Simulating touch in a virtual environment

• US 10,579,145 B2
• Filed: 06/06/2018
• Issued: 03/03/2020
• Est. Priority Date: 01/27/2016
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Gustin, Clayton
• Primary Examiner(s): Lett, Thomas J
• Application Number:
  US16/001,347
• Publication Number:
  US 20180284898A1
• Time in Patent Office: 636 Days
• Field of Search: 345633
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

In various example embodiments, a system and method for simulating touch in a virtual environment is disclosed. In one example embodiment, a system includes one or more circuits configured to receive an indicator of a sensed touch in a virtual environment and to determine, based on the indicator, an area of the sensed touch. The one or more circuits are further configured to generate a simulated touch by applying a ld to one or more touch simulators, the field actuating the one or more touch simulators by linearly displacing an element of the one or more touch simulators.

Claims

1. A system, comprising:

one or more circuits configured to;

receive an indicator of a sensed touch in a virtual environment, the indicator identifying a texture of touch to be simulated;

determine, based on the indicator, an area of the sensed touch;

retrieve, from a database of a plurality of textures, a touch texture corresponding to the texture of touch identified by the indicator, the database storing a level of each of the plurality of textures; and

generate, according to the retrieved touch texture, a simulated touch by applying a field to one or more touch simulators corresponding to the determined area of the sensed touch, the field actuating the one or more touch simulators by linearly displacing an element of the one or more touch simulators.

2. They system of claim 1, wherein the one or more touch simulators operate as a touch interface for a user of the virtual environment, and to generate the simulated touch is to apply the field to at least one touch simulator located at an area of the touch interface corresponding to the area of the sensed touch.

3. The system of claim 1, wherein the one or more circuits are further configured to position equally spaced ones of the one or more touch simulators at different heights to generate the simulated touch according to the retrieved touch texture, wherein the heights are adjusted based on the retrieved touch texture.

4. The system of claim 1, wherein:

the one or more circuits are further configured to determine a magnitude of the sensed touch, and simulate pinching by activating two or more of the one or more touch simulators that are within a threshold distance of each other; and

the field actuates the one or more touch simulators according to the magnitude of the sensed touch in the area of the sensed touch.

5. The system of claim 1, wherein the one or more touch simulators are configured in an article of clothing, and linearly displacing the element of the one or more touch simulators to causes the element to contact the skin of a user that wears the article, and wherein the one or more circuits are further configured to map a location in the virtual environment corresponding to a person represented in the virtual environment with a corresponding location on an article of apparel that includes the one or more touch simulators.

6. The system of claim 5, wherein the sensed touch comprises the user donning the article of clothing, the simulated touch corresponding to a texture of the clothing, the area of the sensed touch comprising one or more areas where the article of clothing touches the user in the virtual environment.

7. The system of claim 1, wherein the one or more circuits are further configured to send current to a micro-sphere to apply a temperature to an area of the sensed touch.

8. The system of claim 1, wherein the sensed touch comprises a user touching a virtual item corresponding to a physical item that is available for purchase.

9. The system of claim 1, wherein:

the one or more touch simulators are disposed in an array,

each of the one or more touch simulators comprise one more charged micro-spheres, and

the array further comprises insulators between the micro-spheres enabling the system to effectuate each micro-sphere independently.

10. A method, comprising:

receiving data indicative of a sensed touch in a virtual environment, the data identifying a texture of touch to be simulated;

determining, based on the received data, an area of the sensed touch;

retrieving, from a database of a plurality of textures, a touch texture corresponding to the texture of touch identified by the data, the database storing a level of each of the plurality of textures; and

simulating, according to the retrieved touch texture, a virtual touch by applying an electric-field to one or more touch simulators corresponding to the determined area of the sensed touch, the electric-field moving the one or more touch simulators by displacing an element of the one or more touch simulators.

11. The method of claim 10, wherein the electric-field displaces the element of the one or more touch simulators a distance proportional to a force of the sensed touch.

12. The method of claim 10, wherein the one or more touch simulators operate as a touch interface for a user of the virtual environment, and simulating the virtual touch comprises applying the electric-field to at least one touch simulator located at an area of the touch interface corresponding to the area of the sensed touch.

13. The method of claim 10, further comprising determining a magnitude of the sensed touch, wherein the electric-field actuates the one or more touch simulators according to the magnitude of the sensed touch in the area of the sensed touch.

14. The method of claim 10, wherein the one or more touch simulators are configured in an article of clothing, and displacing the element of the one or more touch simulators comprises causing the element to contact the skin of a user that wears the article.

15. The method of claim 14, wherein the sensed touch comprises the user donning the article of clothing, the simulated touch corresponding to a texture of the clothing, the area of the sensed touch comprising one or more areas where the article of clothing touches the user in the virtual environment.

16. A device, comprising:

an article of clothing; and

an array of one or more touch simulators embedded in the article of clothing, at least one touch simulator of the one or more touch simulator comprising;

a charged element comprising a microsphere,

an insulator configured to insulate a charged microsphere from another charged microsphere, and

at least two electrodes to receive a command signal to simulate a touch by moving the charged element in the insulator using a field generated according to the command signal, the simulated touch corresponding to a sensed touch in a virtual environment, the command signal being generated by retrieving, from a database of a plurality of textures, a touch texture corresponding to texture of touch to be simulated, the database storming a level of each of the plurality of textures.

17. The device of claim 16, wherein the sensed touch comprises a user donning the article of clothing, the command signal configured to position equally spaced ones of the one or more touch simulators at different heights to generate the simulated touch according to the retrieved touch texture, wherein the heights are adjusted based on the retrieved touch texture.

18. The device of claim 16, wherein the field generated according to the command signal moves the charged element in the insulator according to at least one of a magnitude of the sensed touch, a force of the sensed touch, or a texture of the sensed touch.

19. The device of claim 16, wherein the charged element is a magnetic cylinder, the field generated according to the command signal comprises an electro-magnetic field applied to the magnetic cylinder causing a displacement of the magnetic cylinder.

20. The device of claim 16, wherein the charged element is a micro-sphere, the field generated according to the command signal comprises an electro-magnetic field applied to the micro-sphere causing a displacement of the micro-sphere.