SYSTEMS AND METHODS FOR A HAPTICALLY-ENABLED PROJECTED USER INTERFACE

• US 20150185841A1
• Filed: 12/30/2013
• Published: 07/02/2015
• Est. Priority Date: 12/30/2013
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Levesque, Vincent, Weddle, Amaya B., Birnbaum, David M., Modarres, Ali
• Granted Patent: US 9,965,034 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1639 the display being based on projection
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

One illustrative system disclosed herein includes a sensor configured to detect a user input associated with a projected user interface and transmit a sensor signal associated with the user interaction, and a processor in communication with the sensor, the processor configured to: receive the sensor signal, determine a remote haptic effect based at least in part on the user input, generate a haptic signal based at least in part on the remote haptic effect, and transmit the haptic signal. The illustrative system further includes a haptic output device in communication with the processor, the haptic output device configured to receive the haptic signal and output the remote haptic effect.

Claims

1. A system comprising:

a sensor configured to detect a user input associated with a projected user interface and transmit a sensor signal associated with the user interaction;

a processor in communication with the sensor, the processor configured to;

receive the sensor signal;

determine a remote haptic effect based at least in part on the user input;

generate a haptic signal based at least in part on the remote haptic effect; and

transmit the haptic signal; and

a haptic output device in communication with the processor, the haptic output device configured to receive the haptic signal and output the remote haptic effect.

2. The system of claim 1, wherein the sensor comprises one or more of a camera, an accelerometer, a gyroscope, a depth sensor, or a touch-sensitive surface.

3. The system of claim 1, further comprising a projector.

4. The system of claim 1, wherein the projected user interface is projected onto a surface, and wherein the haptic output device is configured to output the remote haptic effect onto the surface.

5. The system of claim 4, wherein the haptic output device is directly coupled to the surface.

6. The system of claim 1, wherein the projected user interface is projected onto a surface, and wherein the haptic output device is remote from the surface.

7. The system of claim 6, wherein the haptic output device is directly coupled to a user.

8. The system of claim 6, wherein the haptic output device is associated with a device configured to be worn by a user.

9. The system of claim 1, wherein the remote haptic effect comprises one or more of a vibration, a texture, a change in a coefficient of friction, a change in temperature, or an emission of one or more of solids, liquids, gasses, plasmas, or sound pressure waves.

10. The system of claim 1, wherein the haptic output device comprises one or more of an ultrasonic transducer, a speaker, a jet, a piezoelectric actuator, an electric motor, an electro-magnetic actuator, a voice coil, a shape memory alloy, an electro-active polymer, a solenoid, an eccentric rotating mass motor, or a linear resonant actuator.

11. A method comprising:

receiving a sensor signal associated with a user input that is associated with a projected user interface;

determining a remote haptic effect based at least in part on the sensor signal;

generating a haptic signal based at least in part on the remote haptic effect; and

transmitting a haptic signal associated with the remote haptic effect to a haptic output device.

12. The method of claim 11, wherein the sensor comprises one or more of a camera, an accelerometer, a gyroscope, a depth sensor, or a touch-sensitive surface.

13. The method of claim 11, wherein the projected user interface is projected onto a surface, and wherein the haptic output device is remote from the surface.

14. The method of claim 13, wherein the haptic output device is directly coupled to a user.

15. The method of claim 13, wherein the haptic output device is associated with a device configured to be worn by a user.

16. The method of claim 11, wherein the remote haptic effect comprises one or more of a vibration, a texture, a change in temperature, a change in a coefficient of friction, a change in temperature, or an emission of one or more of solids, liquids, gasses, plasmas, or sound pressure waves.

17. The method of claim 11, wherein the haptic output device comprises one or more of an ultrasonic transducer, a speaker, a jet, a piezoelectric actuator, an electric motor, an electro-magnetic actuator, a voice coil, a shape memory alloy, an electro-active polymer, a solenoid, an eccentric rotating mass motor, or a linear resonant actuator.

18. A non-transient computer readable medium comprising program code, which when executed by a processor is configured to cause the processor to:

receive a sensor signal associated with a user input that is associated with a projected user interface;

determine a remote haptic effect based at least in part on the sensor signal;

generate a haptic signal based at least in part on the remote haptic effect; and

transmit the haptic signal associated with the remote haptic effect to a haptic output device.

19. The non-transient computer readable medium of claim 18, wherein the remote haptic effect comprises one or more of a vibration, a texture, a change in temperature, a change in a coefficient of friction, or an emission of one or more of solids, liquids, gasses, plasmas, or sound pressure waves.

20. The non-transient computer readable medium of claim 18, wherein the haptic output device comprises one or more of an ultrasonic transducer, a speaker, a jet, a piezoelectric actuator, an electric motor, an electro-magnetic actuator, a voice coil, a shape memory alloy, an electro-active polymer, a solenoid, an eccentric rotating mass motor, or a linear resonant actuator.