Systems and methods for interfaces featuring surface-based haptic effects

• US 10,007,340 B2
• Filed: 01/29/2010
• Issued: 06/26/2018
• Est. Priority Date: 03/12/2009
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Cruz-Hernandez, Juan Manuel, Grant, Danny A., Modarres, Ali, Gosline, Andrew
• Primary Examiner(s): Wang, Quan-Zhen
• Assistant Examiner(s): Foxx, Chico A
• Application Number:
  US12/696,908
• Publication Number:
  US 20100231539A1
• Time in Patent Office: 3,070 Days
• Field of Search: 340 41, 340 412, 3404071, 3404072, 116205, 341 20- 27, 341 34, 345168-183
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems

Abstract

Systems and methods for interfaces featuring surface-based haptic effects are described. One described system includes a sensor configured to detect a touch in a touch area when an object contacts a touch surface. The touch surface may correspond to the display area or may correspond to a non-display surface of a computing device or peripheral interfaced to a computing device. The system can further include an actuator in communication with the processor and coupled to the touch surface, the actuator configured to output a haptic effect and a processor configured to select a haptic effect to generate. The haptic effect can be selected based on a position of the touch and recognizing an input gesture provided by the touch and/or content displayed in a graphical user interface at a location mapped to a position in the touch area at or near the touch. The haptic effect may provide a texture, simulate an obstacle, and/or adjust the coefficient of friction of the surface.

Claims

1. A system comprising:

a sensor configured to detect a touch in a touch area when an object contacts a touch surface, the touch area mapped to a display area of a graphical user interface; and

a processor in communication with an electrostatic actuator and the sensor, the processor configured to;

identify text displayed in the display area responsive to a search query;

highlight the identified text displayed in the display area in response to the search query;

select a haptic effect to generate based on identifying a position of the touch and the highlighted identified text, wherein the haptic effect is selected to generate a haptic effect at an identified position in the touch area mapped to a position in the display area at or near the highlighted-identified text; and

transmit a haptic signal corresponding to the selected haptic effect to the electrostatic actuator, the electrostatic actuator configured to receive the haptic signal and to generate the selected haptic effect while the touch is occurring, the haptic effect comprising adjusting a coefficient of friction of the touch surface.

2. The system set forth in claim 1, wherein the processor is configured to select a haptic effect based on a control displayed in the graphical user interface at a location mapped to a position in the touch area at or near the position of the touch.

3. The system set forth in claim 1, wherein the processor is configured to select a haptic effect in response to recognizing a page turn input gesture, the haptic effect selected to vary the coefficient of friction in a direction of the page turn input gesture as the gesture is provided.

4. The system set forth in claim 1, wherein the processor is configured to select a haptic effect in response to recognizing a gesture indicating movement of an on-screen content item from a first location to a second location.

5. The system set forth in claim 1, further comprising a display, the display comprising a plurality of pixels and defining the display area, the display configured to output an image based at least in part on a display signal,

wherein the touch surface corresponds to the display or a material above the display, and

wherein the processor is configured to output the display signal.

6. The system set forth in claim 1, further comprising a second actuator configured to provide a haptic effect in response to a haptic signal from the processor.

7. The system of claim 1, wherein an adjustment of the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

8. The system of claim 1, wherein selecting a haptic effect to generate further comprises determining a haptic value associated with one or more pixels at the position of the touch.

9. A method, comprising:

tracking a location of a touch on a touch surface via a sensor in communication with a processor, the location tracked relative to a touch area mapped to a graphical user interface;

based on the location of the touch, identifying, by the processor, an interaction with the graphical user interface;

identifying, by the processor, text displayed in the display area responsive to a search query;

highlighting, by the processor, the identified text displayed in the display area in response to the search query;

selecting, by the processor, a haptic effect to generate based on the interaction and the highlighted identified text, wherein the haptic effect is selected to generate a haptic effect at an identified position in the touch area mapped to a position in the display area at or near the highlighted identified text; and

commanding, by the processor, at least one electrostatic actuator to generate the selected haptic effect, the haptic effect comprising an adjustment of a coefficient of friction of the touch surface, the at least one electrostatic actuator configured to vary the coefficient of friction of the touch surface.

10. The method set forth in claim 9, wherein the interaction comprises adjusting an on-screen control and the haptic effect is selected based on a value of the on-screen control.

11. The method set forth in claim 9, wherein the interaction comprises touching the surface at or near a location mapped to a portion of the graphical user interface containing a feature, the feature associated with the haptic effect.

12. The method set forth in claim 11, wherein the feature comprises a textual or graphic element in the interface highlighted in response to the search query.

13. The method set forth in claim 11, wherein the feature comprises graphical or textual content.

14. The method set forth in claim 11, wherein the feature comprises a boundary in the graphical user interface.

15. The method set forth in claim 9, wherein the interaction comprises an input gesture.

16. The method set forth in claim 15, wherein the haptic effect is provided during the input gesture.

17. The method set forth in claim 15, wherein the haptic effect is provided after the input gesture.

18. The method of claim 9, wherein an adjustment of the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

19. A non-transitory computer-readable medium embodying program code, which when executed by a processor is configured to cause the processor to:

track a location of a touch on a touch surface via a sensor in communication with the processor, the location tracked relative to a touch area mapped to a graphical user interface;

identify, based on the location of the touch, an interaction with the graphical user interface;

identify text displayed in the display area responsive to a search query;

highlight the identified text displayed in the display area in response to the search query;

select a haptic effect to generate based on the interaction and the highlighted identified text, wherein the haptic effect is selected to generate a haptic effect at an identified position in the touch area mapped to a position in the display area at or near the highlighted identified text; and

transmit a haptic signal corresponding to the selected haptic effect to at least one electrostatic actuator, the haptic effect comprising adjusting a coefficient of friction of the touch surface, the at least one electrostatic actuator configured to vary the coefficient of friction of the touch surface.

20. The non-transitory computer readable medium of claim 19, wherein adjusting the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.