Systems and methods for interfaces featuring surface-based haptic effects

• US 10,248,213 B2
• Filed: 05/24/2018
• Issued: 04/02/2019
• Est. Priority Date: 03/12/2009
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Cruz-Hernandez, Juan Manuel, Grant, Danny A., Modarres, Ali, Gosline, Andrew
• Primary Examiner(s): Foxx, Chico A
• Application Number:
  US15/988,359
• Publication Number:
  US 20180267613A1
• Time in Patent Office: 313 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems

Abstract

Systems and methods for interfaces featuring surface-based haptic effects are described. One described system includes a sensor configured to detect a touch in a touch area when an object contacts a touch surface. The touch surface may correspond to the display area or may correspond to a non-display surface of a computing device or peripheral interfaced to a computing device. The system can further include an actuator in communication with the processor and coupled to the touch surface, the actuator configured to output a haptic effect and a processor configured to select a haptic effect to generate. The haptic effect can be selected based on a position of the touch and recognizing an input gesture provided by the touch and/or content displayed in a graphical user interface at a location mapped to a position in the touch area at or near the touch. The haptic effect may provide a texture, simulate an obstacle, and/or adjust the coefficient of friction of the surface.

Claims

1. A system comprising:

a processor in communication with a haptic output device, configured to;

identify text displayed in a display area associated with a touch surface responsive to a search query;

highlight the identified text displayed in the display area;

determine a haptic effect to generate based on identifying a position of a touch and the highlighted identified text, wherein the haptic effect is configured to adjust a coefficient of friction of the touch surface; and

output a haptic signal associated with the haptic effect to the haptic output device, the haptic output device configured to output the haptic effect while the touch is occurring.

2. The system of claim 1, wherein the haptic output device comprises one or more of:

an ultrasonic actuator or an electrostatic actuator.

3. The system set forth in claim 1, wherein the processor is further configured to determine the haptic effect based on a control displayed in a graphical user interface at a location mapped to a position in the touch surface at or near the position of the touch.

4. The system set forth in claim 1, wherein the processor is further configured to determine the haptic effect in response to recognizing a page turn input gesture, the haptic effect determined to vary the coefficient of friction in a direction of the page turn input gesture as the gesture is provided.

5. The system set forth in claim 1, wherein the processor is configured to determine the haptic effect in response to recognizing a gesture indicating movement of an on-screen content item from a first location to a second location.

6. The system of claim 1, wherein an adjustment of the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

7. The system of claim 1, wherein selecting a haptic effect to generate further comprises determining a haptic value associated with one or more pixels at the position of the touch.

8. A method, comprising:

identifying text displayed in a display area associated with a touch surface responsive to a search query;

highlighting the identified text displayed in the display area;

determining a haptic effect to generate based on identifying a position of a touch and the highlighted identified text, wherein the haptic effect is configured to adjust a coefficient of friction of the touch surface; and

outputting a haptic signal associated with the haptic effect to a haptic output device, the haptic output device configured to output the haptic effect while the touch is occurring.

9. The method of claim 8, wherein the haptic output device comprises one or more of:

an ultrasonic actuator or an electrostatic actuator.

10. The method of claim 8, further comprising determining the haptic effect based on a control displayed in a graphical user interface at a location mapped to a position in the touch surface at or near the position of the touch.

11. The method of claim 8, further comprising determining the haptic effect in response to recognizing a page turn input gesture, the haptic effect determined to vary the coefficient of friction in a direction of the page turn input gesture as the gesture is provided.

12. The method of claim 8, further comprising determining the haptic effect in response to recognizing a gesture indicating movement of an on-screen content item from a first location to a second location.

13. The method of claim 8, wherein selecting a haptic effect to generate further comprises determining a haptic value associated with one or more pixels at the position of the touch.

14. The method set forth in claim 8, wherein the touch comprises adjusting an on-screen control and the haptic effect is selected based on a value of the on-screen control.

15. The method of claim 8, wherein an adjustment of the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

16. A non-transitory computer-readable medium embodying program code, which when executed by a processor is configured to cause the processor to:

identify text displayed in a display area associated with a touch surface responsive to a search query;

highlight the identified text displayed in the display area;

determine a haptic effect to generate based on identifying a position of a touch and the highlighted identified text, wherein the haptic effect is configured to adjust a coefficient of friction of the touch surface; and

output a haptic signal associated with the haptic effect to a haptic output device, the haptic output device configured to output the haptic effect while the touch is occurring.

17. The non-transitory computer readable medium of claim 16, wherein selecting a haptic effect to generate further comprises determining a haptic value associated with one or more pixels at the position of the touch.

18. The non-transitory computer readable medium of claim 16, further comprising program code which when executed by the processor is configured to cause the processor to:

determine the haptic effect in response to recognizing a gesture indicating movement of an on-screen content item from a first location to a second location.

19. The non-transitory computer readable medium of claim 16, wherein the haptic output device comprises one or more of:

an ultrasonic actuator or an electrostatic actuator.

20. The non-transitory computer readable medium of claim 16, wherein adjusting the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.