Systems and methods for using textures in graphical user interface widgets

• US 9,927,873 B2
• Filed: 01/29/2010
• Issued: 03/27/2018
• Est. Priority Date: 03/12/2009
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Cruz-Hernandez, Juan Manuel, Grant, Danny A, Modarres, Ali, Gosline, Andrew
• Primary Examiner(s): Zimmerman, Brian
• Assistant Examiner(s): Lau, Kevin
• Application Number:
  US12/697,037
• Publication Number:
  US 20100231541A1
• Time in Patent Office: 2,979 Days
• Field of Search: None
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems

Abstract

Systems and methods for using textures in graphical user interface widgets are disclosed. For example, one disclosed system includes: a system including: an actuator configured to receive a haptic signal and output a haptic effect based at least in part on the haptic signal, the haptic effect configured to simulate a texture; a touch-sensitive interface configured to detect a user interaction and output a interface signal; and a processor in communication with the actuator and the touch-sensitive interface, the processor configured to: receive the interface signal; receive a display signal including a plurality of pixels defining a display area; determine a first texture associated with a first group of pixels defining a first section of the display area; determine a second texture associated with a second group of pixels defining a second section of the display area; and transmit a haptic signal configured to cause the actuator to: output a first haptic effect configured to simulate the first texture if the user interaction is associated with the first section of the display area, and output a second haptic effect configured to simulate the second texture if the user interaction is associated with the second section of the display area.

Claims

1. A system comprising:

a first actuator and a second actuator, each configured to receive a haptic signal and output a haptic effect based at least in part on the haptic signal, the haptic effect configured to simulate a texture;

a touch-sensitive interface configured to detect a user interaction and output an interface signal; and

a processor in communication with the actuator and the touch-sensitive interface, the processor configured to;

receive the interface signal;

receive a display signal comprising a plurality of pixels defining a display area, wherein each of the plurality of pixels is associated with a color;

assign a haptic value to each color;

determine a first texture associated with a first group of pixels defining a first section of the display area, wherein determining the first texture comprises determining the haptic value associated with one or more of the first group of pixels;

determine a second texture associated with a second group of pixels defining a second section of the display area, wherein determining the second texture comprises determining the haptic value associated with one or more of the second group of pixels;

determine a selected actuator by selecting the first actuator if the haptic value is less than a threshold or selecting the second actuator if the haptic value is greater than or equal to the threshold; and

transmit a haptic signal configured to cause the selected actuator to;

output a first haptic effect configured to simulate the first texture if the user interaction is associated with the first section of the display area, and

output a second haptic effect configured to simulate the second texture if the user interaction is associated with the second section of the display area.

2. The system of claim 1, wherein first texture and the second texture are each based at least in part on the display signal.

3. The system of claim 1, wherein the texture is a vibrotactile effect.

4. The system of claim 1, wherein the texture comprises the texture of:

sand, grass, bricks, rocks, skin, fabric, or fur.

5. The system of claim 1, wherein the selected actuator comprises:

a linear resonant actuator, an eccentric rotating mass actuator, a shape memory alloy, an electroactive polymer, a composite piezoelectric actuator, or a piezoelectric actuator.

6. The system of claim 1, wherein the first section of the display area comprises a boundary, and the second section of the display area comprises the pixels that do not comprise the boundary.

7. The system of claim 1, wherein the first section of the display area comprises a route and the second section of the display area comprises a Global Positioning System Interface.

8. The system of claim 1, wherein the first section of the display area comprises a destination and the second section of the display area comprises a Global Positioning System Interface.

9. The system of claim 1, wherein the first section of the display area comprises a location on a social networking page and the second section of the display area comprises the remainder of the social networking page.

10. The system of claim 1, wherein first section of the display area comprises a scrollbar and the second section of the display area comprises pixels that do not comprise the scrollbar.

11. The system of claim 10, wherein the processor is configured to determine a different texture in the first section of the display area as the scrollbar moves.

12. The system of claim 1, wherein the first section of the display area comprises text and the second section of the display area comprises the remainder of the display area.

13. The system of claim 1, wherein the first section of the display area comprises a section of the display area determined based at least in part on the interface signal, and the second section of the display area comprises the remainder of the display area.

14. The system of claim 1, wherein the first section of the display area comprises an icon and the second section of the display area comprises the remainder of the display area.

15. The system of claim 14, wherein the icon comprises a drawing tool.

16. The system of claim 14, wherein the icon comprises a folder.

17. The system of claim 16, wherein the first texture is determined based at least in part on the contents of the folder.

18. The system of claim 1, further comprising a display in communication with the processor, the display configured to receive the display signal and output an image based at least in part on the display signal.

19. The system of claim 18, wherein the first texture and the second texture are output on a surface of the display.

20. A method for outputting textures comprising:

receiving a display signal comprising a plurality of pixels defining a display area, wherein each of the plurality of pixels is associated with a color;

assigning a haptic value to each color;

receiving an interface signal from a touch-sensitive interface configured to detect a user interaction and output an interface signal;

determining a first texture associated with a first group of pixels defining a first section of the display area, wherein determining the first texture comprises determining the haptic value associated with one or more of the first group of pixels;

determining a second texture associated with a second group of pixels defining a second section of the display area, wherein determining the second texture comprises determining the haptic value associated with one or more of the second group of pixels; and

determine a selected actuator by selecting a first actuator if the haptic value is less than a threshold or selecting a second actuator if the haptic value is greater than or equal to the threshold; and

transmitting a haptic signal to the selected actuator configured to receive the haptic signal and output a haptic effect, the haptic signal configured to cause the selected actuator to;

output a first haptic effect configured to simulate the first texture if the user interaction is associated with the first section of the display area, and

output a second haptic effect configured to simulate the second texture if the user interaction is associated with the second section of the display area.

21. The method of claim 20, further comprising receiving the display signal and outputting an image based at least in part on the display signal.

22. The method of claim 21, wherein the first haptic effect and the second haptic effect are output on a surface of the display.

23. A system comprising:

a first actuator and a second actuator, each configured to receive a haptic signal and output a haptic effect configured to simulate a texture based at least in part on the haptic signal;

a touch-sensitive interface configured to detect a user interaction and output an interface signal associated with the user interaction;

a processor in communication with the actuator and the touch-sensitive interface, the processor configured to;

receive the interface signal;

receive a display signal comprising a plurality of pixels defining a display area, wherein each of the plurality of pixels is associated with a color;

assign a haptic value to each color;

determine a first texture based at least in part on the display signal and the interface signal, the first texture associated with a first group of pixels defining a first section of the display area, wherein determining the first texture comprises determining the haptic value associated with one or more of the first group of pixels;

determine a second texture based at least in part on the display signal and the interface signal, the second texture associated with a second group of pixels defining a second section of the display area, wherein determining the second texture comprises determining the haptic value associated with one or more of the second group of pixels; and

determine a selected actuator by selecting the first actuator if the haptic value is less than a threshold or selecting the second actuator if the haptic value is greater than or equal to the threshold; and

transmit a haptic signal configured to cause the selected actuator to;

output a first haptic effect configured to simulate the first texture if the user interaction is associated with the first section of the display area, and

output a second haptic effect configured to simulate the second texture if the user interaction is associated with the second section of the display area; and

a display configured to receive the display signal and output an image based at least in part on the display signal, and wherein the first haptic effect and the second haptic effect are output on a surface of the display.