Systems and methods for force-based object manipulation and haptic sensations

• US 10,031,583 B2
• Filed: 03/19/2015
• Issued: 07/24/2018
• Est. Priority Date: 03/21/2014
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Levesque, Vincent, Cruz-Hernandez, Juan Manuel, Grant, Danny, Saboune, Jamal, Wu, Liwen, Stahlberg, Kurt Eerik, Hamam, Abdelwahab
• Primary Examiner(s): Zhou, Hong
• Application Number:
  US14/663,406
• Publication Number:
  US 20150268725A1
• Time in Patent Office: 1,223 Days
• Field of Search: 345173-174, 715863
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Abstract

Systems and methods for force-based object manipulation and haptic sensations are disclosed. One disclosed method includes the steps of receiving a first signal indicating a location of a user interaction and receiving a second signal indicating a first force. The method also includes, if the location of the user interaction corresponds to an object displayed on a display screen: outputting a first haptic signal to a haptic output device to cause a first haptic effect; and outputting a second haptic signal to the haptic output device to cause a second haptic effect if the first force meets or exceeds a first force threshold.

Claims

1. A method comprising:

receiving, by a processor and from a sensor, one or more signals indicating a location and a force of an interaction with a surface;

determining, by the processor, that the location of the interaction corresponds to an object displayed on a display screen; and

causing, by the processor, a haptic output device to output haptic effects that are configured to simulate a texture of the object in increasing detail in response to the force increasing or in decreasing detail in response to the force decreasing,

wherein the haptic effects are generated according to a relationship between (i) a haptic function associated with a haptic effect, and (ii) a mapping function that maps the force to a value.

2. The method of claim 1, further comprising:

generating a first layer signal configured to cause a first layer of a graphical user interface (GUI) having a plurality of layers to be displayed on the display screen in response to the force being below a force threshold; and

generating a second layer signal configured to cause a second layer of the GUI to be displayed on the display screen in response to the force meeting or exceeding the force threshold.

3. The method of claim 2, wherein the force threshold is a first force threshold, and further comprising:

determining whether the force meets or exceeds both the first force threshold and a second force threshold that is greater than the first force threshold; and

in response to determining that the force meets or exceeds both the first force threshold and the second force threshold;

generating a third layer signal configured to cause a third layer of the GUI to be displayed on the display screen, the third layer different from the first layer and the second layer; and

transmitting the third layer signal to the display screen.

4. The method of claim 3, wherein the second layer and the third layer visually represent different views of the object.

5. The method of claim 1, wherein the haptic effect is a first haptic effect, and the relationship further includes a second haptic function associated with a second haptic effect that is different from the first haptic effect.

6. The method of claim 1, further comprising:

in response to the location of the interaction corresponding to the object and the force being below a force threshold, outputting a first haptic effect configured to simulate a first characteristic of a first layer of the object; and

in response to the location of the interaction corresponding to the object and the force meeting or exceeding the force threshold, outputting a second haptic effect configured to simulate a second characteristic of (i) a virtual item positioned beneath a surface of the first layer, or (ii) a second layer positioned beneath the first layer.

7. The method of claim 6, wherein the second characteristic includes a texture of the virtual item positioned beneath the surface of the first layer.

8. The method of claim 6, wherein the second characteristic includes a texture of the second layer positioned beneath the first layer.

9. The method of claim 6, wherein the first characteristic includes a first texture and the second characteristic includes a second texture.

10. The method of claim 6, wherein the force threshold is modified over time based on a usage pattern of a user.

11. The method of claim 1, further comprising causing the haptic output device to output a mixture of a first haptic effect simulating a first layer of the object and a second haptic effect simulating a second layer of the object.

12. The method of claim 11, where in the second layer of the object is positioned underneath the first layer of the object.

13. The method of claim 1, further comprising causing the haptic output device to output a mixture of a first haptic effect simulating a layer of the object and a second haptic effect simulating a virtual item positioned within the object.

14. A non-transitory computer-readable medium comprising program code that is executable by a processor to cause the processor to:

receive, from a sensor, one or more signals indicating a location and a force of an interaction with a surface;

determine that the location of the interaction corresponds to an object displayed on a display screen; and

cause a haptic output device to output haptic effects that are configured to simulate a texture of the object in increasing detail in response to the force increasing or in decreasing detail in response to the force decreasing,

wherein the haptic effects are generated according to a relationship between (i) a haptic function associated with a haptic effect, and (ii) a mapping function that maps the force to a value.

15. The non-transitory computer-readable medium of claim 14, further comprising program code that is executable by the processor to cause the processor to:

generate a first layer signal configured to cause a first layer of a graphical user interface (GUI) having a plurality of layers to be displayed on the display screen in response to the force being below a force threshold; and

generate a second layer signal configured to cause a second layer of the GUI to be displayed on the display screen in response to the force meeting or exceeding the force threshold.

16. The non-transitory computer-readable medium of claim 15, wherein the force threshold is a first force threshold, and further comprising program code that is executable by the processor to cause the processor to:

determine whether the force meets or exceeds both the first force threshold and a second force threshold that is greater than the first force threshold; and

in response to determining that the force meets or exceeds both the first force threshold and the second force threshold;

generate a third layer signal configured to cause a third layer of the GUI to be displayed on the display screen, the third layer different from the first layer and the second layer; and

transmit the third layer signal to the display screen.

17. The non-transitory computer-readable medium of claim 16, wherein the second layer and the third layer visually represent different views of the object.

18. The non-transitory computer-readable medium of claim 14, wherein the haptic effect is a first haptic effect, and the relationship further includes a second haptic function associated with a second haptic effect that is different from the first haptic effect.

19. The non-transitory computer-readable medium of claim 14, further comprising program code that is executable by the processor to cause the processor to:

in response to the location of the interaction corresponding to the object and the force being below a force threshold, output a first haptic signal to the haptic output device to cause the haptic output device to output a first haptic effect, the first haptic effect being configured to simulate a first characteristic of a first layer of the object; and

in response to the location of the interaction corresponding to the object and the force meeting or exceeding the force threshold, output a second haptic signal to the haptic output device to cause the haptic output device to output a second haptic effect, the second haptic effect being configured to simulate a second characteristic of (i) a virtual item positioned beneath a surface of the first layer, or (ii) a second layer positioned beneath the first layer.

20. A system comprising:

a haptic output device configured to receive a haptic signal and output a haptic effect;

a processor communicatively coupled to the haptic output device; and

a memory on which program code executable by the processor is stored to cause the processor to;

receive, from a sensor, one or more signals indicating a location and a force of an interaction with a surface;

determine that the location of the interaction corresponds to an object displayed on a display screen and the force meets or exceeds a force threshold; and

cause the haptic output device to output haptic effects that are configured to simulate a texture of the object in increasing detail in response to the force increasing or in decreasing detail in response to the force decreasing,

wherein the haptic effects are generated based on a relationship between (i) a haptic function associated with a haptic effect, and (ii) a mapping function that maps the force to a value.

21. The system of claim 20, wherein the memory further comprises program code executable by the processor to cause the processor to:

generate a first layer signal configured to cause a first layer of a graphical user interface (GUI) having a plurality of layers to be displayed on the display screen in response to the force being below a force threshold; and

generate a second layer signal configured to cause a second layer of the GUI to be displayed on the display screen in response to the force meeting or exceeding the force threshold.

22. The system of claim 21, wherein the force threshold is a first force threshold, and wherein the memory further comprises program code executable by the processor to cause the processor to:

determine whether the force meets or exceeds both the first force threshold and a second force threshold that is greater than the first force threshold; and

in response to determining that the force meets or exceeds both the first force threshold and the second force threshold;

generate a third layer signal configured to cause a third layer of the GUI to be displayed on the display screen, the third layer different from the first layer and the second layer; and

transmit the third layer signal to the display screen.

23. The system of claim 22, wherein the first layer, second layer, and the third layer visually represent different views of the object.

24. The system of claim 20, wherein the memory further comprising program code that is executable by the processor to cause the processor to:

in response to the location of the interaction corresponding to the object and the force being below a force threshold, output a first haptic signal to the haptic output device to cause the haptic output device to output a first haptic effect, the first haptic effect being configured to simulate a first characteristic of a first layer of the object; and

in response to the location of the interaction corresponding to the object and the force meeting or exceeding the force threshold, output a second haptic signal to the haptic output device to cause the haptic output device to output a second haptic effect, the second haptic effect being configured to simulate a second characteristic of (i) a virtual item positioned beneath a surface of the first layer, or (ii) a second layer positioned beneath the first layer.