Systems and Methods for Force-Based Object Manipulation and Haptic Sensations

• US 20150268725A1
• Filed: 03/19/2015
• Published: 09/24/2015
• Est. Priority Date: 03/21/2014
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Levesque, Vincent, Cruz-Hernandez, Juan Manuel, Grant, Danny, Wu, Liwen, Seboune, Jamal, Stahlberg, Kurt Eerik, Hamam, Abdelwahab
• Granted Patent: US 10,031,583 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Abstract

Systems and methods for force-based object manipulation and haptic sensations are disclosed. One disclosed method includes the steps of receiving a first signal indicating a location of a user interaction and receiving a second signal indicating a first force. The method also includes, if the location of the user interaction corresponds to an object displayed on a display screen: outputting a first haptic signal to a haptic output device to cause a first haptic effect; and outputting a second haptic signal to the haptic output device to cause a second haptic effect if the first force meets or exceeds a first force threshold.

Claims

1. A method of producing a haptic effect, the method comprising:

receiving a first signal indicating a location of a user interaction;

receiving a second signal indicating a first force;

if the location of the user interaction corresponds to an object displayed on a display screen;

outputting a first haptic signal to a haptic output device to cause a first haptic effect; and

outputting a second haptic signal to the haptic output device to cause a second haptic effect if the first force meets or exceeds a first force threshold.

2. The method of claim 1, further comprising:

comparing the first force to a second force threshold that is greater than the first force threshold; and

if the first force meets or exceeds the second force threshold;

determining an action to take with respect to the object based on the location of the user interaction; and

executing a modified action based on the first force.

3. The method of claim 2, further comprising:

establishing an exploration mode responsive to determining the first force meets or exceeds the first force threshold, but does not meet or exceed the second force threshold; and

establishing a manipulation mode responsive to determining the first force meets or exceeds the first force threshold and meets or exceeds the second force threshold.

4. The method of claim 3, wherein the exploration mode provides haptic effects if the location of the user interaction corresponds to the object displayed on the display screen, but does not execute the action, and wherein the manipulation mode provides haptic effects if the location of the user interaction corresponds to the object displayed on the display screen, and also executes the action.

5. The method of claim 1, further comprising:

generating a first layer signal configured to cause a first layer of a graphical user interface (GUI) having a plurality of layers to be displayed on the display screen; and

generating a second layer signal configured to cause a second layer of the GUI to be displayed on the display screen if the first force meets or exceeds the first force threshold.

6. The method of claim 5, further comprising:

determining whether the first force meets or exceeds both the first force threshold and a second force threshold that is greater than the first force threshold; and

if the first force meets or exceeds both the first force threshold and the second force threshold;

generating a third layer signal configured to cause a third layer of the GUI to be displayed on the display screen, the third layer different from the first layer and the second layer; and

transmitting the third layer signal to the display screen.

7. The method of claim 6, further comprising:

outputting a third haptic signal to the haptic output device to cause a third haptic effect if the second layer comprises the object; and

outputting a fourth haptic signal to the haptic output device to cause a fourth haptic effect if the third layer comprises the object.

8. The method of claim 1, further comprising:

generating the first haptic signal based on the first force and a texture associated with the object.

9. The method of claim 8, further comprising:

receiving one or more additional signals indicating a second user interaction comprising a second force at a second location, the second force comprising a greater intensity than the first force;

generating the second haptic signal based on another texture of a virtual object layered beneath the object.

10. A computer-readable medium comprising program code for producing a haptic effect, the computer-readable medium comprising:

program code for receiving a first signal indicating a location of a user interaction;

program code for receiving a second signal indicating a first force;

program code for, if the location of the user interaction corresponds to an object displayed on a display screen;

outputting a first haptic signal to a haptic output device to cause a first haptic effect; and

outputting a second haptic signal to the haptic output device to cause a second haptic effect if the first force meets or exceeds a first force threshold.

11. The computer-readable medium of claim 10, further comprising:

program code for comparing the first force to a second force threshold that is greater than the first force threshold; and

program code for, if the first force meets or exceeds the second force threshold;

determining an action to take with respect to the object based on the location of the user interaction; and

executing a modified action based on the first force.

12. The computer-readable medium of claim 11, further comprising:

program code for establishing an exploration mode responsive to determining the first force meets or exceeds the first force threshold, but does not meet or exceed the second force threshold; and

program code for establishing a manipulation mode responsive to determining the first force meets or exceeds the first force threshold and meets or exceeds the second force threshold.

13. The computer-readable medium of claim 12, wherein the exploration mode provides haptic effects if the location of the user interaction corresponds to the object displayed on the display screen, but does not execute the action, and wherein the manipulation mode provides haptic effects if the location of the user interaction corresponds to the object displayed on the display screen, and also executes the action.

14. The computer-readable medium of claim 10, further comprising:

program code for generating a first layer signal configured to cause a first layer of a graphical user interface (GUI) having a plurality of layers to be displayed on the display screen; and

program code for generating a second layer signal configured to cause a second layer of the GUI to be displayed on the display screen if the first force meets or exceeds the first force threshold.

15. The computer-readable medium of claim 14, further comprising:

program code for determining whether the first force meets or exceeds both the first force threshold and a second force threshold that is greater than the first force threshold; and

program code for, if the first force meets or exceeds both the first force threshold and the second force threshold;

generating a third layer signal configured to cause a third layer of the GUI to be displayed on the display screen, the third layer different from the first layer and the second layer; and

transmitting the third layer signal to the display screen.

16. The computer-readable medium of claim 15, further comprising:

program code for outputting a third haptic signal to the haptic output device to cause a third haptic effect if the second layer comprises the object; and

program code for outputting a fourth haptic signal to the haptic output device to cause a fourth haptic effect if the third layer comprises the object.

17. The computer-readable medium of claim 10, further comprising:

program code for generating the first haptic signal based on the first force and a texture associated with the object.

18. The computer-readable medium of claim 17, further comprising:

program code for receiving one or more additional signals indicating a second user interaction comprising a second force at a second location, the second force comprising a greater intensity than the first force;

program code for generating the second haptic signal based on another texture of a virtual object layered beneath the object.

19. A system for producing a haptic effect, the system comprising:

a computer-readable medium; and

a processor in communication with the computer-readable medium, the processor configured to execute program code stored in the computer-readable medium, the program code configured to cause the processor to perform the following operations;

receive a first signal indicating a location of a user interaction;

receive a second signal indicating a first force;

if the location of the user interaction corresponds to an object displayed on a display screen;

output a first haptic signal to a haptic output device to cause a first haptic effect; and

output a second haptic signal to the haptic output device to cause a second haptic effect if the first force meets or exceeds a first force threshold.

20. The system of claim 19, the processor further configured to:

compare the first force to a second force threshold that is greater than the first force threshold; and

if the first force meets or exceeds the second force threshold;

determine an action to take with respect to the object based on the location of the user interaction; and

execute a modified action based on the first force.

21. The system of claim 20, the processor further configured to:

establish an exploration mode responsive to determining the first force meets or exceeds the first force threshold, but does not meet or exceed the second force threshold; and

establish a manipulation mode responsive to determining the first force meets or exceeds the first force threshold and meets or exceeds the second force threshold.

22. The system of claim 21, wherein the exploration mode provides haptic effects based on contacts corresponding with a plurality of objects displayed on the display screen, but prevents interaction with the plurality of objects, and wherein the manipulation mode provides haptic effects based on contacts corresponding with the plurality of objects displayed on the display screen, and also provides interaction with the plurality of objects.

23. The system of claim 19, the processor further configured to:

generate a first layer signal configured to cause a first layer of a graphical user interface (GUI) having a plurality of layers to be displayed on the display screen; and

generate a second layer signal configured to cause a second layer of the GUI to be displayed on the display screen if the first force meets or exceeds the first force threshold.

24. The system of claim 23, the processor further configured to:

determine whether the first force meets or exceeds both the first force threshold and a second force threshold that is greater than the first force threshold; and

if the first force meets or exceeds both the first force threshold and the second force threshold;

generate a third layer signal configured to cause a third layer of the GUI to be displayed on the display screen, the third layer different from the first layer and the second layer; and

transmit the third layer signal to the display screen.

25. The system of claim 24, the processor further configured to:

output a third haptic signal to the haptic output device to cause a third haptic effect if the second layer comprises the object; and

output a fourth haptic signal to the haptic output device to cause a fourth haptic effect if the third layer comprises the object.

26. The system of claim 19, the processor further configured to:

generate the first haptic signal based on the first force and a texture associated with the object.

27. The system of claim 26, the processor further configured to:

receive one or more additional signals indicating a second user interaction comprising a second force at a second location, the second force comprising a greater intensity than the first force;

generate the second haptic signal based on another texture of a virtual object layered beneath the object.