System and method for simulated physical interactions with haptic effects

• US 9,330,544 B2
• Filed: 03/14/2013
• Issued: 05/03/2016
• Est. Priority Date: 11/20/2012
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Levesque, Vincent, Cruz-Hernandez, Juan Manuel, Weddle, Amaya, Birnbaum, David M.
• Primary Examiner(s): Mummalaneni, Nalini
• Application Number:
  US13/830,087
• Publication Number:
  US 20140139450A1
• Time in Patent Office: 1,146 Days
• Field of Search: 715/702, 715/863, 715/701, 715/773, 345173-177, 345/156, 345/168, 345/157, 345/169, 345/163, 340/407.1, 340/407.2, 341/27, 455/566
• US Class Current: 1/1
• CPC Class Codes: A63F 13/214 for locating contacts on a surface, e.g. floor mats or touch pads
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: G06F 1/1692 the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H10N 30/20 with electrical input and mechanical output, e.g. functioning as actuators or vibrators

Abstract

A system of the present disclosure may include a sensor configured to detect user interaction with a touch surface and transmit a sensor signal associated with the user interaction; a processor in communication with the sensor, the processor configured to: determine a position of the user interaction based on the sensor signal, determine a feature associated with the position of the user interaction, control a device associated with the feature, modify a display signal based in part on the user interaction, select a haptic effect to generate based at least in part on user interaction and the position, the haptic effect selected to simulate the feature, and transmit a haptic signal to generate the haptic effect, and a haptic output device in communication with the processor and coupled to the touch surface, the haptic output device configured to receive a haptic signal and output a haptic effect.

Claims

1. A system comprising:

a sensor configured to detect a user interaction with a touch surface and transmit a sensor signal associated with the user interaction;

a processor in communication with the sensor, the processor configured to;

determine a type and a position of the user interaction based on the sensor signal,

determine a feature associated with the position of the user interaction,

control one of a plurality of devices based on the user interaction, the controlled device associated with the feature,

modify a display signal based in part on the user interaction,

determine a first haptic effect based at least in part on the type and the position of the user interaction and, the first haptic effect configured to simulate contact with the feature;

transmit a first haptic signal to generate the first haptic effect;

determine a second haptic effect configured to simulate selection of the feature after contact with the feature, the second haptic effect configured to distinguish the controlled device from the other of the plurality of devices, the second haptic effect different from the first haptic effect; and

transmit a second haptic signal to generate the second haptic effect, and

a haptic output device in communication with the processor and coupled to the touch surface, the haptic output device configured to receive the first haptic signal and output the first haptic effect, and receive the second haptic signal and output the second haptic effect.

2. The system of claim 1, wherein at least one of the first or second haptic effects comprises a simulated texture or an effect configured to vary a coefficient of friction on the touch surface.

3. The system of claim 1, wherein the haptic output device comprises a device configured to generate an electrostatic field.

4. The system of claim 1, wherein the sensor comprises a touchscreen display.

5. The system of claim 1, wherein the feature is associated with a file in a virtual desktop.

6. The system of claim 5, wherein the haptic effect is associated with moving the file.

7. The system of claim 1, wherein the feature is associated with an object in a game.

8. The system of claim 7, wherein the haptic effect is associated with movement of the object.

9. The system of claim 1, wherein the feature is associated with a simulated input device.

10. The system of claim 9, wherein the simulated input device comprises one or more of:

a virtual switch, a virtual slider, a virtual button, a virtual joystick, a virtual mouse, or a virtual dial.

11. The system of claim 9, wherein the simulated input device is configured to control a function of the system.

12. A method comprising:

detecting a user interaction with a touch surface;

transmitting a sensor signal associated with the user interaction;

determining a type and a position of the user interaction based on the sensor signal;

determining a feature associated with the position of the user interaction;

controlling one of a plurality of devices based on the user interaction, the controlled device associated with the feature;

modifying a display signal based in part on the user interaction;

determining a first haptic effect based at least in part on the type and the position of the user interaction, the first haptic effect configured to simulate the feature;

determining a second haptic effect configured to simulate selection of the feature after contact with the feature, the second haptic effect configured to distinguish the controlled device from the other of the plurality of devices, the second haptic effect different from the first haptic effect;

transmitting a first haptic signal associated with the haptic effect to a haptic output device; and

transmitting a second haptic signal associated with the haptic effect to the haptic output device.

13. The method of claim 12, wherein at least one of the first or second haptic effects comprises one of a simulated texture or an effect configured to vary a coefficient of friction on the touch surface.

14. The method of claim 13, wherein the haptic effect is associated with moving a file.

15. The method of claim 12, wherein the feature is associated with a file in a virtual desktop.

16. The method of claim 12, wherein the feature is associated with a character in a game.

17. The method of claim 16, wherein the haptic effect is associated with a movement of the character.

18. The method of claim 12, wherein the feature is associated with a simulated input device.

19. The method of claim 18, wherein the simulated input device comprises:

a virtual switch, a virtual slider, a virtual button, a virtual joystick, a virtual mouse, or a virtual dial.

20. The method of claim 18, wherein the simulated input device is configured to control a function of a system.

21. A non-transient computer readable medium comprising program code, which when executed by a processor is configured to cause the processor to:

detect a user interaction with a touch surface;

transmit a sensor signal associated with the user interaction;

determine a type and a position of the user interaction based on the sensor signal;

determine a feature associated with the position of the user interaction;

control one of a plurality of devices based on the user interaction, the controlled device associated with the feature;

modify a display signal based in part on the user interaction;

determine a first haptic effect based at least in part on the type and the position of the user interaction, the first haptic effect configured to simulate the feature;

transmit a first haptic signal associated with the haptic effect to a haptic output device;

determine a second haptic effect configured to simulate selection of the feature after contact with the feature, the second haptic effect configured to distinguish the controlled device from the other of the plurality of devices, the second haptic effect different from the first haptic effect, and wherein at least one of the first or second haptic effects comprises a simulated texture or an effect configured to vary a coefficient of friction on the touch surface; and

transmit a second haptic signal associated with the haptic effect to the haptic output device.