Systems and methods for deformation-based haptic effects

• US 10,080,957 B2
• Filed: 11/18/2016
• Issued: 09/25/2018
• Est. Priority Date: 11/25/2014
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Levesque, Vincent, Grant, Danny, Cruz-Hernandez, Juan Manuel, Modarres, Ali, Rihn, William
• Primary Examiner(s): Lee, Larry
• Application Number:
  US15/355,817
• Publication Number:
  US 20170136350A1
• Time in Patent Office: 676 Days
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: G06F 1/1652 the display being flexible, e.g. mimicking a sheet of paper, or rollable
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04102 Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
• CPC Class Codes: G06F 2203/04809 Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0338 with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0447 Position sensing using the local deformation of sensor cells
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04M 1/0268 including a flexible display panel
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces

Abstract

One illustrative system disclosed herein includes a deformation sensor configured to detect a deformation of a deformable surface and transmit a first sensor signal associated with the deformation. The system also includes a sensor configured to detect a user interaction with a user input device and transmit a second sensor signal associated with the user interaction. The system further includes a processor configured to: receive the first sensor signal; receive the second sensor signal; execute a function based at least in part on the first sensor signal and the second sensor signal. The processor is also configured to: determine a haptic effect based at least in part on the first sensor signal or the second sensor signal; and transmit a haptic signal associated with the haptic effect to a haptic output device configured to receive the haptic signal and output the haptic effect.

Claims

1. A device comprising:

a deformable housing;

a deformation sensor coupled to the deformable housing, the deformation sensor being configured to detect a deformation of the deformable housing and transmit a sensor signal associated with the deformation;

a processor in communication with the deformation sensor; and

a memory on which instructions executable by the processor are stored to cause the processor to;

receive the sensor signal;

determine the deformation of the deformable housing based on the sensor signal;

generate an electronic communication based on the deformation of the deformable housing;

transmit the electronic communication to a remote electronic device, the electronic communication being configured to cause a function associated with the deformation to be executed by the remote electronic device;

determine a haptic effect configured to confirm that the function was executed by the remote electronic device; and

transmit a haptic signal associated with the haptic effect to a haptic output device, the haptic signal configured to cause the haptic output device to output the haptic effect.

2. The device of claim 1, wherein the deformation comprises rolling, bending, folding, stretching, twisting, or squeezing the deformable housing.

3. The device of claim 2, wherein the device is a game controller configured to control the remote electronic device.

4. The device of claim 3, wherein the game controller lacks a display.

5. The device of claim 1, further comprising a user input device that comprises a mechanical button, a mechanical switch, a trigger, a wheel, a directional pad, or a joystick.

6. The device of claim 1, wherein the haptic output device is coupled to a remote object.

7. The device of claim 1, wherein the device is a wearable device, and wherein the wearable device comprises a shoe, an armband, a sleeve, a jacket, glasses, a glove, a ring, a watch, a wristband, an article of clothing, a hat, a headband, or jewelry.

8. The device of claim 1, wherein the haptic effect is a first haptic effect, wherein the device further comprises a touch-sensitive surface in communication with the processor, and wherein the memory further comprises instructions executable by the processor to cause the processor to:

cause a second haptic effect to be output by the haptic output device in response to an interaction with the touch-sensitive surface, the second haptic effect having a magnitude;

detect a reduction in an amount of pressure being applied to the touch-sensitive surface during a time period in which the second haptic effect is being output by the haptic output device; and

in response to detecting the reduction in the amount of pressure during the time period, cause the magnitude of the second haptic effect to increase.

9. The device of claim 1, wherein the haptic effect is a first haptic effect, and wherein the memory further comprises instructions executable by the processor to cause the processor to:

determine a second haptic effect associated with the deformation of the deformable housing, the second haptic effect being configured to cause the deformable housing to change in shape; and

cause the haptic output device to output the second haptic effect.

10. A method comprising:

receiving, by a device having a deformable housing, a sensor signal indicating a deformation of the deformable housing;

determining, by the device, the deformation of the deformable housing based on the sensor signal;

generating, by the device, an electronic communication based on the deformation of the deformable housing;

transmitting, by the device, the electronic communication to a remote electronic device, the electronic communication being configured to cause a function associated with the deformation to be executed by the remote electronic device;

determining, by the device, a haptic effect configured to confirm that the function was executed by the remote electronic device; and

transmitting, by the device, a haptic signal associated with the haptic effect to a haptic output device, the haptic signal configured to cause the haptic output device to output the haptic effect.

11. The method of claim 10, wherein the deformation comprises rolling, bending, folding, stretching, twisting, or squeezing the deformable housing.

12. The method of claim 11, wherein the device is a game controller configured to control the remote electronic device.

13. The method of claim 10, wherein the haptic output device is coupled to a remote device.

14. The method of claim 10, wherein the device lacks a touch-sensitive surface and comprises a mechanical button, a mechanical switch, a trigger, a wheel, a directional pad, or a joystick.

15. The method of claim 10, wherein the haptic effect is a first haptic effect, and further comprising:

causing a second haptic effect to be output by the haptic output device in response to an interaction with a touch-sensitive surface, the second haptic effect having a magnitude;

detecting a reduction in an amount of pressure being applied to the touch-sensitive surface during a time period in which the second haptic effect is being output by the haptic output device; and

in response to detecting the reduction in the amount of pressure during the time period, increasing the magnitude of the second haptic effect.

16. A non-transitory computer readable medium comprising program code, which when executed by a processor of a device is configured to cause the device to:

receive a sensor signal from a deformation sensor coupled to a deformable housing of the device, the sensor signal indicating a deformation of the deformable housing;

determine the deformation of the deformable housing based on the sensor signal;

generate an electronic communication based on the deformation of the deformable housing;

transmit the electronic communication to a remote electronic device, the electronic communication being configured to cause a function associated with the deformation to be executed by the remote electronic device;

determine a haptic effect configured to confirm that the function was executed by the remote electronic device; and

transmit a haptic signal associated with the haptic effect to a haptic output device, the haptic signal configured to cause the haptic output device to output the haptic effect.

17. The non-transitory computer readable medium of claim 16, wherein the deformation comprises rolling, bending, folding, stretching, twisting, or squeezing the deformable housing.

18. The non-transitory computer readable medium of claim 16, wherein the device is a game controller configured to control the remote electronic device.

19. The non-transitory computer readable medium of claim 16, wherein the haptic effect is a first haptic effect, and further comprising program code which when executed by the processor is configured to cause the device to:

cause a second haptic effect to be output by the haptic output device in response to an interaction with a touch-sensitive surface, the second haptic effect having a magnitude;

detect a reduction in an amount of pressure being applied to the touch-sensitive surface during a time period in which the second haptic effect is being output by the haptic output device; and

in response to detecting the reduction in the amount of pressure during the time period, cause the magnitude of the second haptic effect to increase.