Systems and methods for shape input and output for a haptically-enabled deformable surface

• US 9,690,381 B2
• Filed: 08/21/2014
• Issued: 06/27/2017
• Est. Priority Date: 08/21/2014
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Levesque, Vincent, Grant, Danny, Hamam, Abdelwahab, Saboune, Jamal, Rihn, William
• Primary Examiner(s): KHAN, IBRAHIM A
• Application Number:
  US14/465,005
• Publication Number:
  US 20160054799A1
• Time in Patent Office: 1,041 Days
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 2203/04102 Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0443 using a single layer of sensing electrodes
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: H04M 1/0268 including a flexible display panel
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

One illustrative computing device disclosed herein includes a first sensor configured to detect a position associated with a deformable surface and transmit a sensor signal associated with the position; and a processor in communication with the sensor, the processor configured to: receive the sensor signal; determine a haptic effect based at least in part on the sensor signal; and transmit a haptic signal associated with the haptic effect. The illustrative computing device also includes a haptic output device in communication with the processor, the haptic output device configured to receive the haptic signal and output the haptic effect.

Claims

1. A computing device comprising:

a deformable housing;

one or more sensors coupled to the deformable housing and configured to detect a deformation in the deformable housing and a position of the computing device in real space or relative to a remote object and transmit one or more sensor signals associated with the deformation and the position;

a processor in communication with the one or more sensors, the processor configured to;

receive the one or more sensor signals from the one or more sensors;

determine that the computing device is at least partially enclosing the remote object based at least in part on a first input comprising the deformation in the deformable housing and a second input comprising the position of the computing device;

determine a function to perform based at least in part on the computing device at least partially enclosing the remote object;

cause the function to be executed;

determine a haptic effect based at least in part on the one or more sensor signals; and

transmit a haptic signal associated with the haptic effect; and

a haptic output device coupled to the deformable housing and in communication with the processor, the haptic output device configured to receive the haptic signal and output the haptic effect.

2. The computing device of claim 1, wherein the function comprises manipulating a virtual object or communicating with the remote object.

3. The computing device of claim 1, wherein the deformation in the deformable housing is associated with a user interaction with the deformable housing, the user interaction comprising bending, folding, flexing, twisting, squeezing, or stretching the deformable housing.

4. The computing device of claim 1, wherein the haptic effect comprises a vibration, a perceptible change in a coefficient of friction on surface of the computing device, a simulated texture, or a stroking sensation.

5. The computing device of claim 1, wherein the processor is further configured to:

determine a system mode of the computing device, wherein the system mode comprises an operational state of the computing device; and

determine the function based at least in part on the system mode.

6. The computing device of claim 5, wherein the haptic effect comprises bending, folding, flexing, twisting, squeezing, or stretching the deformable housing.

7. The computing device of claim 1, wherein the computing device is associated with a wearable device comprising a shoe, an armband, a sleeve, a jacket, glasses, a glove, a ring, a watch, a wristband, a bracelet, an article of clothing, a hat, a headband, and/or jewelry.

8. The computing device of claim 1, wherein the processor is further configured to:

determine an amount of the deformation based on the one or more sensor signals;

determine the position of the computing device in at least two degrees of freedom based on the one or more sensor signals; and

determine that the computing device is at least partially enclosing the remote object using the amount of the deformation as the first input and the position of the computing device in the at least two degrees of freedom as the second input.

9. The computing device of claim 1, wherein the processor is further configured to:

determine the function based on an amount of the deformation in the deformable housing and the position of the computing device relative to the remote object.

10. The computing device of claim 1, wherein the processor is further configured to:

determine that the computing device is oriented toward the remote object based on the one or more sensor signals; and

determine the function based at least in part on the computing device being oriented toward the remote object.

11. The computing device of claim 1 wherein the processor is further configured to:

determine that the computing device is within a predetermined distance from the remote object based on the one or more sensor signals; and

determine the function based at least in part on the computing device being within the predetermined distance from the remote object.

12. The computing device of claim 11, wherein the processor is further configured to:

determine the haptic effect based at least in part on the computing device being within the predetermined distance of the remote object.

13. The computing device of claim 1, wherein the processor is configured to:

determine the function to perform based on the deformation in the deformable housing;

associate the remote object with the function based on the position of the computing device; and

cause the function to be executed based on the remote object being associated with the function.

14. A method comprising:

receiving, from one or more sensors coupled to a deformable housing of a computing device, one or more sensor signals associated with a deformation in the deformable housing and a position of the computing device in real space or relative to a remote object;

determining that the computing device is at least partially enclosing the remote object based at least in part on a first input comprising the deformation in the deformable housing and a second input comprising the position of the computing device;

determining a function to perform based at least in part on the computing device at least partially enclosing the remote object;

causing the function to be executed;

determining a haptic effect based at least in part on the one or more sensor signals; and

causing a haptic output device coupled to the deformable housing to output the haptic effect.

15. The method of claim 14, wherein the deformation in the deformable housing is associated with a user interaction with the deformable housing, and wherein the user interaction comprises bending, folding, flexing, twisting, squeezing, or stretching the deformable housing.

16. The method of claim 14, further comprising:

determining a system mode of the computing device, wherein the system mode comprises an operational state of the computing device; and

determining the function based at least in part on the system mode.

17. A non-transient computer readable medium comprising program code, which when executed by a processor is configured to cause the processor to:

receive, from one or more sensors coupled to a deformable housing of a computing device, one or more sensor signals associated with a deformation in the deformable housing and a position of the computing device in real space or relative to a remote object;

determine that the computing device is at least partially enclosing the remote object based at least in part on a first input comprising the deformation in the deformable housing and a second input comprising the position of the computing device;

determine a function to perform based at least in part on the computing device at least partially enclosing the remote object;

cause the function to be executed;

determine a haptic effect based at least in part on the one or more sensor signals; and

cause a haptic output device coupled to the deformable housing to output the haptic effect.

18. The non-transient computer readable medium of claim 17, further comprising program code which when executed by the processor is configured to cause the processor to:

determine a system mode of the computing device, wherein the system mode comprises an operational state of the computing device; and

determine the function based at least in part on the system mode.