Systems and methods for shape input and output for a haptically-enabled deformable surface

• US 10,203,757 B2
• Filed: 04/25/2017
• Issued: 02/12/2019
• Est. Priority Date: 08/21/2014
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Levesque, Vincent, Grant, Danny, Saboune, Jamal, Hamam, Abdelwahab, Rihn, William
• Primary Examiner(s): Khan, Ibrahim A
• Application Number:
  US15/496,678
• Publication Number:
  US 20170228122A1
• Time in Patent Office: 658 Days
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 2203/04102 Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0443 using a single layer of sensing electrodes
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: H04M 1/0268 including a flexible display panel
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

One illustrative computing device disclosed herein includes a first sensor configured to detect a position associated with a deformable surface and transmit a sensor signal associated with the position; and a processor in communication with the sensor, the processor configured to: receive the sensor signal; determine a haptic effect based at least in part on the sensor signal; and transmit a haptic signal associated with the haptic effect. The illustrative computing device also includes a haptic output device in communication with the processor, the haptic output device configured to receive the haptic signal and output the haptic effect.

Claims

1. A computing device comprising:

a deformable housing;

one or more sensors configured to detect a deformation in the deformable housing and a position of the computing device and transmit one or more sensor signals associated with the deformation and the position;

a processor in communication with the one or more sensors; and

a memory comprising program code that is executable by the processor to cause the processor to;

receive the one or more sensor signals from the one or more sensors;

determine an interaction with a virtual object in a virtual environment using the deformation in the deformable housing and the position of the computing device;

determine that a function of a particular type is to be performed based at least in part on the interaction, wherein the particular type of the function is determined based on the deformation in the deformable housing;

determine a parameter for the function based on the position of the computing device;

cause the function to be executed in accordance with the parameter;

determine a haptic effect based at least in part on the interaction; and

transmit a haptic signal associated with the haptic effect to a haptic output device, the haptic output device being configured to receive the haptic signal and output the haptic effect.

2. The computing device of claim 1, wherein the virtual environment comprises an augmented reality environment.

3. The computing device of claim 1, wherein the function comprises manipulating the virtual object.

4. The computing device of claim 3, wherein manipulating the virtual object comprises moving the virtual object or virtually grabbing hold of the virtual object.

5. The computing device of claim 1, wherein the interaction comprises at least partially enclosing the virtual object with the deformable housing.

6. The computing device of claim 1, wherein the interaction comprises the computing device being oriented toward the virtual object, and wherein the memory further comprises program code that is executable by the processor to cause the processor to:

determine that the computing device is oriented toward the virtual object based on the position of the computing device relative to the virtual object in the virtual environment.

7. The computing device of claim 1, wherein the interaction comprises the computing device being within a predetermined distance of the virtual object, and wherein the memory further comprises program code that is executable by the processor to cause the processor to:

determine that the computing device is within the predetermined distance of the virtual object based on the position of the computing device relative to the virtual object in the virtual environment.

8. A method comprising:

receiving, by a processor of a computing device, one or more sensor signals from one or more sensors, the one or more sensors being configured to detect a deformation in a deformable housing of the computing device and a position of the computing device;

determining, by the processor, an interaction with a virtual object in a virtual environment using the deformation in the deformable housing and the position of the computing device;

determining, by the processor, that a function of a particular type is to be performed based at least in part on the interaction, wherein the particular type of the function is determined based on the deformation in the deformable housing;

determining, by the processor, a parameter for the function based on the position of the computing device;

causing, by the processor, the function to be executed in accordance with the parameter;

determining, by the processor, a haptic effect based at least in part on the interaction; and

transmitting, by the processor, a haptic signal associated with the haptic effect to a haptic output device, the haptic output device being configured to receive the haptic signal and output the haptic effect.

9. The method of claim 8, wherein the virtual environment comprises an augmented reality environment.

10. The method of claim 8, wherein the function comprises moving the virtual object or virtually grabbing hold of the virtual object.

11. The method of claim 8, wherein the interaction comprises at least partially enclosing the virtual object with the deformable housing.

12. The method of claim 8, wherein the interaction comprises the computing device being oriented toward the virtual object, and further comprising:

determining that the computing device is oriented toward the virtual object based on the position of the computing device relative to the virtual object in the virtual environment.

13. The method of claim 8, wherein the interaction comprises the computing device being within a predetermined distance of the virtual object, and further comprising:

determining that the computing device is within the predetermined distance of the virtual object based on the position of the computing device relative to the virtual object in the virtual environment.

14. A non-transitory computer readable medium comprising program code that is executable by a processor of a computing device to cause the processor to:

receive one or more sensor signals from one or more sensors, the one or more sensors being configured to detect a deformation in a deformable housing of the computing device and a position of the computing device;

determine an interaction with a virtual object in a virtual environment using the deformation in the deformable housing and the position of the computing device;

determine that that a function of a particular type is to be performed based at least in part on the interaction, wherein the particular type of the function is determined based on the deformation in the deformable housing;

determine a parameter for the function based on the position of the computing device;

cause the function to be executed in accordance with the parameter;

determine a haptic effect based at least in part on the interaction; and

transmit a haptic signal associated with the haptic effect to a haptic output device, the haptic output device being configured to receive the haptic signal and output the haptic effect.

15. The non-transitory computer readable medium of claim 14, wherein the function comprises moving the virtual object or virtually grabbing hold of the virtual object.

16. The non-transitory computer readable medium of claim 14, wherein the interaction comprises the computing device being oriented toward the virtual object, and further comprising program code that is executable by the processor to cause the processor to:

determine that the computing device is oriented toward the virtual object based on the position of the computing device relative to the virtual object in the virtual environment.

17. The non-transitory computer readable medium of claim 14, wherein the interaction comprises the computing device being within a predetermined distance of the virtual object, and further comprising program code that is executable by the processor to cause the processor to:

determine that the computing device is within the predetermined distance of the virtual object based on the position of the computing device relative to the virtual object in the virtual environment.