Simulation of tangible user interface interactions and gestures using array of haptic cells

• US 9,405,369 B2
• Filed: 04/25/2014
• Issued: 08/02/2016
• Est. Priority Date: 04/26/2013
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Modarres, Ali, Cruz-Hernandez, Juan Manuel, Grant, Danny A., Levesque, Vincent
• Primary Examiner(s): Chang, Kent
• Assistant Examiner(s): Brittingham, Nathan
• Application Number:
  US14/262,482
• Publication Number:
  US 20140320436A1
• Time in Patent Office: 830 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1641 the display being formed by a plurality of foldable display components G06F1/1647 takes precedence
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1652 the display being flexible, e.g. mimicking a sheet of paper, or rollable
• CPC Class Codes: G06F 2203/04102 Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A user interface device includes a flexible layer comprising a touch surface configured to receive a touch by a user, a plurality of haptic cells covered by the flexible layer, each haptic cell comprising a haptic output device, a sensor configured to sense an amount and/or rate of deformation of the flexible layer when a user touches the touch surface, and a processor configured to receive an output signal from the sensor, generate a haptic control signal based on the output signal from the sensor, and output the haptic control signal to at least one haptic output device of the plurality of haptic cells to cause the haptic output device to deform an associated haptic cell in response to the sensed deformation of the flexible layer.

Claims

1. A user interface device comprising:

a flexible layer comprising a touch surface configured to receive a touch by a user;

a plurality of haptic cells covered by the flexible layer, each haptic cell comprising a haptic output device;

a sensor configured to sense an amount and/or rate of deformation of the flexible layer when a user touches the touch surface;

a pressure sensor configured to sense a resistance displayed by the haptic cell to the user at the touch surface; and

a processor configured to receive output signals from the sensor and the pressure sensor, generate a haptic control signal based on the output signals from the sensors, the haptic control signal having electrical characteristics, output the haptic control signal to at least one haptic output device of the plurality of haptic cells to cause the haptic output device to deform an associated haptic cell in response to the sensed deformation of the flexible layer and change at least one electrical characteristic of the haptic control signal based on the sensed resistance displayed by the haptic cell, the at least one electrical characteristic being selected from the group comprising magnitude, frequency, or duration, the changed haptic control signal controls the haptic output device to modify the resistance of the flexible layer to a desired resistance.

2. The user interface device according to claim 1, wherein the processor is configured to output a plurality of haptic control signals to a plurality of haptic output devices located in proximity to one another to collectively create a haptic effect.

3. The user interface device according to claim 2, wherein the haptic effect simulates a button or joystick.

4. The user interface device according to claim 2, wherein at least two of the plurality of haptic output devices create different amounts of deformations of their associated haptic cells to create the haptic effect.

5. The user interface device according to claim 1, wherein the processor is configured to generate a plurality of haptic control signals based on the output signal from the sensor and output the haptic control signals to a plurality of haptic output devices sequentially to create a haptic effect.

6. The user interface device according to claim 5, wherein the haptic effect simulates a wave or a ripple.

7. The user interface device according to claim 5, wherein the haptic effect simulates movement of a joystick.

8. The user interface device according to claim 5, wherein the haptic effect simulates movement of a slider.

9. The user interface device according to claim 1, wherein the processor is configured to generate a second haptic control signal different than the haptic control signal and output the second haptic control signal to the haptic output device to cause the haptic output device to output a vibrotactile haptic effect.

10. A method comprising:

sensing an amount and/or rate of displacement of a flexible layer of a user interface device with a sensor;

sensing a resistance displayed by a haptic cell to a user of the user interface device with a pressure sensor;

generating a haptic control signal based on the sensed amount and/or rate of displacement of the flexible layer with a processor, the haptic control signal having electrical characteristics;

deforming the haptic cell with a haptic output device based on the haptic control signal; and

changing at least one electrical characteristic of the haptic control signal based on the sensed resistance displayed by the haptic cell, the at least one electrical characteristic being selected from the group comprising magnitude, frequency, or duration, the changed haptic control signal controls the haptic output device to modify the resistance of the flexible layer to a desired resistance.

11. The method according to claim 10, further comprising generating a plurality of haptic control signals and deforming a plurality of haptic cells located in proximity to each other with a plurality of haptic output devices based on the plurality of haptic control signals to collectively create a haptic effect.

12. The method according to claim 11, wherein the haptic effect simulates a button or joystick.

13. The method according to claim 11, wherein at least two of the haptic cells are deformed by different amounts to create the haptic effect.

14. The method according to claim 10, further comprising generating a plurality of haptic control signals and sequentially deforming a plurality of haptic cells located in proximity to each other with a plurality of haptic output devices based on the plurality of haptic control signals to collectively create a haptic effect.

15. The method according to claim 14, wherein the haptic effect simulates a wave or a ripple.

16. The method according to claim 14, wherein the haptic effect simulates movement of a joystick.

17. The method according to claim 14, wherein the haptic effect simulates movement of a slider.

18. The method according to claim 10, further comprising generating a second haptic control signal different than the haptic control signal and generating a vibrotactile haptic effect with the haptic output device.