Interactivity model for shared feedback on mobile devices

• US 9,619,033 B2
• Filed: 02/18/2016
• Issued: 04/11/2017
• Est. Priority Date: 02/15/2012
• Status: Expired due to Fees

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Birnbaum, David, Ullrich, Chris, Short, Jason, Devenish, Ryan
• Primary Examiner(s): SHERMAN, STEPHEN G
• Application Number:
  US15/046,701
• Publication Number:
  US 20160162032A1
• Time in Patent Office: 418 Days
• Field of Search: 345156-184, 340 412, 3404071, 3404072, 463 30, 178 1801- 1809, 178 1811
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04102 Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A system that produces a dynamic haptic effect and generates a drive signal that includes a gesture signal and a real or virtual device sensor signal. The haptic effect is modified dynamically based on both the gesture signal and the real or virtual device sensor signal such as from an accelerometer or gyroscope, or by a signal created from processing data such as still images, video or sound. The haptic effect may optionally be modified dynamically by using the gesture signal and the real or virtual device sensor signal and a physical model, or may optionally be applied concurrently to multiple devices which are connected via a communication link. The haptic effect may optionally be encoded into a data file on a first device. The data file is then communicated to a second device and the haptic effect is read from the data file and applied to the second device.

Claims

1. A method of producing a haptic effect on a mobile device comprising:

receiving first data from a first pressure input on a touch surface;

receiving second data from a second pressure input on a touch surface, the second pressure input being different from the first pressure input;

generating a dynamic interaction parameter in response to the first data and the second data; and

applying a drive signal to a haptic output device based on the dynamic interaction parameter.

2. The method of claim 1, wherein the touch surface comprises a touchscreen or touchpad.

3. The method of claim 1, wherein the first or second pressure input comprises at least a force, pressure, strain or bend.

4. The method of claim 1, wherein the first or second pressure input comprises a pressure sensor input selected from the group consisting of Air Pressure, Fibre Optic Sensors, Flexion, Force-sensitive Resistor (FSR), Load Cell, LuSense CPS² 155, Miniature Pressure Transducer, Piezoelectric Ceramic &

Film, or Strain Gage.

5. The method of claim 1, wherein generating a dynamic interaction parameter comprises generating a dynamic interaction parameter from a difference between the first pressure input and the second pressure input.

6. The method of claim 1, wherein the first or second pressure input comprises a device sensor input.

7. The method of claim 6, wherein the device sensor input comprises an input received from a remotely coupled device.

8. The method of claim 6, wherein the device sensor input comprises a virtual sensor input.

9. The method of claim 6, wherein the device sensor input comprises an ambient input selected from the group consisting of accelerometer, gyroscope, microphone, photometer, thermometer or altimeter.

10. The method of claim 6, wherein the device sensor input comprises a bio monitor input selected from the group consisting of skin or body temperature, blood pressure (BP), heart rate monitor (HRM), Electrocardiogram (ECG), Electroencephalogram (EEG), Electromyography (EMG), Electrooculography (EOG), Electropalatography (EPG) or Galvanic Skin Response (GSR).

11. A haptic effect enabled system comprising:

a haptic output device;

a drive module electronically coupled to the haptic output device for receiving first data from a first pressure input on a touch surface, receiving second data from a second pressure input on a touch surface, the second pressure input being different from the first pressure input, and generating a dynamic interaction parameter in response to the first data and the second data; and

a drive circuit electronically coupled to the drive module and the haptic output device for applying a drive signal to the haptic output device based on the dynamic interaction parameter.

12. The system of claim 11, wherein the touch surface comprises a touchscreen or touchpad.

13. The system of claim 11, wherein the first or second pressure input comprises at least a force, pressure, strain or bend.

14. The system of claim 11, wherein the first or second pressure input comprises a pressure sensor input selected from the group consisting of Air Pressure, Fibre Optic Sensors, Flexion, Force-sensitive Resistor (FSR), Load Cell, LuSense CPS² 155, Miniature Pressure Transducer, Piezoelectric Ceramic &

Film, or Strain Gage.

15. The system of claim 11, wherein generating a dynamic interaction parameter comprises generating a dynamic interaction parameter from a difference between the first pressure input and the second pressure input.

16. The system of claim 11, wherein the first or second pressure input comprises a device sensor input.

17. The system of claim 16, wherein the device sensor input comprises an input received from a remotely coupled device.

18. The system of claim 16, wherein the device sensor input comprises a virtual sensor input.

19. The system of claim 16, wherein the device sensor input comprises an ambient input selected from the group consisting of accelerometer, gyroscope, microphone, photometer, thermometer or altimeter.

20. The system of claim 16, wherein the device sensor input comprises a bio monitor input selected from the group consisting of skin or body temperature, blood pressure (BP), heart rate monitor (HRM), Electrocardiogram (ECG), Electroencephalogram (EEG), Electromyography (EMG), Electrooculography (EOG), Electropalatography (EPG) or Galvanic Skin Response (GSR).

21. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, causes the processor to produce a haptic effect, the instructions comprising:

receiving first data from a first pressure input on a touch surface;

receiving second data from a second pressure input on a touch surface, the second pressure input being different from the first pressure input;

generating a dynamic interaction parameter in response to the first data and the second data; and

applying a drive signal to a haptic output device based on the dynamic interaction parameter.

22. The non-transitory computer readable medium of claim 21, wherein the touch surface comprises a touchscreen or touchpad.

23. The non-transitory computer readable medium of claim 21, wherein the first or second pressure input comprises at least a force, pressure, strain or bend.

24. The non-transitory computer readable medium of claim 21, wherein the first or second pressure input comprises a pressure sensor input selected from the group consisting of Air Pressure, Fibre Optic Sensors, Flexion, Force-sensitive Resistor (FSR), Load Cell, LuSense CPS² 155, Miniature Pressure Transducer, Piezoelectric Ceramic &

Film, or Strain Gage.

25. The non-transitory computer readable medium of claim 21, wherein generating a dynamic interaction parameter comprises generating a dynamic interaction parameter from a difference between the first pressure input and the second pressure input.

26. The non-transitory computer readable medium of claim 21, wherein the first or second pressure input comprises a device sensor input.

27. The non-transitory computer readable medium of claim 26, wherein the device sensor input comprises an input received from a remotely coupled device.

28. The non-transitory computer readable medium of claim 26, wherein the device sensor comprises a virtual sensor input.

29. The non-transitory computer readable medium of claim 26, wherein the device sensor input comprises an ambient input selected from the group consisting of accelerometer, gyroscope, microphone, photometer, thermometer or altimeter.

30. The non-transitory computer readable medium of claim 26, wherein the device sensor input comprises a bio monitor input selected from the group consisting of skin or body temperature, blood pressure (BP), heart rate monitor (HRM), Electrocardiogram (ECG), Electroencephalogram (EEG), Electromyography (EMG), Electrooculography (EOG), Electropalatography (EPG) or Galvanic Skin Response (GSR).