Automatic remote sensing and haptic conversion system

• US 9,910,495 B2
• Filed: 08/02/2016
• Issued: 03/06/2018
• Est. Priority Date: 09/06/2013
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Weddle, Amaya Becvar, Grant, Danny
• Primary Examiner(s): Girma, Fekadeselassie
• Application Number:
  US15/226,299
• Publication Number:
  US 20160342212A1
• Time in Patent Office: 581 Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A system is provided that automatically converts an input into one or more haptic effects in near real-time. The system senses the input in near real-time. The system automatically converts the sensed input into one or more haptic signals in near real-time. The system generates the one or more haptic effects based on the one or more haptic signals.

Claims

1. A method of converting a sensed input signal into one or more haptic effects, the method comprising:

receiving the sensed input signal from a sensor;

converting the sensed input signal into one or more haptic signals;

modifying a haptic parameter of the one or more haptic signals to have substantially a same numeric value as a parameter of the sensed input signal, wherein the haptic parameter and the parameter of the sensed input signal are of a same parameter type, wherein the same parameter type comprises at least one of an amplitude, a frequency, a duration, an envelope, a density, a magnitude, a time signature, a frequency signature, a frequency band, or a strength; and

generating the one or more haptic effects based on the haptic parameter and the one or more haptic signals.

2. The method of claim 1, wherein the sensed input signal corresponds to at least one of a force, a pressure, a strain, or a bend.

3. The method of claim 1, wherein the sensor comprises a pressure sensor, wherein the pressure sensor comprises at least one of a fiber optic sensor, a flexion sensor, a bend sensor, a force-sensitive resistor, a load cell, a LuSense CPS² 155, a miniature pressure transducer, a piezo sensor, or a strain gage.

4. The method of claim 1, wherein the sensed input signal corresponds to a pressure input, wherein the sensor comprises a pressure sensor sensing the pressure input on a touch-sensitive input device.

5. The method of claim 4, wherein the touch-sensitive input device comprises a touchscreen.

6. The method of claim 1, wherein the sensed input signal corresponds to an audio signal, wherein the sensor comprises a microphone.

7. The method of claim 1, wherein the sensed input signal corresponds to a video signal, wherein the sensor comprises a camera.

8. The method of claim 1, wherein the sensed input signal corresponds to an acceleration signal, wherein the sensor comprises an accelerometer.

9. The method of claim 1, wherein the sensed input signal corresponds to a movement signal, wherein the sensor comprises a pedometer.

10. The method of claim 1, wherein the sensed input signal corresponds to a temperature signal, wherein the sensor comprises a temperature sensor.

11. The method of claim 1, wherein the sensed input signal corresponds to an ambient input, wherein the sensor comprises at least one of an accelerometer, a gyroscope, a microphone, a photometer, a temperature sensor, or an altimeter.

12. The method of claim 1, wherein the sensed input signal corresponds to a bio monitor input, wherein the sensor comprises at least one of a temperature sensor, a bio monitor, an electrocardiogram, an electroencephalogram, an electromyograph, an electrooculogram, an electropalatograph, or a galvanic skin response sensor.

13. The method of claim 1, wherein the converting further comprises:

wirelessly transmitting the sensed input signal to a controller configured to perform the converting.

14. The method of claim 1, wherein the generating the one or more haptic effects is performed by a wearable haptic device.

15. The method of claim 1, wherein the generating the one or more haptic effects further comprises:

sending the one or more haptic signals to one or more haptic output devices to generate the one or more haptic effects.

16. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to convert a sensed input signal into one or more haptic effects, the converting comprising:

receiving the sensed input signal from a sensor;

converting the sensed input signal into one or more haptic signals;

modifying a haptic parameter of the one or more haptic signals to have substantially a same numeric value as a parameter of the sensed input signal, wherein the haptic parameter and the parameter of the sensed input signal are of a same parameter type, wherein the same parameter type comprises at least one of an amplitude, a frequency, a duration, an envelope, a density, a magnitude, a time signature, a frequency signature, a frequency band, or a strength; and

generating the one or more haptic effects based on the haptic parameter and the one or more haptic signals.

17. The non-transitory computer-readable medium of claim 16, wherein the sensed input signal corresponds to at least one of a force, a pressure, a strain, or a bend.

18. The non-transitory computer-readable medium of claim 16, wherein the sensor comprises a pressure sensor, wherein the pressure sensor comprises at least one of a fiber optic sensor, a flexion sensor, a bend sensor, a force-sensitive resistor, a load cell, a LuSense CPS² 155, a miniature pressure transducer, a piezo sensor, or a strain gage.

19. The non-transitory computer-readable medium of claim 16, wherein the sensed input signal corresponds to a pressure input, wherein the sensor comprises a pressure sensor sensing the pressure input on a touch-sensitive input device.

20. A system for converting a sensed input signal into one or more haptic effects, the system comprising:

a memory configured to store a haptic conversion module; and

a processor configured to execute the haptic conversion module stored on the memory;

wherein the haptic conversion module is configured to receive the sensed input signal from a sensor;

wherein the haptic conversion module is further configured to convert the sensed input signal into one or more haptic signals;

wherein the haptic conversion module is further configured to modify a haptic parameter of the one or more haptic signals to have substantially a same numeric value as a parameter of the sensed input signal, wherein the haptic parameter and the parameter of the sensed input signal are of a same parameter type, wherein the same parameter type comprises at least one of an amplitude, a frequency, a duration, an envelope, a density, a magnitude, a time signature, a frequency signature, a frequency band, or a strength; and

wherein the haptic conversion module is further configured to generate the one or more haptic effects based on the haptic parameter and the one or more haptic signals.