SYSTEMS AND METHODS FOR PROVIDING HAPTIC FEEDBACK FOR REMOTE INTERACTIONS

• US 20150323993A1
• Filed: 05/12/2014
• Published: 11/12/2015
• Est. Priority Date: 05/12/2014
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: LEVESQUE, Vincent, MODARRES, Ali, GRANT, Danny A., DIONNE, Jean Francois, BIRNBAUM, David M.
• Granted Patent: US 10,613,627 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A system includes a first electronic device and a second electronic device. The first electronic device includes a sensor configured to sense or property experienced by the first electronic device, and a transmitter configured to transmit a signal based on output from the sensor. The second electronic device is in signal communication with the first electronic device. The second electronic device includes a receiver configured to receive the transmitted signal, a detector configured to determine an object that a user of the second device is focusing on, a processor configured to generate a haptic signal representative of the transmitted signal if it is determined that the object the user is focusing on corresponds with a location of the first electronic device, and a haptic output device configured to receive the haptic signal and generate a haptic effect to the user.

Claims

1. A system comprising:

a first electronic device comprising

a sensor configured to sense a condition or property experienced by the first electronic device, and

a transmitter configured to transmit a signal based on output from the sensor; and

a second electronic device in signal communication with the first electronic device, the second electronic device comprising

a receiver configured to receive the transmitted signal,

a detector configured to determine an object that a user of the second device is focusing on,

a processor configured to generate a haptic signal representative of the transmitted signal if it is determined that the object the user is focusing on corresponds with a location of the first electronic device, and

a haptic output device configured to receive the haptic signal and generate a haptic effect to the user.

2. The system according to claim 1, wherein the detector comprises a camera configured to capture an image of an eye of the user, and an image processor configured to determine a direction of an eye gaze of the user based on the image.

3. The system according to claim 1, wherein the sensor is configured to sense vibrations or deformations.

4. The system according to claim 3, wherein the haptic effect simulates the sensed vibrations or deformations.

5. The system according to claim 1, wherein the first electronic device further comprises a camera configured to output a video stream, the video steam being part of the transmitted signal, and wherein the second electronic device further comprises a display configured to display the video stream.

6. The system according to claim 1, wherein the second electronic device is a head-mounted display.

7. The system according to claim 6, wherein the detector comprises a camera mounted on the head-mounted display, the camera having a field of view aligned with a direction the head-mounted display is pointing.

8. A method comprising:

selecting a distant object;

detecting a signal transmitted by the object, the signal comprising a driving signal for a haptic output device; and

generating a haptic effect to a user with the haptic output device based on the driving signal.

9. The method according to claim 8, wherein selecting a distant object comprises detecting that the user is within a predefined proximity range of the distant object.

10. The method according to claim 8, wherein selecting a distant object comprises detecting an eye gaze of the user looking at the distant object.

11. The method according to claim 8, further comprising sensing vibrations, wherein the signal emitted from the object is based on the sensed vibrations.

12. The method according to claim 8, wherein the signal transmitted by the object includes a video stream, and wherein the method further comprises displaying the video stream to the user.

13. A system comprising:

a first electronic device comprising

an adjuster configured to adjust a control of the first electronic device, and

a transmitter configured to transmit a signal associated with an adjustment of the control;

a second electronic device in signal communication with the first electronic device, the second electronic device comprising

a receiver configured to receive the transmitted signal,

a detector configured to detect a user input for adjusting the control,

a processor configured to generate a haptic signal representative of the transmitted signal if the detector detects the user input for adjusting the control, and

a haptic output device configured to receive the haptic signal and generate a haptic effect to the user, the haptic effect representative of the adjustment of the control.

14. The system according to claim 13, wherein the detector is configured to detect a gesture by the user representative of movement of the adjuster.

15. The system according to claim 14, wherein the second electronic device further comprises a display configured to display a virtual image of the first electronic device, and wherein the gesture by the user is made relative to the virtual image.

16. The system according to claim 15, wherein the second electronic device is a head-mounted display.

17. A method comprising:

selecting a distant object comprising an adjuster for adjusting a control of the distant object;

detecting a gesture made by the user to adjust the control of the distant object;

adjusting the control of the distant object; and

generating a haptic effect representative of the adjustment to the user.

18. The method according to claim 17, further comprising displaying a virtual image of the selected distant object to the user, wherein the gesture made by the user is made relative to the virtual image of the selected object.