Simulating obstruction in a virtual environment

• US 10,055,022 B2
• Filed: 01/11/2017
• Issued: 08/21/2018
• Est. Priority Date: 01/11/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Appleyard, Thomas D. F., Fahnestock, Gibson, Harwood, Perry A., Wishart, Alexandra E.
• Primary Examiner(s): Xavier, Antonio
• Application Number:
  US15/403,625
• Publication Number:
  US 20180196515A1
• Time in Patent Office: 587 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

A hand-wearable haptic interface device for simulating interaction with a virtual object in a Virtual Reality (VR) or Augmented Reality (AR) environment is provided. The hand-wearable haptic interface device can provide improved simulation of an obstruction caused by a virtual object in a virtual or augmented reality environment. The device comprises a joint-movement restrictor adapted to be positioned adjacent a finger joint when the device is worn on a hand of a user. The movement restrictor is adapted to provide different magnitudes of flexion resistance force for resisting flexion of the finger joint based on a flexion resistance control signal.

Claims

1. A hand-wearable haptic interface device comprising:

a joint-movement restrictor adapted to be positioned adjacent a finger joint when the device is worn on a hand of a user,

wherein the movement restrictor is adapted to provide different magnitudes of flexion resistance force for resisting flexion of the finger joint based on a flexion resistance control signal, and

wherein the joint-movement restrictor comprises a meta-material having a malleability which is adapted to vary based on an electric signal supplied to the meta-material, the supplied electric signal being based on the flexion resistance control signal;

a processing unit adapted to receive a flexion control signal from a control system and to generate the flexion resistance control signal based on the received control signal; and

a joint flexion sensor adapted to determine an angle of flexion of the finger joint and to generate a flexion feedback signal based on the determined angle of flexion of the finger joint, wherein the processing unit is adapted to generate the flexion resistance control signal further based on the flexion feedback signal,

wherein the flexion resistance control signal simulates an object'"'"'s resistance or obstruction to movement or manipulation.

2. The device of claim 1, wherein the joint-movement restrictor comprises a tubular sleeve formed from the meta-material and is adapted to receive the finger-joint therein when the device is worn on the hand of the user.

3. The device of claim 1, wherein the joint-movement restrictor comprises one or more rods of meta-material adapted to span across the finger joint when the device is worn on the hand of the user.

4. The device of claim 1, wherein the processing unit is adapted to communicate the flexion feedback control signal to the control system.

5. The device of claim 1, further comprising a haptic feedback unit adapted to be positioned adjacent a finger pad or palm when the device is worn on the hand of the user, wherein the haptic feedback unit is adapted to apply different magnitudes of tactile force to the finger pad or palm based on a tactile feedback control signal.

6. The device of claim 5, further comprising a processing unit adapted to receive a haptic feedback control signal from a control system and to generate the tactile feedback control signal based on the received haptic feedback control signal.

7. The device of claim 1, wherein the device comprises a glove.

8. A system for simulating interaction with a virtual object in a virtual or augmented reality environment, the system comprising:

the hand-wearable haptic interface device of claim 1; and

a control system configured to generate the flexion resistance control signal and to communicate the flexion resistance control signal to the hand-wearable haptic interface device.

9. A hand-wearable haptic interface device comprising:

a joint-movement restrictor adapted to be positioned adjacent a finger joint when the device is worn on a hand of a user,

wherein the movement restrictor is adapted to provide different magnitudes of flexion resistance force for resisting flexion of the finger joint based on a flexion resistance control signal, and

wherein the joint-movement restrictor comprises an arrangement of electro-magnets having a repelling force between the electro-magnets which can vary based on an electric signal supplied to the electro-magnets, the supplied electric signal being based on the flexion resistance control signal;

a processing unit adapted to receive a flexion control signal from a control system and to generate the flexion resistance control signal based on the received control signal; and

a joint flexion sensor adapted to determine an angle of flexion of the finger joint and to generate a flexion feedback signal based on the determined angle of flexion of the finger joint, wherein the processing unit is adapted to generate the flexion resistance control signal further based on the flexion feedback signal,

wherein the flexion resistance control signal simulates an object'"'"'s resistance or obstruction to movement or manipulation.

10. The device of claim 9, wherein the processing unit is adapted to communicate the flexion feedback control signal to the control system.

11. The device of claim 9, further comprising a haptic feedback unit adapted to be positioned adjacent a finger pad or palm when the device is worn on the hand of the user, wherein the haptic feedback unit is adapted to apply different magnitudes of tactile force to the finger pad or palm based on a tactile feedback control signal.

12. The device of claim 11, further comprising a processing unit adapted to receive a haptic feedback control signal from a control system and to generate the tactile feedback control signal based on the received haptic feedback control signal.

13. The device of claim 9, wherein the device comprises a glove.

14. A system for simulating interaction with a virtual object in a virtual or augmented reality environment, the system comprising:

the hand-wearable haptic interface device of claim 9; and

a control system configured to generate the flexion resistance control signal and to communicate the flexion resistance control signal to the hand-wearable haptic interface device.

15. A method for simulating interaction with a virtual object in a virtual or augmented reality environment, the method comprising:

calculating a resistance that a hand of a user would encounter when interacting with a real-world object corresponding to the virtual object;

sensing an angle of flexion of a finger joint on the hand of the user and generating a flexion feedback signal indicating the sensed angle of flexion of the finger joint;

calculating a flexion resistance force based on the calculated real-world resistance and the sensed angle of flexion in response to the flexion feedback signal and generating a flexion resistance control signal indicating the calculated flexion resistance force; and

applying, through a hand-wearable haptic interface device, the flexion resistance force to the finger joint to restrict flexion of the finger joint.

16. The method of claim 15, further comprising:

calculating a magnitude of tactile force that the hand of the user would encounter when interacting with the real-world object corresponding to the virtual object;

generating tactile feedback control signal based on the calculated magnitude of tactile force; and

applying, through the hand-wearable haptic interface device, the magnitude of tactile force to a finger pad or palm of the hand in response to the tactile feedback control signal.