Virtual hand: a new 3-D haptic interface and system for virtual environments

• US 8,350,843 B2
• Filed: 03/13/2008
• Issued: 01/08/2013
• Est. Priority Date: 03/13/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Rogowitz, Bernice E., Borrel, Paul
• Primary Examiner(s): WANG, JIN CHENG
• Application Number:
  US12/047,848
• Publication Number:
  US 20090231272A1
• Time in Patent Office: 1,762 Days
• Field of Search: 345156-173, 345419-427
• US Class Current: 345/419
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

The present invention discloses a creation of a virtual hand, body part, or tool in a virtual environment, controlled by a new 3-D haptic interface for virtual environments. There is also the provision of a method and arrangement applicable to computer systems for creating a virtual environment, which facilitates a user to touch, feel, edit, and interact with data about the objects, surfaces, and textures in the environment. There is also a provision for multiple virtual hands operating in the same virtual world, so that users can work collaboratively in the virtual world; they can touch, feel and edit the data in the virtual world, including data about the other users'"'"' virtual hands.

Claims

1. A method of producing a 3-D interface facilitating a user to move a virtual hand or body part or tool through a computer graphics environment defining a “

virtual space”

having representations of objects and corresponding surfaces, said method comprising;

providing, in communication with a computer device forming said computer graphics environment, a haptic device including a robot arm mounting an array of pins, said pins having tips for contacting the hand of the user, said tips of the array of pins providing a touching surface of the virtual hand, said virtual hand represented in said virtual space corresponding to an imprint resulting from placing the user'"'"'s hand on said touching surface;

communicating control signals, from said haptic device to said computer device, for moving the virtual hand in said defined virtual space corresponding to movement imparted to the haptic device responsive to said pin tips contacting and being displaced by motion of the user'"'"'s hand on the touching surface;

representing virtual objects encountered by said virtual hand in said virtual space via the haptic device;

communicating, via said computer device, tactile information about a virtual object'"'"'s characteristics, in which the virtual object deforms the touching surface;

receiving, at said haptic device, said tactile information and responsively imparting said tactile information about the surface deformation to the array of pins, to result in pin displacements such that a user'"'"'s experience of touching virtual objects and virtual surfaces in said virtual space are sensed by the user through the haptic device; and

communicating, via said haptic device, information to said computer device for transforming the represented virtual object in said computer graphics environment responsive to a user manipulating said array of pins on the haptic device, said transforming including editing or changing a shape of a virtual object, the virtual object'"'"'s surface or texture wherein pins of said array of pins possess a predefined range of motion, said method including;

detecting, for each pin, when that pin reaches an end said predefined range of motion; and

for each pin attempting to exceed its predefined range, producing motion of said robot arm to compensate for a displacement that could not be absorbed by the pin,

whereby forces applied to the user'"'"'s hand touching said pins are encountered upon said virtual hand seemingly touching objects and surfaces in said virtual environment.

2. The method as claimed in claim 1, wherein said robot arm mounting said array of pins possess 6 degrees of freedom of movement.

3. The method as claimed in claim 1, wherein said virtual hand is movable over a virtual object so as to sense a texture and shape thereof at locations where pins of said array are displaced by the user'"'"'s hand to communicate said texture and shape to the user.

4. The method as claimed in claim 3, wherein said virtual object comprises the virtual hand of another user, facilitating hand contact mediated and manipulated in a virtual world.

5. The method as claimed in claim 1, wherein said body part comprises a user'"'"'s face which is capable of transporting a virtual face into a virtual world so as to be touchable by another virtual face or virtual hand.

6. The method as claimed in claim 1, wherein said 3-D interface is adapted to generate scenarios in a virtual environment including, selectively, virtual shopping, interactive computer games, virtual masseuse avatar, virtual pottery, virtual sports, tactile skill learning, training aids, and computer-aided designs.

7. The method as claimed in claim 1, wherein said method is implementable on computer systems so as to create, through said virtual hand or body part, a virtual environment enabling a user to touch, feel and interact with data.

8. The method as claimed in claim 1, wherein forces applied by the users'"'"' hand on the haptic device allow the user to edit and shape the objects, textures and surfaces in the virtual world.

9. The method as claimed in claim 1, wherein the 3-D interface provides a collaborative mechanism whereby users in different physical environments can interact on the same computer-generated model, where each user can feel, touch, edit and manipulate the objects, surfaces and textures in the computer-generated virtual environment.

10. The method as claimed in claim 1, wherein said tactile information about the surface deformation imparted to the array pins includes information representing both a shape and elasticity of a virtual surface of an object represented in the defined virtual space.

11. The method as claimed in claim 1, wherein said responsively imparting said tactile information about the surface deformation to the array pins further comprises:

displacing, via movement of said robot arm, said pin array in a manner such that that all pins of said array are within an allowable range.

12. The method as claimed in claim 1, wherein a constraint of motion is defined for said robot arm, said motion of said robot arm produced in response to said detecting pins reaching an end said predefined range of motion being based on said constraint.

13. A system for producing a 3-D interface facilitating a user to move a virtual hand or body part through a computer graphics environment having representations of objects and corresponding surfaces, said system comprising:

a haptic device, in communication with a computer device forming said computer graphics environment, said haptic device including a robot arm mounting an array of pins, said pins having tips for contacting a hand of the user, said tips of the array of pins providing a touching surface of the virtual hand, said virtual hand represented in said virtual space corresponding to an imprint resulting from placing the user'"'"'s hand on said touching surface;

said haptic device communicating control signals to said computer device for moving the virtual hand in said defined virtual space corresponding to movement imparted to the haptic device responsive to said pin tips contacting and being displaced by motion of the user'"'"'s hand on the touching surface;

said computer device representing virtual objects encountered by said virtual hand in said virtual space via the haptic device by communicating tactile information about a virtual object'"'"'s characteristics, in which the virtual object deforms the touching surface;

said haptic device receiving said tactile information and responsively imparting said tactile information about the surface deformation to the array of pins, to result in pin displacements such that a user'"'"'s experience of touching virtual objects and virtual surfaces in said virtual space are sensed by the user through the haptic device, and

said haptic device further communicating information to said computer device for transforming the represented virtual object in said computer graphics environment responsive to a user manipulating said array of pins on the haptic device, said transforming including editing or changing a shape of a virtual object, a virtual object'"'"'s surface or texture,

wherein pins of said array of pins possess a predefined range of motion, said computer device detecting, for each pin, when that pin reaches an end said predefined range of motion; and

for each pin attempting to exceed its predefined range, said haptic device receiving signals to produce motion of said robot arm to compensate for a displacement that could not be absorbed by the pin,

whereby forces applied to the user'"'"'s hand touching said pins are encountered upon said virtual hand seemingly touching objects and surfaces in said virtual environment.

14. The system as claimed in claim 13, wherein said robot arm mounting said array of pins possess 6 degrees of freedom of movement.

15. The system as claimed in claim 14, wherein said virtual hand is movable over a virtual object so as to sense a texture and shape thereof at locations where pins of said array are displaced by the user'"'"'s hand to communicate said texture and shape to the user.

16. The system as claimed in claim 15, wherein said virtual object comprises the virtual hand of another user, facilitating hand contact mediated and manipulated in a virtual world.

17. The system as claimed in claim 13, wherein said body part comprises a user'"'"'s face which is capable of transporting a virtual face into a virtual world so as to be touchable by another virtual face or virtual hand.

18. The system as claimed in claim 13, wherein said 3-D interface is adapted to generate scenarios in a virtual environment including, selectively, interactive computer games, virtual shopping, virtual masseuse avatar, virtual pottery, virtual sports, tactile skill learning, training aids, and computer-aided designs, and is implementable on computer systems so as to create, through said virtual hand or body part, a virtual environment enabling a user to touch, feel and interact with data.

19. The system as claimed in claim 13, wherein said tactile information about the surface deformation imparted to the array pins includes information representing both a shape and elasticity of a virtual surface of an object represented in the defined virtual space.

20. The system as claimed in claim 13, wherein said responsively imparting said tactile information about the surface deformation to the array pins further comprises:

displacing, via movement of said robot arm, said pin array in a manner such that that all pins of said array are within an allowable range.

21. The system as claimed in claim 13, wherein a constraint of motion is defined for said robot arm, said motion of said robot arm produced in response to said detecting pins reaching an end said predefined range of motion being based on said constraint.