Tactile interface apparatus for providing physical feedback to a user based on an interaction with a virtual environment

• US 5,737,505 A
• Filed: 10/15/1996
• Issued: 04/07/1998
• Est. Priority Date: 01/11/1995
• Status: Expired due to Fees

• Current Assignee: Haptek, Incorporated
• Original Assignee: Haptek, Incorporated
• Inventors: Wiley, Jack W., Shaw, Christopher D.
• Primary Examiner(s): Nguyen, Phu K.
• Assistant Examiner(s): Vo, Cliff N.
• Application Number:
  US08/729,310
• Time in Patent Office: 539 Days
• Field of Search: 395/99, 395/119, 395/87, 395/85, 395/86, 395/97, 318/568.1, 318/568.11, 482/901, 273/438
• US Class Current: 345/419
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/28 responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light controlling the output signals based on the game progress A63F13/50
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 13/577 using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars
• CPC Class Codes: A63F 13/833 Hand-to-hand fighting, e.g. martial arts competition A63F13/837 takes precedence
• CPC Class Codes: A63F 13/90 Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/302 specially adapted for receiving control signals not targeted to a display device or game input means, e.g. vibrating driver's seat, scent dispenser
• CPC Class Codes: A63F 2300/303 for displaying additional data, e.g. simulating a Head Up Display
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/643 by determining the impact between objects, e.g. collision detection
• CPC Class Codes: A63F 2300/8029 Fighting without shooting
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06F 2203/013 Force feedback applied to a game
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

A tactile interface system which provides a method for entering user position into a virtual reality and providing tactile feedback from that virtual reality. This system will allow for the representation of the user limb position and enable the user to feel interactions with objects represented in the virtual reality. The system also provides for the recording of tactile information to accompany audio and visual recordings.

Claims

1. Tactile interface apparatus comprising:

a mounting means;

a left interface arm comprising a left upper arm and a left forearm, the left interface arm for providing physical feedback to a left human arm, the left upper arm and the left forearm being coupled to one another for rotation about a left elbow hinge;

a right interface arm comprising a right upper arm and a right forearm, the right interface arm for providing physical feedback to a right human arm, the right upper arm and the right forearm being coupled to one another for rotation about a right elbow hinge;

a left mechanical shoulder rotatably coupling the left interface arm to the mounting means, the left mechanical shoulder permitting rotation of the left upper arm with respect to the mounting means about a left shoulder pivot;

a right mechanical shoulder rotatably coupling the right interface arm to the mounting means, the right mechanical shoulder permitting rotation of the right upper arm about a right shoulder pivot;

left actuating means being operable in response to a left output signal to cause rotation of the left forearm relative to the left upper arm, and simultaneously to cause rotation of the left upper arm relative to the mounting means, thereby to exert forces on the left human arm in use;

right actuating means being operable in response to a right output signal to cause rotation of the right forearm relative to the right upper arm, and simultaneously to cause rotation of the right upper arm relative to the mounting means, thereby to exert forces on the right human arm in use;

sensing means for providing input signals representative of the relative locations of the left forearm, the left upper arm and the mounting means, and representative of the relative locations of the right forearm, the right upper arm and the mounting means; and

processing means for providing a virtual environment and for determining an interaction of the human operator with the virtual environment in use, the interaction being determined from the virtual environment and the input signals, the processing means further providing the left and right output signals to the left and right actuating means respectively based on said determined interaction, thereby to exert forces on the left and right human arms in use.

2. Tactile interface apparatus according to claim 1 wherein

the left actuating means comprises linear actuating means which acts between a point on the left forearm which is offset from the left elbow hinge and a point on the left mechanical shoulder which is offset from the left shoulder pivot;

and

the right actuating means comprises linear actuating means which acts between a point on the right forearm which is offset from the right elbow hinge and a point on the right mechanical shoulder which is offset from the right shoulder pivot.

3. Tactile interface apparatus according to claim 1 wherein the sensing means comprises:

a left elbow angle measuring means for providing a left elbow input signal to the processing means, the left elbow input signal being proportional to an angle between the left upper arm and the left forearm;

a right elbow angle measuring means for providing a right elbow input signal to the processing means, the right elbow input signal being proportional to an angle between the right upper arm and the right forearm;

a left shoulder angle measuring means for providing a left shoulder input signal to the processing means, the left elbow input signal being proportional to an angle between the left upper arm and the mounting means; and

a right shoulder angle measuring means for providing a right shoulder input signal to the processing means, the right shoulder input signal being proportional to an angle between the right upper arm and the mounting means;

the processing means determining an interaction of the human operator with the virtual environment in use, the interaction being determined from the virtual environment and the left and right shoulder and elbow input signals, the processing means further providing the left and right output signals to the left and right actuating means respectively based on said determined interaction.

4. Tactile interface apparatus according to claim 3 further comprising a face assembly comprising a face protector and display means, the display means for providing an image of the virtual environment.

5. Tactile interface apparatus according to claim 4 further comprising:

a chest restraint for corresponding to a human chest, the face assembly being rotatable relative to the chest restraint; and

face assembly actuating means being operable to rotate the face assembly relative to the chest restraint.

6. Tactile interface apparatus according to claim 4 further comprising:

a chest restraint for corresponding to a human chest, the chest restraint including contact means being operable to contact the human chest.

7. Tactile interface apparatus according to claim 4 wherein:

the processing means provides a display signal to the display means in use, the display means providing output which includes an image of the left and right human arms from a user'"'"'s perspective.

8. Tactile interface apparatus according to claim 3 further comprising left and right fist cups being coupled to the left and right forearms respectively, the left and right fist cups for corresponding to left and right human hands respectively.

9. Tactile interface apparatus according to claim 3 wherein the left and right actuating means are selected from the group consisting of pneumatic cylinders, hydraulic cylinders and electric servo motors.

10. Tactile interface apparatus comprising:

a mounting means;

an interface arm comprising an upper arm and a forearm, the interface arm for providing physical feedback to a human arm, the upper arm and the forearm being coupled to one another for rotation about an elbow hinge;

a mechanical shoulder rotatably coupling the interface arm to the mounting means, the mechanical shoulder permitting rotation of the upper arm with respect to the mounting means about a shoulder pivot;

linear actuating means being operable in response to an output signal to cause rotation of the forearm relative to the upper arm, and simultaneously to cause rotation of the upper arm relative to the mounting means, thereby to exert forces on the human arm in use, the actuating means acting in use between a point on the forearm which is offset from the elbow hinge and a point on the mechanical shoulder which is offset from the shoulder pivot;

an elbow angle measuring means for providing an elbow input signal proportional to an angle between the upper arm and the forearm;

a shoulder angle measuring means for providing a shoulder input signal proportional to an angle between the upper arm and the mounting means; and

processing means for providing a virtual environment and for providing the output signal to the actuating means;

the processing means determining an interaction of the human operator with the virtual environment, the interaction being determined from the virtual environment and the shoulder and elbow input signals, the processing means further providing the output signal to the actuating means based on said determined interaction, thereby to exert forces on the human arm in use.

11. Tactile interface apparatus according to claim 10 further comprising

a face assembly comprising a face protector and display means, the display means for providing an image of the virtual environment.

12. Tactile interface apparatus according to claim 11 further comprising:

a chest restraint for corresponding to a human chest, the face assembly being rotatable relative to the chest restraint; and

face assembly actuating means being operable to rotate the face assembly relative to the chest restraint.

13. Tactile interface apparatus according to claim 10 further comprising:

a chest restraint for corresponding to a human chest, the chest restraint including contact means being operable to contact the human chest.

14. Tactile interface apparatus according to claim 11 wherein:

the processing means provides a display signal to the display means in use, the display means providing output which includes an image of the human arm from a user'"'"'s perspective.

15. Tactile interface apparatus according to claim 11 further comprising a fist cup being coupled to the forearm, the fist cup for corresponding to a human hand.

16. Tactile interface apparatus according to claim 10 wherein the actuating means is selected from the group consisting of pneumatic cylinders, hydraulic cylinders and electric servo motors.