Interactive aircraft training system and method

• US 5,320,538 A
• Filed: 09/23/1992
• Issued: 06/14/1994
• Est. Priority Date: 09/23/1992
• Status: Expired due to Term

• Current Assignee: L-3 Communications Corporation (L3Harris Technologies, Inc.)
• Original Assignee: Hughes Training, Inc.
• Inventors: Baum, David R.
• Primary Examiner(s): Apley, Richard J.
• Assistant Examiner(s): Cheng, Joe H.
• Application Number:
  US07/950,114
• Time in Patent Office: 629 Days
• Field of Search: 434/38, 434/40, 434/69, 434/258, 434/307, 434/308, 434/350, 340/686, 340/689, 340/705, 340/709, 381/190, 381/205, 358/88, 358/93, 358/105, 358/229, 358/213.1, 358/248, 455/89, 901/1, 73/299, 73/323, 73/379, 73/379.01, 395/127, 395/135, 395/152, 395/154, 395/155, 395/161, 33/313, 33/366, 33/377, 364/578, 273/856, 273/DIG. 28, 345/7-9, 345/156, 345/157
• US Class Current: 434/307.00R
• CPC Class Codes: G09B 9/165 Condition of cabin, cockpit or pilot's accessories
• CPC Class Codes: G09B 9/22 including aircraft sound simulation
• CPC Class Codes: G09B 9/307 by helmet-mounted projector or display G09B9/36 takes precedence; optical parts of head-up displays G02B27/01
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: Y10S 345/952 Simulation

Abstract

The system includes a computer (20), a detector (40) for detecting and tracking head orientation and head movement of an individual, a pair of tactile gloves (42, 44) which are donned by the individual (51) for detecting and transmitting to the computer (20) as input data orientation and movements of the hands of the individual inserted in the tactile gloves (42, 44), a stereoscopic, head-mounted display (31), a subsystem for enabling the computer to generate a stereoscopic image of the training environment, a subsystem for causing the stereoscopic image of the training environment to be displayed and changed by the computer relative to input data received by the computer relating to the head orientation and head movement of the individual, relative to input data received by the computer relating to orientation and movement of the hands of the individual inserted in the tactile gloves, and relative to input data reflecting realistic changes in the training environment that would be perceived by the individual if interacting with an identical, non-simulated, training environment. An object (43) representative of a tool is adapted for transmitting tactile information to the computer (20). Sounds representative of the environment are transmitted to the individual (51) through the earphones (33). Vocal emanations of the individual are detected by a microphone (48). System peripheral items (31, 33, 40, 42, 43, 44, 48) are connected to the computer (20) by means of wires (60, 61, 62, 63, 64, 65). The computer (20) interfaces and incorporates an environment simulation and modeling subsystem (22), an image generation component (24), a user interface management component (26), and a component for formulating and transmitting instructional input (28).

Claims

1. An interactive training system comprising:

a computer;

means for detecting the head orientation and head movement of an individual;

at least one tactile glove means for receiving a hand of the individual and for detecting and transmitting to said computer as input data representing orientation and movements of the hand of the individual inserted in said tactile glove;

means for displaying a stereoscopic computer-generated image of a training environment to the individual;

means for enabling said computer to generate a stereoscopic image of the training environment; and

means for causing the stereoscopic image of the training environment to be displayed and changed by the computer relative to said input data received by said computer relating to the head orientation and head movement of the individual, relative to said input data received by said computer relating to orientation and movement of the hand of the individual inserted in said tactile glove means, and relative to input data reflecting realistic changes in the training environment that would be perceived by the individual if interacting with an identical, non-simulated, training environment,

further comprising tactile object means to be grasped by an individual and adapted for detecting and transmitting to said computer as input data orientation of, movements of, and manipulation of said tactile object means, and further comprising means for causing the stereoscopic image of the training environment to be displayed and changed by the computer relative to said input data received by said computer relating to orientation of, movement of, and manipulation of said tactile object means.

2. The invention of claim 1, said at least one tactile glove means comprising two tactile glove means.

3. The invention of claim 1, further comprising a tactile means for detecting and transmitting to said computer as input data representing orientation and movement of predetermined body parts of the individual and further comprising means for causing the stereoscopic image of the training environment to be displayed and changed by the computer relative to said input data received by said computer relating to orientation and movement of predetermined body parts of the individual.

4. The invention of claim 3, said tactile means for detecting and transmitting to said computer as input data representing orientation and movement of predetermined body parts of the individual comprising a tactile body suit.

5. The invention of claim 1, further comprising a microphone for detecting vocal emanations of the individual, means for converting said vocal emanations of the individual into input data and means for transmitting to said computer said input data of vocal emanations of the individual, and further comprising means for causing the stereoscopic image of the training environment to be displayed and changed by the computer relative to said input data received by said computer relating to vocal emanations of the individual.

6. The invention of claim 1, said means for displaying a stereoscopic computer-generated image of the training environment to the individual comprising a stereoscopic, head-mounted display.

7. The invention of claim 1, further comprising means for conveying aural features of the training environment to the individual.

8. The invention of claim 7, said means for means for conveying aural features of the training environment to the individual comprising stereophonic earphones.