Trainer using video photographs and overlays for reconfigurable hardware simulation

• US 5,286,202 A
• Filed: 12/22/1992
• Issued: 02/15/1994
• Est. Priority Date: 10/30/1990
• Status: Expired due to Term

• Current Assignee: L-3 Communications Corporation (L3Harris Technologies, Inc.)
• Original Assignee: Hughes Training, Inc.
• Inventors: de Gyarfas, Victor S., Saunders, Randy
• Primary Examiner(s): Apley, Richard J.
• Assistant Examiner(s): CHENG, JOE H
• Application Number:
  US07/995,569
• Time in Patent Office: 420 Days
• Field of Search: 434/23, 434/24, 434/29, 434/30, 434/35, 434/38, 434/43, 434/44, 434/219, 434/307, 434/308, 434/322, 434/336, 434/350, 434/365, 434/372, 273/85 G, 273/434, 273/DIG. 28, 358/92, 358/104, 358/229, 358/241, 358/254, 340/706-709, 340/712, 340/717, 340/724, 385/135, 385/155, 385/156, 385/159, 385/160, 385/161, 244/118.5, 244/1 R, 73/866.1, 73/866.3
• US Class Current: 434/43
• CPC Class Codes: G09B 9/302 the image being transformed by computer processing, e.g. updating the image to correspond to the changing point of view

Abstract

A system (10) for simulating an operating environment, such as aircraft cockpit for use in training. The system (10) includes a video storage device (46) for storing and transmitting an image of the operating environment. The video storage device (46) is coupled to a video monitor (58) for displaying the stored image. A graphics generator (54) generates an overlay image simulating the appearance of displays and manipulable controls in the operating environment in a plurality of its manipulative states. The graphics overlays may be manipulated by means of a touch sensitive screen (64) to simulate the operation of the manipulable controls. The system also includes an interactive system (12) for authoring and editing the overlays as well as the simulation process.

Claims

1. A vehicle simulation system for training operators of a hardware system comprising:

video storage means for storing and transmitting a plurality of static images, each consisting of a different view of the hardware system;

graphic generator means for generating overlay images simulating the appearance of manipulable controls in the hardware system in a plurality of states;

overlay processor coupled to the video storage means and to the graphics generator for combining the overlay images with the static images, the overlay images of a given manipulable control being superimposed over a corresponding manipulable control in the static image;

video monitor coupled to the video storage means, graphics generator means and overlay processor means for displaying said static and overlay images;

user interface coupled to said graphics generator means and responsive to user input for adjusting the state of said overlay images of manipulable controls; and

host computer coupled to the video storage means, graphics generator means and overlay processor for controlling the sequence and state of the display of the static and overlay images to simulate a plurality of views of the hardware system with the manipulable controls in a plurality of states.

2. The system of claim 1 wherein said graphics generator means comprises a database for storing a set of commands specifying the appearance of said overlay image and means for storing said database.

3. The system of claim 1 further comprising means for developing said database including an interactive tool for providing a graphical user interface during development of said data base.

4. The system of claim 1 wherein said images of said hardware system comprise photographs of said hardware system.

5. The system of claim 1 wherein said video storage means comprises a laser disk player.

6. The system of claim 1 wherein said video monitor includes

a touch sensitive screen for transmitting a signal responsive to touching particular areas of said screen to said user interface means.

7. The system of claim 1 wherein said hardware system is the interior of a vehicle and said manipulable controls are the controls for operating said vehicle.

8. A vehicle simulation system for training operators of a hardware system comprising:

video storage means for storing and transmitting a plurality of static images, each consisting of a different view of the hardware system;

graphic generator means for generating overlay images simulating the appearance of manipulable controls in the hardware systems in a plurality of states;

overlay processor coupled to the video storage means and to the graphics generator for combining the overlay images with the static images, the overlay images of a given manipulable control being superimposed over a corresponding manipulable control in the static image;

video monitor coupled to the video storage means, graphics generator means and overlay processor means for displaying said static and overlay images;

user interface means coupled to said graphic generator means and responsive to user input for adjusting the state of said overlay images of manipulable controls;

host computer coupled to the video storage means, graphics generator means and overlay processor for controlling the sequence and state of the display of the static and overlay images to simulate a plurality of views of the hardware system with the manipulable controls in a plurality of states;

graphics authoring workstation coupled to said graphics generator means for authoring and updating said overlay images; and

a database authoring workstations for authoring and updating software, said software for defining a training program consisting of a sequence of said static images of said hardware system and said overlay images.

9. The system of claim 8 wherein said database authoring work station comprises a VAX computer and computer terminal connected to said graphics authoring work station and to said host computer.

10. The system of claim 8 wherein said graphics authoring work station comprises a personal computer, a high resolution graphics monitor, a video overlay monitor, a video disc player, a keyboard and a mouse.

11. The system of claim 8 wherein said graphics generator means comprises a database for storing a set of commands specifying the appearance of said overlay image, and a means for storing said database.

12. The system of claim 8 further comprising a means for developing said database including an interactive tool for providing a graphical user interface during development of said database.

13. The system of claim 8 wherein said images of said hardware system comprise photographs of said hardware system.

14. The system of claim 8 wherein said video storage means comprises a laser disc player.

15. The system of claim 8 wherein said video monitor includes

a touch sensitive screen for transmitting a signal responsive to touching particular areas of said screen to said user interface means.

16. The system of claim 8 wherein said hardware system is the cockpit of an aircraft and said manipulable controls are the controls for operating said aircraft.

17. A reconfigurable system for training operators for a variety of different hardware items in an operating environment, each hardware item having manipulable controls and displays which operate in a plurality of states, said system comprising:

an operator training station comprising video signal storage means for storing and transmitting a plurality of static images of said hardware in the operating environment, each consisting of a different view of the hardware system, video monitor means coupled to said video storage means for displaying said image of said hardware in the operating environment, graphics generator means for generating overlay images simulating the appearance of manipulable controls in a plurality of manipulative states, overlay processor coupled to the video storage means and to the graphics generator for combining the overlay images with the static images, the overlay images of a given manipulable control being superimposed over a corresponding control in the static image;

and a host computer coupled to said video signal storage means, said video monitor, and said graphics generator means for controlling the display of said images on said video monitor;

the system further comprising;

a graphics authoring work station coupled to said operator training station for authoring and updating said overlay image; and

a database authoring work station coupled to said operator training station for authoring and updating software, said software for defining a plurality of training programs, each program consisting of a sequence of said static images of said hardware in an operating environment and said overlay images of said plurality of manipulative states.

18. The system of claim 17 wherein said graphics generator means comprises a database for storing a set of commands to specify the appearance of said overlay images and means for storing said database.

19. The system of claim 17 further comprising means for developing said database including an interactive tool for providing a graphical user interface during development of said database.

20. The system of claim 17 further comprising:

a touch sensitive screen responsive to touching particular areas of said screen for transmitting a signal to said host computer; and

means for altering the appearance of said overlay images in response to said touching.