Image animation for visual training in a simulator

• US 5,533,181 A
• Filed: 06/21/1995
• Issued: 07/02/1996
• Est. Priority Date: 12/24/1990
• Status: Expired due to Term

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: Loral Corporation (Newell Brands Inc.)
• Inventors: Bergsneider, Carl W.
• Primary Examiner(s): Jankus, Almis R.
• Assistant Examiner(s): Feild, Joseph H.
• Application Number:
  US08/492,941
• Time in Patent Office: 377 Days
• Field of Search: 395/152-153, 364/410, 364/424.06, 434/29-51, 434/14, 348/121-123, 348/594, 348/586, 358/450, 358/452, 273/433-434, 273/313-316, 345/122, 345/113-114
• US Class Current: 345/473
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G09B 9/302 the image being transformed by computer processing, e.g. updating the image to correspond to the changing point of view

Abstract

A method and apparatus for generating imagery animation in a color video monitor as may be used for visual training. A high resolution photo image of a particular station which is to be the subject for simulation training is generated and it is electronically scanned to produce a digitized photo image of the station. The digitized photo image is edited to remove all images exhibiting dynamic characteristics and the resultant photo image is stored in graphics processor video memory designated for background static object imagery. The removed dynamic object images are rendered and stored in graphics processor video memory designated for foreground dynamic object imagery. The background static and foreground dynamic object imageries are combined in a composite video signal which is applied to a trainee video monitor. Once the background static object imagery is generated in the monitor, only the foreground dynamic object images are manipulated by the graphics processor for real-time imagery animation.

Claims

1. In a simulator trainer including (a) a trainee station video monitor providing visual imagery of real-time events, (b) a trainer controller providing signals indicative of various training scenarios, (c) a graphics processor providing video imagery to the trainee video monitor, and (d) a simulation computer responsive to trainer controller and trainee station response signals to provide control signals to the graphics processor, a method of generating imagery animation comprising the steps of:

providing a photo image of an actual station to be simulated, for simulation training;

scanning the photo image to provide a digitized electronic signal indicative of the photo image;

editing the digitized photo image by removing all object images which exhibit dynamic character and inserting background shading in areas where dynamic object images have been removed, generating a static image;

loading the edited digitized static image into a first array of video memory files designated for background static object imagery, said first array having a first specific range of colors assigned thereto;

loading rendered dynamic object images into a second array of video memory files designated for foreground dynamic object imagery, said second array having a second specific range of colors assigned thereto, wherein said first specific range of colors is distinct from said second specific range of colors, and wherein the first array remains unchanged by the graphics processor and is only manipulated by the simulation computer when there is a change in the aircraft being simulated;

combining the background static and foreground dynamic object imageries into a composite video signal;

feeding the composite video signal into the trainee video monitor to provide background static object imagery and overlaying foreground dynamic object imagery; and

manipulating by the graphics processor only the foreground dynamic object imagery in accordance with simulation computer control signals, wherein the trainer controller functions to change training scenarios represented by the foreground dynamic object imagery corresponding to trainee responses received by the simulation computer, and wherein the background static and foreground dynamic object imageries employed in the training scenario are reconfigurable by the trainer controller for object imageries peculiar to an actual aircraft.

2. The method as set forth in claim 1 wherein the photo image comprises a color print photograph of the particular station.

3. The method as set forth in claim 2 wherein the photo image comprises a 35 mm color print photograph of the particular station.

4. The method as set forth in claim 1 wherein the edited digitized photo images and the rendered dynamic object images are loaded into video memory files of the graphics processor.

5. The method as set forth in claim 4 wherein the edited digitized photo images are loaded into graphics processor video memory files designated for background static object imagery and the rendered dynamic object images are loaded into separate video memory files designated for foreground dynamic object imagery.

6. The method as set forth in claim 1 wherein the editing also comprises scaling of the photo image to produce a life-sized video image in the trainee video monitor.

7. In an aircraft simulator trainer for crew member training including (a) a trainee station video monitor providing visual imagery of real-time events, (b) a trainer controller providing signals indicative of various aircraft training scenarios, (c) a graphics processor providing video imagery to the trainee video monitor, and (d) a simulation computer having programmed training exercises and responsive to trainer controller and trainee station response signals to provide control signals to the graphics processor, a method of generating imagery animation in the trainee monitor comprising the steps of:

providing a photo image of an actual aircraft cockpit station instrumentation which is to be simulated as the subject for simulation training;

electronically scanning the photo image to provide a digitized electronic photo image thereof;

editing the digitized photo image by removing all object images exhibiting dynamic character and inserting background shading to those areas where dynamic object images have been removed, generating a static image;

loading the edited digitized photo image into a first array of video memory of the graphics processor designated for background static object imagery, said first array having a first specific range of colors assigned thereto;

loading rendered dynamic object images into a second array of video memory of the graphics processor designated for foreground dynamic object imagery, said second array having a second specific range of colors assigned thereto, wherein said first specific range of colors is distinct from said second specific range of colors, and wherein the first array remains unchanged by the graphics processor and is only manipulated by the simulation computer when there is a change in the aircraft being simulated;

combining the background static and foreground dynamic imageries into a composite video signal;

feeding the composite video signal to the trainee video monitor to provide background static object imagery and overlaying foreground dynamic object imagery; and

manipulating only the foreground dynamic object imagery in accordance with simulation computer control signals, wherein the trainer controller functions to change training scenarios represented by the foregoing dynamic object imagery corresponding to trainee responses received by the simulation computer, and wherein the background static and foregoing dynamic object imageries employed in the training scenario are reconfigurable by the trainer controller for instrumentation peculiar to an actual aircraft.

8. The method as set forth in claim 7 wherein the photo image comprises a color print photograph of a pilot'"'"'s cockpit instrumentation.

9. The method as set forth in claim 8 wherein the photo image comprises a 35 mm color print photograph.

10. The method as set forth in claim 7 wherein the simulator trainer also includes a touch-screen panel mounted to the trainee video monitor, wherein the simulation computer is responsive to signals generated from the touch-sceen panel by a trainee entering changes to the video monitor imagery.

11. The method as set forth in claim 7 wherein the editing also comprises scaling of the photo image to produce a life-sized video image in the trainee video monitor.

12. In a simulator trainer including (a) a trainee station video monitor providing visual imagery of real-time events, (b) a trainer controller providing signals indicative of various training scenarios, (c) a graphics processor providing video imagery to the trainee station monitor, and (d) a simulation computer having programmed training exercises and responsive to trainer controller and trainee station response signals to provide control signals to the graphics processor, apparatus for generating imagery animation in the trainee station video monitor comprising in combination:

means to generate a photo image of an actual station which is to be simulated as the subject for simulation training;

means to scan the photo image and provide a digitized electronic signal indicative of the photo image;

means to edit the digitized photo image to remove all object images exhibiting dynamic character; and

means to render the dynamic object images which were removed by editing the digitized photo image;

said edited digitized photo image being loaded into video memory of the graphics processor designated for background static object imagery and assigned a first specific range of colors, while the rendered dynamic object images are loaded into video memory of the graphics processor designated for foreground dynamic object imagery and assigned a second specific range of colors different from the first specific range of colors, said graphics processor effecting a combination of the background static and foreground dynamic object imageries where the processing time of the graphics processor is reduced by limiting the background static and foreground dynamic imageries to their respective specific color ranges and where the combination is in the form of a composite video signal which is applied to the trainee station video monitor and only the dynamic object imagery is manipulated by the graphics processor in accordance with control signals from the simulation computer, wherein the trainer controller functions to change training scenarios represented by the foreground dynamic object imagery corresponding to signals generated by a plurality of hand controls input by a trainee and received by the simulation computer and wherein the background static and foreground dynamic object imageries employed in the programmed training exercises are reconfigurable by the trainer controller to represent particular scenarios.

13. The apparatus according to claim 12 wherein the means to generate a photo image comprises a camera formated for color print film to provide a high resolution color photo.

14. The apparatus according to claim 13 wherein the means to generate a photo image comprises a camera formated for 35 mm color print film to provide a contact color print of the particular station.

15. The apparatus according to claim 12 wherein the means to edit also inserts shading in the areas where dynamic object images are removed and scales the resultant photo image to produce a life-sized video image in the trainee video monitor.

16. In an aircraft simulator trainer for crew member training including (a) at least one trainee station having a video color monitor providing visual imagery of real-time events, (b) a trainer controller providing a signal'"'"'s indicative of various aircraft training scenarios, (c) a graphics processor providing video imagery to the at least one trainee station video monitor, and (d) a simulation computer having programmed training exercises and responsive to trainer controller and trainee station response signals to provide control signals to the graphics processor, apparatus for generating imagery animation in the trainee station video monitor comprising in combination:

means to generate a high resolution photo image of an actual aircraft cockpit station which is to be simulated as the subject for simulation training;

means to electronically scan the photo image to generate a digitized electronic signal indicative of the photo image;

means to edit the digitized photo image to remove all object images which exhibit dynamic characteristics;

said edit digitized photo image being loaded into video memory of the graphics processor designated for background static object imagery and assigned a first specific range of colors, while the rendered dynamic object images are loaded into video memory of the graphics processor designated for foreground dynamic object imagery and assigned a second specific range of colors different from the first specific range of colors and the graphics processor effects combining of the background static and foreground dynamic object images into a composite video signal where the processing time of the graphics processor is reduced by limiting the background static and foreground dynamic imageries to their respective specific color ranges and where the composite video signal is applied to the trainee station video monitor and only the foreground dynamic object imagery is manipulated by the graphics processor in accordance with control signals from the simulation computer, wherein the trainer controller functions to change the composite video signal corresponding to signals generated by a plurality of hand controls input by a trainee and received by the simulation computer, and wherein the composite video signal employed in the aircraft training scenarios to represent an aircraft cockpit station.

17. The apparatus according to claim 16 wherein the means to generate a high resolution photo image comprises a camera formated for color print film to provide a contact color print of the cockpit station.

18. The apparatus according to claim 17 wherein the camera is formated for 35 mm color print film.

19. The apparatus according to claim 16 wherein the simulator trainer also includes a touchscreen panel mounted to the trainee video monitor and wherein the simulation computer is responsive to signals generated by a crew member trainee from the touchscreen panel via a touchscreen controller which is connected to the simulation computer.

20. The apparatus according to claim 16 wherein the means to edit also inserts shading in the areas where dynamic object images are removed and scales the resultant photo image to produce a life-sized video image in the trainee video monitor.