Augmented reality traffic control center

• US 20050231419A1
• Filed: 04/15/2004
• Published: 10/20/2005
• Est. Priority Date: 04/15/2004
• Status: Active Grant

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: Lockheed Martin MS2 (Martin Marietta Corporation)
• Inventors: Mitchell, Steven W.
• Granted Patent: US 7,129,887 B2
• Time in Patent Office: Days
• US Class Current: 342/36
• CPC Class Codes: G08G 5/0026 located on the ground
• CPC Class Codes: G08G 5/0082 for monitoring traffic from a ground station radar or analogous systems specially adapted for traffic control G01S13/91

Abstract

In an exemplary embodiment, an augmented reality system for traffic control combines data from a plurality of sensors to display, in real time, information about traffic control objects, such as airplanes. The sensors collect data, such as infrared, ultraviolet, and acoustic data. The collected data is weather-independent due to the combination of different sensors. The traffic control objects and their associated data are then displayed visually to the controller regardless of external viewing conditions. The system also responds to the controller'"'"'s physical gestures or voice commands to select a particular traffic control object for close-up observation or to open a communication channel with the particular traffic control object.

Claims

1. A augmented reality system, comprising:

a display;

a sensor for collecting data associated with traffic control objects in a traffic control space;

a computer receiving said data from said sensor, and operative to display said data on said display in real time; and

means for detecting a physical gesture of a traffic controller selecting an traffic control object displayed on said display.

2. The system of claim 1, wherein said traffic control objects are air traffic control objects.

3. The system of claim 2, further comprising means for displaying flight data about said air traffic control objects on said display.

4. The system of claim 3, wherein said flight data comprises at least one of a trajectory, heading, altitude, speed, call sign, and flight number.

5. The system of claim 2, further comprising means for opening a communication channel to said selected air traffic control object.

6. The system of claim 2, wherein said display comprises a plurality of displays arranged to simulate a plurality of windows in a flight control tower.

7. The system of claim 2, further comprising:

means for opening a computer data file containing data about said selected air traffic control object; and

means for displaying said data as a textual annotation on said display.

8. The system of claim 7, wherein said data about said selected air traffic control object comprises at least one of:

a passenger list or a physical characteristic of said selected air traffic control object.

9. The system of claim 1, wherein said physical gesture to be detected comprises at least one of a hand gesture, a pointing gesture, a voice command, a sustained visual look, and a change of visual focus.

10. The system of claim 1, wherein said sensor comprises at least one of an infrared image sensor, a radio frequency image sensor, RADAR, LIDAR, a millimeter wave imaging sensor, an acoustic sensor, a digital infrared camera, a digital ultraviolet camera, an electro-optical camera, digital RADAR, and high-resolution radar.

11. The system of claim 1, wherein said display comprises a virtual reality helmet.

12. The system of claim 1, wherein said traffic control space is an aircraft carrier air traffic control space.

13. The system of claim 1, wherein said traffic control space is a train traffic control space.

14. The system of claim 1 wherein said means for detecting comprise a laser pointer, a gyro-mouse, a video observation system, a data glove, a touch-sensitive screen, and a voice observation system.

15. The system of claim 1, wherein said data collected by said sensor comprises non-visual data.

16. A method, comprising:

(a) collecting data associated with traffic control objects in a traffic control space;

(b) displaying said data in real time; and

(c) detecting a physical gesture of a traffic controller selecting one of said traffic control objects displayed.

17. The method of claim 16, further comprising:

(d) opening a communication channel with said selected traffic control object.

18. The method of claim 16, wherein (a) comprises collecting data associated with air traffic control objects.

19. The method of claim 18, further comprising:

(d) displaying flight data about said air traffic control objects.

20. The method of claim 19, wherein (d) comprises displaying at least one of a trajectory, heading, altitude, speed, call sign, and flight number.

21. The method of claim 18, further comprising:

opening a computer data file containing data about said selected air traffic control object; and

displaying said data as a textual annotation on said display.

22. The method of claim 16, wherein (a) comprises collecting said data from at least one of an infrared image sensor, a radio frequency image sensor, RADAR, LIDAR, a millimeter wave imaging sensor, an acoustic sensor, a digital infrared camera, a digital ultraviolet camera, digital RADAR, and electro-optical camera, and high-resolution radar.

23. The method of claim 16, wherein (c) comprises detecting at least one of a hand gesture, a pointing gesture, a voice command, a sustained visual look, and a change of visual focus.

24. The method of claim 16, wherein (b) comprises displaying said data on at least one of:

a plurality of displays arranged to simulate a plurality of windows in a flight control tower, and a virtual reality helmet.

25. The method of claim 16, wherein (a) comprises collecting non-visual data associated with traffic control objects in a traffic control space.