Computer-aided system for 360º heads up display of safety/mission critical data

• US 20100238161A1
• Filed: 07/20/2009
• Published: 09/23/2010
• Est. Priority Date: 03/19/2009
• Status: Abandoned Application

• Current Assignee: Real Time Companies, Llc
• Original Assignee: Real Time Companies, Llc
• Inventors: Young, Joel, Cove, Patty, Hiett, John, Varga, Kenneth
• Application Number:
  US12/460,552
• Publication Number:
  US 20100238161A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A safety critical, time sensitive data system for projecting safety/mission critical data onto a display pair of Commercial Off The Shelf (COTS) light weight projection glasses or monocular creating a virtual 360° HUD (Heads Up Display) with 6 degrees of freedom movement. The system includes the display, the workstation, the application software, and inputs containing the safety/mission critical information (Current User Position, Total Collision Avoidance System—TCAS, Global Positioning System—GPS, Magnetic Resonance Imaging—MRI Images, CAT scan images, Weather data, Military troop data, real-time space type markings etc.). The workstation software processes the incoming safety/mission critical data and converts it into a three dimensional space for the user to view. Selecting any of the images may display available information about the selected item or may enhance the image. Predicted position vectors may be displayed as well as 3D terrain.

Claims

1. A process of navigating in three dimensional space comprising the steps of

a. providing a database;

b. providing at least one sensor;

c. providing a controller;

d. providing an augmented reality display means;

e. providing networking means connecting said database, said at least one sensor, said controller, and said augmented reality display means; and

f. presenting data from said database, said at least one sensor, said controller, and said augmented reality display means to a user.

2. The process of claim 1 wherein said user operates a vehicle;

said database, said at least one sensor, and said controller are aboard said vehicle;

said user wears said augmented reality display means; and

said augmented reality display means presents an augmented see through display.

3. The process of claim 1 wherein said user operates a vehicle;

said networking means has broadband communication means;

said augmented reality display means presents an augmented see through display; and

said controller uses data from said sensor continually to update said database and said augmented see through display.

4. The process of claim 1 wherein said networking means has broadband communication means and can communicate with a plurality of remote stations;

said augmented reality display means presents an augmented see through display;

said controller can assess data from said database and said sensor to determine attributes of objects in said three dimensional space;

said attributes are selected from the group comprising threat, distance, velocity, size, position, price, address, depth, heading, time, identity, and resource availability; and

said controller projects said attributes onto said augmented reality display means.

5. The process of claim 1 wherein said augmented reality display means presents an augmented see through display;

said controller uses data from said sensor continually to update said database and said augmented see through display;

said controller can assess data from said database and said sensor to determine attributes of objects in said three dimensional space;

said attributes are selected from the group comprising threat, distance, velocity, size, position, price, address, depth, heading, time, identity, and resource availability; and

said controller projects said attributes onto said augmented reality display means.

6. The process of claim 5 further comprising the step of providing a user input means;

said user operates a vehicle; and

said attributes are displayed to said user in response to signals from said user input means.

7. The process of claim 6 wherein said attributes are displayed so that said user can perceive said objects in real time in three dimensional space even if line of sight to said objects in three dimensional space is occluded;

and said user input means comprises data obtained through said sensor and selected from the group comprising eye orientation, head orientation, voice command, and push button.

8. The process of claim 5 wherein said attributes are displayed so that said user can perceive said objects in three dimensional space even if line of sight to said objects in three dimensional space is occluded.

9. The process of claim 1 wherein said at least one sensor comprises a plurality of sensors selected from the group comprising radar, orientation sensors, visible spectrum cameras, infrared cameras, microphones, transceivers, clocks, thumb position sensors, computer mouses, pointing sensors, global positioning system transponders, MRI, CAT scan, fuel sensors, speedometer, thermometer, depth sensor, pressure sensor, X-ray, sonar, and wind sensors.

10. The process of claim 1 wherein said at least one sensor comprises a plurality of sensors mounted on a platform selected from the group comprising a satellite, a vehicle operated by said user, a beacon, an air traffic control tower, a military control center, a display means worn by said user, and a vehicle not operated by said user.

11. The process of claim 1 wherein said database contains data that can be updated by means selected from the group comprising said at least one sensor, known data sources, neural network, fuzzy logic, time based decaying weights, assigned paths, official chart data, and plans.

12. A sensory aid having augmented reality display means, software, a database, and at least one sensor;

said software being connected to said database, said augmented reality display means, and said at least one sensor;

said software presenting on demand views to said augmented reality display means of structures hidden from a user of said sensory aid using data obtained from a source selected from the group comprising said database and said at least one sensor;

said software presenting on demand views to said augmented reality display means of physical properties of an object using data obtained from a source selected from the group comprising said database and said at least one sensor.

13. The sensory aid of claim 12 wherein said software presents on demand views to said augmented reality display means of optimal placement of parts to an object being assembled using data obtained from a source selected from the group comprising said database and said at least one sensor.

14. The sensory aid of claim 12 wherein said software presents on demand views to said augmented reality display means of optimal placement of holes being formed in a workpiece using data obtained from a source selected from the group comprising said database and said at least one sensor.

15. The sensory aid of claim 12 wherein said augmented reality display means comprises goggles worn by said user.

16. The sensory aid of claim 12 wherein said augmented reality display means comprises glasses worn by said user having an augmented see through display.

17. The sensory aid of claim 16 having earphones.