Augmented reality situational awareness system and method
First Claim
1. A method of using an augmented reality navigation system on a moving transportation platform selected from the group of transportation platforms consisting of a water transportation device such as a ship, a land transportation device such as a motor vehicle, and an air transportation device such as an airplane, to prioritize and assess navigation data, comprising:
- obtaining navigation information relating to the transportation platform;
providing a display unit that provides the user with a view of the real world;
creating a virtual imagery graphical overlay of relevant navigation information corresponding to the user'"'"'s field of view, the graphical overlay created using graphics technology that reduces cognitive load, including using color schemes as a way of assisting the user in prioritizing the information on the display unit, and presenting data using a predictor display which displays to the user where the transportation platform will be in the near future; and
displaying the graphical overlay in the display unit, so that the user sees an augmented reality view comprising both the real world and the graphical overlay.
1 Assignment
0 Petitions
Accused Products
Abstract
Method and apparatus are presented for prioritizing and assessing navigation data using an Augmented Reality navigation aid. Navigators are often placed in treacherous, unfamiliar, or low-visibility situations. An augmented reality navigation aid is used to overlay relevant computer-generated images, which are anchored to real-world locations of hazards, onto one or more users'"'"' field of view. Areas of safe passage for transportation platforms such as ships, land vehicles, and aircraft can be displayed via computer-generated imagery or inferred from various attributes of the computer-generated display. The invention is applicable to waterway navigation, land navigation, and to aircraft navigation (for aircraft approaching runways or terrain in low visibility situations). A waterway embodiment of the invention is called WARN™, or Waterway Augmented Reality Navigation™.
A method is presented for visualization of hazards which pose a serious threat to those in the immediate vicinity. Such hazards include, but are not limited to, fire, smoke, radiation, and invisible gasses. The method utilizes augmented reality, which is defined as the mixing of real world imagery with computer-generated graphical elements.
Computer-generated three-dimensional representations of hazards can be used in training and operations of emergency first responders and others. The representations can be used to show the locations and actions of a variety of dangers, real or computer-generated, perceived or not perceived, in training or operations settings. The representations, which may be graphic, iconic, or textual, are overlaid onto a view of the user'"'"'s real world, thus providing a reality augmented with computer-generated hazards. A user can then implement procedures (training and operational) appropriate to the hazard at hand.
A method is presented which uses Augmented Reality for visualization of text and other messages sent to an EFR by an incident commander. The messages are transmitted by the incident commander via a computer at the scene to an EFR/trainee in an operational or training scenario. Messages to an EFR/trainee, including (but not limited to) iconic representation of hazards, victims, structural data, environmental conditions, and exit directions/locations, are superimposed right onto an EFR/trainee'"'"'s view of the real emergency/fire and structural surroundings. The primary intended applications are for improved safety for the EFR, and improved EFR-incident commander communications both on-scene and in training scenarios.
281 Citations
20 Claims
-
1. A method of using an augmented reality navigation system on a moving transportation platform selected from the group of transportation platforms consisting of a water transportation device such as a ship, a land transportation device such as a motor vehicle, and an air transportation device such as an airplane, to prioritize and assess navigation data, comprising:
-
obtaining navigation information relating to the transportation platform;
providing a display unit that provides the user with a view of the real world;
creating a virtual imagery graphical overlay of relevant navigation information corresponding to the user'"'"'s field of view, the graphical overlay created using graphics technology that reduces cognitive load, including using color schemes as a way of assisting the user in prioritizing the information on the display unit, and presenting data using a predictor display which displays to the user where the transportation platform will be in the near future; and
displaying the graphical overlay in the display unit, so that the user sees an augmented reality view comprising both the real world and the graphical overlay. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A method of augmented reality visualization of hazards, comprising:
-
providing a display unit for the user;
providing motion tracking hardware;
using the motion tracking hardware to determine the location and direction of the viewpoint to which the computer-generated three-dimensional graphical elements are being rendered;
providing an image or view of the real world;
using a computer to generate three-dimensional graphical elements as representations of hazards;
rendering the computer-generated graphical elements to correspond to the user'"'"'s viewpoint;
creating for the user a mixed view comprised of an actual view of the real world as it appears in front of the user, where graphical elements can be placed anywhere in the real world and remain anchored to that place in the real world regardless of the direction in which the user is looking, wherein the rendered graphical elements are superimposed on the actual view, to accomplish an augmented reality view of representations of hazards in the real world; and
presenting the augmented reality view, via the display unit, to the user. - View Dependent Claims (15, 16, 17, 18, 19)
-
-
20. A method of accomplishing an augmented reality hazard visualization system for a user, comprising:
-
providing a display unit;
providing the user with a hazardous phenomena cleanup device;
providing motion tracking hardware, and attaching it to both the head-worn display unit and the hazardous phenomena cleanup device;
using the motion tracking hardware that is attached to the head worn unit and to determine the location and direction of the viewpoint of the head-worn display unit;
using the motion tracking hardware that is attached to the hazardous phenomena cleanup device to determine the location and direction of the aimpoint of the hazardous phenomena cleanup device;
determining the operating state of the hazardous phenomena cleanup device;
using a computer to generate graphical representations comprising simulated potentially hazardous phenomena, and simulated application of hazardous phenomena cleanup agent, showing the cleanup agent itself emanating directly from the hazardous phenomena cleanup device, and showing the interaction of the cleanup agent with the hazardous phenomena;
rendering the generated graphical elements to correspond to the user'"'"'s viewpoint; and
creating for the user a mixed view comprised of an actual view of the real world as it appears in front of the user, where graphical elements can be placed any place in the real world and remain anchored to that place in the real world regardless of the direction in which the user is looking, wherein the rendered graphical elements are superimposed on the actual view, to accomplish an augmented reality view of potentially hazardous phenomena in the real world, the application of cleanup agent to the hazardous phenomena, and the effect of cleanup agent on the hazardous phenomena.
-
Specification