Method and system for visualization enhancement for situational awareness
First Claim
1. A program storage device readable by a computer machine, tangibly embodying program instructions executable by the computer machine to perform method steps for visualization enhancement for situational awareness, said method steps comprising:
- providing a graphical user interface enabling a user to interact with the software program running on the computer machine running;
the computer machine providing a database of vehicle mission recordings;
selecting one or more mission recordings;
displaying a GUI window comprising;
a navigation map associated with the mission recording wherein,the navigation map displays the traveled path traveled of an Unmanned Ground Vehicle (UGV) in first color, if availablethe current position of the vehicle is indicated by a triangle in a second color,the front of the vehicle is designated by the point of the triangle,the field of view (FOV) of the camera is also indicated on the triangle by the two adjacent lines, shown in a third color when;
a status display; and
taking one or more camera images from the mission recording;
overlaying on the top of the image display is the cardinal direction of the displayed camera image;
changing the direction with camera panning within the still frame image;
progressing through the timeline of a mission using a horizontal scroll bar slider wherein each slider increment is equivalent to moving one second in time;
allowing a user to jump to any point from the beginning to the end of the mission;
quickly incrementing or decrementing of the slider;
providing ‘
Front’ and
‘
Back’
buttons next to the scroll bar;
allowing the user to toggle between the front camera and the rear camera of the vehicle;
providing a set of playback controls that allow the user to play, pause, rewind, and fast forward through the images,repeatedly pressing the rewind or fast-forward buttons increases the speed;
tagging events in the mission recoding;
loading multiple mission files;
displaying each loaded mission file on separate timelines;
each timeline is zoom-able using buttons at the bottom of the screen;
the user can drag on the timeline to display different portions of the timeline;
below the timelines, an overview bar displays, as denoted by a first colored line, what portion of the overall timeline is being displayed and the current image location, a denoted by second colored line or bar;
the second colored line or bar can be dragged to quickly access other portions of the timelines;
events are noted by a colored line or bar on the timeline;
each event can be selected and the comment from that event is displayed beneath the timelines;
the (x,y) location of that comment is plotted as a colored circle on the map;
the current image position is represented by a colored line on the timelines; and
dragging the current image position colored line to move forward or backward in the images.
4 Assignments
0 Petitions
Accused Products
Abstract
An after-action, mission review tool that displays camera and navigation sensor data allowing a user to pan, tilt, and zoom through the images from front and back cameras on an vehicle, while simultaneously viewing time/date information, along with any available navigation information such as the latitude and longitude of the vehicle at that time instance. Also displayed is a visual representation of the path the vehicle traversed; when the user clicks on the path, the image is automatically changed to the image corresponding to that position. If aerial images of the area are available, the path can be plotted on the geo-referenced image.
-
Citations
26 Claims
-
1. A program storage device readable by a computer machine, tangibly embodying program instructions executable by the computer machine to perform method steps for visualization enhancement for situational awareness, said method steps comprising:
-
providing a graphical user interface enabling a user to interact with the software program running on the computer machine running; the computer machine providing a database of vehicle mission recordings; selecting one or more mission recordings; displaying a GUI window comprising; a navigation map associated with the mission recording wherein, the navigation map displays the traveled path traveled of an Unmanned Ground Vehicle (UGV) in first color, if available the current position of the vehicle is indicated by a triangle in a second color, the front of the vehicle is designated by the point of the triangle, the field of view (FOV) of the camera is also indicated on the triangle by the two adjacent lines, shown in a third color when; a status display; and taking one or more camera images from the mission recording; overlaying on the top of the image display is the cardinal direction of the displayed camera image; changing the direction with camera panning within the still frame image; progressing through the timeline of a mission using a horizontal scroll bar slider wherein each slider increment is equivalent to moving one second in time; allowing a user to jump to any point from the beginning to the end of the mission; quickly incrementing or decrementing of the slider; providing ‘
Front’ and
‘
Back’
buttons next to the scroll bar;allowing the user to toggle between the front camera and the rear camera of the vehicle; providing a set of playback controls that allow the user to play, pause, rewind, and fast forward through the images, repeatedly pressing the rewind or fast-forward buttons increases the speed; tagging events in the mission recoding; loading multiple mission files; displaying each loaded mission file on separate timelines; each timeline is zoom-able using buttons at the bottom of the screen; the user can drag on the timeline to display different portions of the timeline; below the timelines, an overview bar displays, as denoted by a first colored line, what portion of the overall timeline is being displayed and the current image location, a denoted by second colored line or bar; the second colored line or bar can be dragged to quickly access other portions of the timelines; events are noted by a colored line or bar on the timeline; each event can be selected and the comment from that event is displayed beneath the timelines; the (x,y) location of that comment is plotted as a colored circle on the map; the current image position is represented by a colored line on the timelines; and dragging the current image position colored line to move forward or backward in the images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A program storage device readable by a computer machine, tangibly embodying program instructions executable by the computer machine to perform method steps for visualization enhancement for situational awareness, said method steps comprising:
-
providing a graphical user interface enabling a user to interact with the software program running on the computer machine running; the computer machine providing a database of vehicle mission recordings; selecting one or more mission recordings; displaying a GUI window comprising; a navigation map associated with the mission recording wherein, the navigation map displays the traveled path traveled of an Unmanned Ground Vehicle (UGV) in first color, if available the current position of the vehicle is indicated by a triangle in a second Color, the front of the vehicle is designated by the point of the triangle, the field of view (FOV) of the camera is also indicated on the triangle by the two adjacent lines, shown in a third color when; a status display; and taking one or more camera images from the mission recording; overlaying on the top of the image display is the cardinal direction of the displayed camera image; changing the direction with camera panning within the still frame image; progressing through the timeline of a mission using a horizontal scroll bar slider wherein each slider increment is equivalent to moving one second in time allowing a user to jump to any point from the beginning to the end of the mission; quickly incrementing or decrementing of the slider; providing ‘
Front’ and
‘
Back’
buttons next to the scroll bar;allowing the user to toggle between the front camera and the rear camera of the vehicle; providing a set of playback controls that allow the user to play, pause, rewind, and fast forward through the images, repeatedly pressing the rewind or fast-forward buttons increases the speed; adding one or more tags to a mission; annotating the image data with one or more tags; searching one or more missions by the tag, providing a map server; providing a map user interface; providing controls so that the map display can be zoomed and panned using mouse actions; selecting the time ranges to search using calendar inputs placed below the map display; displaying status information to the right of the date/time selection; providing a timeline featured at the bottom of the UI map display; conducting a search, when a search is conducted, events will appear on the timeline; these events can be selected, and pertinent information is displayed above the timeline; querying a specific location; dragging a bounding box over the map; the resulting navigation paths will be drawn on the display map; search results summarizes summarizing the collections are found in the bounding box; colored lines on the timeline represent the start time of each collection in the search results, where each collection is a ten minute segment of data; and when an event on the timeline is selected, the collection information is displayed in the search results section. - View Dependent Claims (24, 25, 26)
-
Specification