AUGMENTED REALITY SYSTEM FOR IDENTIFYING FORCE CAPABILITY AND OCCLUDED TERRAIN

• US 20150054826A1
• Filed: 09/08/2014
• Published: 02/26/2015
• Est. Priority Date: 03/19/2009
• Status: Abandoned Application

• Current Assignee: Real Time Companies, Llc
• Original Assignee: Real Time Companies, Llc
• Inventors: Varga, Kenneth
• Application Number:
  US14/480,301
• Publication Number:
  US 20150054826A1
• Time in Patent Office: Days
• US Class Current: 345/421
• CPC Class Codes: F41G 3/04 for dispersing fire from a battery ; for controlling spread of shots; for coordinating fire from spaced weapons
• CPC Class Codes: F41G 9/00 Systems for controlling missiles or projectiles, not provided for elsewhere
• CPC Class Codes: G01S 13/86 Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G06T 15/40 Hidden part removal
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G09B 9/003 for military purposes and tactics
• CPC Class Codes: G09B 9/54 Simulation of radar G09B9/40 takes precedence
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 2013/0074 Stereoscopic image analysis

Abstract

An occlusion or unknown space volume confidence determination and planning system using databases, position, and shared real-time data to determine unknown regions allowing planning and coordination of pathways through space to minimize risk is disclosed. Data from a plurality of cameras, or other sensor devices can be shared and routed between units of the system. Hidden surface determination, also known as hidden surface removal (HSR), occlusion culling (OC) or visible surface determination (VSD), can be achieved by identifying obstructions from multiple sensor measurements and incorporating relative position with depth between sensors to identify occlusion structures. Weapons ranges, and orientations are sensed, calculated, shared, and can be displayed in real-time. Data confidence levels can be highlighted from time, and frequency of data. The real-time data can be displayed stereographically for and highlighted on a display.

Claims

1. A method for identifying an unknown object in a space comprising:

receiving, by one or more computing devices, a plurality of data feeds from a plurality of plurality of sensors, the plurality of data feeds capturing data corresponding to at least one object obstructed from view in a first three-dimensional stereographic space displayed at an interface;

selecting, by the one or more computing devices, respective data feeds from the plurality of data feeds; and

generating, by the one or more computing devices, a second three-dimensional stereographic space for display at the interface, wherein the second three-dimensional stereographic space includes a rendering of the at least one object, portions of the rendering based on the respective data feeds.

2. The method of claim 1, wherein the three-dimensional stereographic space corresponds to a real-world environment, the method further comprising:

determining an orientation of the interface displaying the first three-dimensional stereographic space, the orientation defining a point-of-view of a user interacting with the interface, and

wherein the second three-dimensional stereographic interface is generated based on the orientation.

3. The method of claim 1, wherein the real-world environment is mountainous terrain, and wherein the interface is a head-mountable device.

4. The method of claim 1, further comprising weighting each data feed of the plurality of data feeds based on a weighting threshold quantifying the accuracy of respective data feed at certain point in time.

5. The method of claim 3, wherein selecting respective data feeds from the plurality of data feeds comprises identifying the respective data feeds with a particular weighting that satisfy a weight threshold.

6. The method of claim 2, further comprising:

providing for display at the interface, geographic location information corresponding to the at least one object, the geographic location information uniquely identifying the at least one object from the perspective of the point-of-view of the user.

7. The method of claim 1, wherein the second three-dimensional stereographic space is generated in real-time.

8. The method of claim 1, wherein the respective data feeds includes at least two data feeds, the further comprising:

processing the at least two data feeds to generate enhanced data including a specific geographic location corresponding to the at least one object and an identification of the at least one object; and

wherein the rendering of the at least one object is also based on the enhanced data.

9. The method of claim 1, wherein the plurality of data feeds are at least one of a global positioning data feed, a radio data feed, a video data feed, an early warning and control system data feed, and an audio data feed providing at least one of tactical data, three-dimensional environmental data, three-dimensional weather data, or three-dimensional terrain data corresponding to the at least one object.

10. The method of claim 1, further comprising providing the second three-dimensional stereographic to an extra-sensory perception sharing system located near the interface.

11. A system for identifying an unknown object in a space comprising:

at least one computing device to;

receive a plurality of data feeds from a plurality of plurality of sensors,

the plurality of data feeds capturing data corresponding to at least one object obstructed from view in a first three-dimensional stereographic space displayed at an interface;

select respective data feeds from the plurality of data feeds; and

generate a second three-dimensional stereographic space for display at the interface, wherein the second three-dimensional stereographic space includes a rendering of the at least one object, portions of the rendering of the at least one object based on the respective data feeds.

12. The system of claim 11, wherein the three-dimensional stereographic space corresponds to a real-world environment, and wherein the at least one computing device is further configured to:

determining an orientation of the interface displaying the first three-dimensional stereographic space, the orientation defining a point-of-view of a user interacting with the interface,

wherein the second three-dimensional stereographic interface is generated according to the orientation.

13. The system of claim 11, further comprising weighting each data feed of the plurality of data feeds based on a weighting threshold quantifying the accuracy of respective data feed at certain point in time.

14. The system of claim 13, wherein selecting respective data feeds from the plurality of data feeds comprises identifying the respective data feeds with a particular weighting that satisfy the weight threshold.

15. The system of claim 11, further comprising providing for display at the interface, geographic location information corresponding to the at least one object, the geographic location information uniquely identifying the at least one object from the perspective of the point-of-view of the user.

16. The system of claim 11, wherein the second three-dimensional stereographic space is generated in real-time.

17. The system of claim 11, wherein the plurality of data feeds are at least one of a global positioning data feed, a radio data feed, a video data feed, an early warning and control system data feed, and an audio data feed providing at least one of tactical data, three-dimensional environmental data, three-dimensional weather data, or three-dimensional terrain data corresponding to the at least one object.

18. The system of claim 11, wherein the respective data feeds includes at least two data feeds, and wherein the at least one computing device is further configured to:

process the at least two data feeds to generate enhanced data including a specific geographic location corresponding to the at least one object and an identification of the at least one object, wherein the rendering of the at least one object is based on the enhanced data.

19. The system of claim 12, wherein the interface is a head-mountable device comprising:

a display surface for displaying the first three-dimensional stereographic space and the second three-dimensional stereographic space;

at least one sensor positioned to optically track a direction of at least one eye of a user interacting with the interface;

at least one head orientation sensor to track a head movement of the user; and

wherein the direction and head movement of the user are processed by the at least one processor to determine the orientation of the user;

20. A system for identifying an unknown object in a space comprising:

a head-mountable device comprising a display surface, the head-mountable device in operable communication with at least one processor, the at least one processor to;

receive a plurality of data feeds from a plurality of plurality of sensors, the plurality of data feeds capturing data corresponding to at least one object obstructed from view in a first three-dimensional stereographic space displayed at the display surface;

automatically select respective data feeds from the plurality of data feeds; and

generate a second three-dimensional stereographic space for display at the display surface, wherein the second three-dimensional stereographic space includes a rendering of the at least one object, portions of the rendering of the at least one object based on the respective data feeds.