Method for real-time correlation of streaming video to geolocation

• US 8,744,230 B2
• Filed: 08/13/2012
• Issued: 06/03/2014
• Est. Priority Date: 08/12/2011
• Status: Active Grant

• Current Assignee: BAE Systems Information and Electronic Systems Integration Incorporated (BAE Systems Plc)
• Original Assignee: BAE Systems Information and Electronic Systems Integration Incorporated (BAE Systems Plc)
• Inventors: Hovagim, Gregory R., Borden, Jeffrey M., Shaw, Garrett T., Brommer, Karl D.
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): MESA, JOSE M
• Application Number:
  US13/572,893
• Publication Number:
  US 20130039631A1
• Time in Patent Office: 659 Days
• Field of Search: 386/200, 386/227
• US Class Current: 386/200
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8541 involving branching, e.g. to different story endings
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus

Abstract

A real time streaming geolocation method includes recording data and linking it to specific coordinates. The data is selectively stored to a database using a specialized data filtering method, and a streaming video can be created from the stored data. The streaming video can be created in real time, creating a current video simulation of a specific environment. The method also allows for interactive addition, modification and deletion of data, such as points of interest, in the video stream.

Claims

1. A method for data recording and linking data to geolocation coordinates comprising:

recording a plurality of sensor data from a plurality of sensor positioned in a vehicle;

linking said sensor data to coordinates of a specific location;

selectively storing said sensor data in a database according to coordinates of said specific location, wherein selectively storing said sensor data includes a process of data filtering wherein said process of data filtering comprises of;

recording said sensor data to said database when no data exists for coordinates of said specific location;

generating an average image patch from video frames linked to coordinates of said specific location;

comparing said sensor data with said average image patch;

sorting said sensor data by GPS location received from a GPS receiver; and

storing said sensor data along with a time stamp and a flag for the specific location to said database when there is a difference between said sensor data and said average image patch greater than a specific threshold; and

generating a streaming video from said sensor data in response to queries to said database.

2. The method of claim 1, wherein the sensor data is recorded video.

3. The method of claim 1, wherein the specific location coordinates are GPS coordinates.

4. The method of claim 1, further comprising linking specific points of interest to the sensor data.

5. The method of claim 4, wherein a user can add, modify, and delete the points of interest with a user interface.

6. The method of claim 1 wherein generating a streaming video is completed in substantially real time.

7. The method of claim 1, wherein a plurality of sensors is selected from a group of motion detector, microphone, temperature sensors, chemical sensors, biological sensors and radiation sensors.

8. The method of claim 1, further comprising archiving said sensor data linked to coordinates of said specific location when the difference between said sensor data and said average image patch less than said specific threshold.

9. A system for data recording and linking data to geolocation coordinates comprising:

a plurality sensor for generating a plurality of sensor data, wherein said sensor data is linked to coordinates of a specific location;

a database for selectively storing said sensor data according to coordinates of said specific location;

a data management system for filtering said sensor data by utilizing a data filtering unit wherein said data filtering unit comprising;

a first recording unit for recording said sensor data to said database when no data exists for coordinates of said specific location;

an image generation unit for generating an average image patch from video frames linked to coordinates of said specific location;

a comparator for comparing said sensor data with an average image patch; and

a second recording unit for sorting the sensor data by GPS location received from a GPS receiver and recording said sensor data along with a time stamp and a flag for the specific location to said database when there is a difference between said sensor data and said average image patch greater than a specific threshold;

a user interface for displaying data from said data management system; and

a video generation unit for generating a streaming video from said sensor data in response to queries to said database.

10. The system of claim 9, wherein said sensor data is recorded video.

11. The system of claim 9, wherein coordinates of said specific location are GPS coordinates.

12. The system of claim 9, wherein specific points of interest is linked to said sensor data.

13. The systems of claim 9, wherein a user can add, modify, and delete points of interest by utilizing said user interface.

14. The system of claim 9, wherein said streaming video is generated and completed in substantially real time.

15. The system of claim 9, wherein said sensor data is archived and linked to coordinates of said specific location when difference between said sensor data and said average image patch is less than said specific threshold.

16. The system of claim 9, wherein said plurality of sensors is selected from a group of motion detector, microphone, temperature sensor, chemical sensor, biological sensor and radiation sensor.

17. The system of claim 9, wherein said streaming video is augmented with public domain video summarization software to automatically create searchable geolocation databases in the said data management system.