SYSTEM AND METHOD FOR MANAGING AND ANALYZING MULTIMEDIA INFORMATION

• US 20150168144A1
• Filed: 11/14/2014
• Published: 06/18/2015
• Est. Priority Date: 11/14/2013
• Status: Active Grant

• Current Assignee: KSI Data Sciences, LLC
• Original Assignee: KSI Data Sciences, LLC
• Inventors: Barton, Jason, Gaster, Jon
• Granted Patent: US 10,942,026 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G08B 13/19634 Electrical details of the system, e.g. component blocks for carrying out specific functions
• CPC Class Codes: G08B 13/19645 Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
• CPC Class Codes: G08B 13/1965 the vehicle being an aircraft
• CPC Class Codes: G08B 13/1966 Wireless systems, other than telephone systems, used to communicate with a camera
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04N 1/00204 with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

A UAV data processing and management system is provided including an encoder broadcaster and data manager which provides end users with a single interface for searching and sharing any video or imagery source, from any device with no client software required. Data inputs to the resource can include UAV video, photos, traffic cameras, fixed surveillance systems, iOS and Android device pictures, and other data (e.g., texts, emails) and inputs from all forms of social media, such as Twitter, Instagram, Facebook, etc. The cloud based manager is built with collaboration and sharing in mind while at the same time maintaining data privacy, security protection, chain-of-custody control and audit trail maintenance. Analytic tools are integrated accordingly as “plug-ins” or as a store of available app resources which are easily removed, added and customized based on user needs and system requirements and cost constraints.

Claims

1. An unmanned aerial vehicle data management system, comprising:

an unmanned aerial vehicle;

an unmanned aerial vehicle system ground station;

a signal encoder broadcaster;

a local cache which receives data from the encoder broadcaster for local storage;

a data manager located on the Internet cloud which receives live video from the signal encoder broadcaster and archival data from the local cache; and

a remote content delivery network for signal transmission to a computer browser and a least one mobile device wherein dynamic data streams originating from the UAV are managed and fused with imagery and data from other remote sensors for delivery to end users through the browser.

2. The unmanned aerial vehicle data management system of claim 1, wherein the encoder broadcaster includes a local data cache that stores live encoded data with affiliated selected analytics.

3. The unmanned aerial vehicle data management system of claim 1, further comprising a user authenticator enabling the encoder broadcaster to transmit live UAV video to and receive communications from authenticated users via the Internet.

4. The unmanned aerial vehicle data management system of claim 1, where users of the at least one mobile device can interact with UAV video directly from the Internet or from a mobile network connection.

5. The unmanned aerial vehicle data management system of claim 1, wherein the system provides active and live video from the signal encoder broadcaster to the system manager.

6. A data management system, comprising:

an integrated server located on the Internet cloud;

an archive memory connected to the integrated server for storing transport stream signals that are MISP compliant and are embedded with KLV metadata;

a local cache memory;

a local WiFi connection; and

an encoder broadcaster with multiple sensor inputs that transmits live encoded video to the local cache via the WiFi connection, transmits live videos to the integrated server, and streams high quality uploads to the archive memory.

7. The data management system of claim 6, further comprising a cellular link between the integrated server and the encoder broadcaster for transmitting and receiving encrypted data between the server and the encoder broadcaster.

8. The data management system of claim 6, wherein the integrated server serves as a platform for a sensor data manager in order to provide analytic functions, single-click uploads for users through a web based interface.

9. The data management system of claim 6, further comprising a local content delivery network which communicates with the integrated server through landlines or Internet networks.

10. The data management system of claim 9, wherein the local content delivery network further comprises workstations, servers and mobile units which can communicate with the integrated server.

11. A multi sensor data management system, comprising:

multiple sensor sources connected to a signal transport device;

a transmission connection from transport device to an internet based server;

a manager unit that allows different users to gain access to the multiple sensor data through the Internet cloud; and

an interface that provides data search and share for users to the multiple sensor data from any Internet or mobile network connected device.

12. The multi sensor data management system of claim 11, wherein the multiple sensor sources include UAV video, photos, traffic cameras, fixed surveillance cameras, iOS and Android photos, texts, emails and Twitter, Instagram and Facebook data.

13. The multi sensor data management system of claim 11, further comprising analytic tools which are provided as plug in modules or store-based apps to the manager unit.

14. The multi sensor data management system of claim 11, wherein the manager unit include a dynamic monitoring tool for applying territorially specific laws and rules to geo-spatially mapped sensor data in order to render certain data legally compliant when analyzed by the applied laws and rules.

15. The multi sensor data management system of claim 14, where said rules include local and national police evidence requirements.

16. The multi sensor data management system of claim 14, where said rules include privacy rules and regulations including HIPAA.

17. The multi sensor data management system of claim 11, further comprising an events manager that includes multiple collaboration areas, alert messaging, and mission specific indices.

18. The multi sensor data management system of claim 11, further comprising

a mapping unit that geo-spatially represents and coordinates data from the multiple sensor sources onto an online map in real time;

and

a timeline unit that integrates data from the mapped sensor sources onto a timeline display having coordinates tied to sensor type, sensor distance and sensor data time.

19. The multi sensor data management system of claim 18, further comprising an evidence locker unit which test and stores the timeline integrated data based upon a successful application of user specified rules to the data.

20. The multi sensor data management system of claim 19, further comprising an evidence mapping unit which redraws a map with a line connecting said geo-mapped data elements that are stored in the evidence locker in order to reconstruct a trail tied to multiple said sensor data.