Intelligent video network protocol

• US 9,021,006 B2
• Filed: 06/04/2008
• Issued: 04/28/2015
• Est. Priority Date: 03/28/2006
• Status: Active Grant

• Current Assignee: Motorola Solutions, Inc.
• Original Assignee: Avigilon Fortress Corporation
• Inventors: Myers, Gary, Cutting, Robert A., Martone, Andrew, Conger, David V., Morris, James, Aldrich, William, Mannebach, Michael C., Yen, Chung-Cheng, Borrebach, Nathan D., Hoskote, Satyajeet S., Lipton, Alan J., Shayne, Ethan
• Primary Examiner(s): LEE, BRYAN Y
• Application Number:
  US12/155,476
• Publication Number:
  US 20090158367A1
• Time in Patent Office: 2,519 Days
• Field of Search: 709/201
• US Class Current: 709/201
• CPC Class Codes: G06F 9/54 Interprogram communication
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2407 Monitoring of transmitted content, e.g. distribution time, number of downloads arrangements for monitoring programmes for broadcast or for distribution combined with broadcast H04H20/14
• CPC Class Codes: H04N 21/25816 involving client authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing

Abstract

Software capabilities of a video analytics device are obtained. The software of the video analytics device is configured. An output from the video analytics device is received. The output is sent to a user device.

Claims

1. A communication system comprising:

a device with video analytics capability;

an application running on a computer, the device and the application communicating with each other via a physical network, the application discovering video analytics devices, authenticating the discovered video analytics devices, and obtaining software capabilities of a video analytics device;

a communication layer independent of and disposed between the device and the application and having a video analytics communication protocol and an application program interface, the video analytics communication protocol including;

protocol data,

device configuration data comprising information about the video analytics supported by the device and including video analytics output formats,

channel configuration data comprising information about each video analytics channel on the device and including a list of video analytics channels and supported video analytics capabilities for each channel,

event output data,

user management data, and

video analytics metadata output data comprising metadata generated by the device and including target descriptions for targets detected and output mechanisms.

2. The communication system of claim 1, wherein the protocol data comprises information regarding the capabilities of the communication protocol including supported data formats, transports, and authentication mechanisms.

3. The communication system of claim 1, wherein the communication protocol further includes view management data.

4. The communication system of claim 3 wherein the view management data comprises a list of views for the device.

5. The communication system of claim 1, wherein the rule management data comprises information regarding rules for a channel.

6. The communication system of claim 1, wherein the event output data comprises an alert or a count.

7. The communication system of claim 1, wherein the communication protocol further includes user management data comprising authentication and authorization information for a user.

8. The communication system of claim 1, wherein the metadata output data comprises data regarding targets detected by the device.

9. The communication system of claim 1, wherein the physical network is one of socket-based or peripheral-based.

10. The communication system of claim 1, wherein the communications layer is one of HTTP, SIP, or SNMP.

11. The communication system of claim 1, wherein the API is one of XML, SOAP, JSON, or Binary.

12. A method for communication between a device with video analytics capability and an application running on a computer, the device and the application sending messages to each other via a physical network, the method comprising:

discovering video analytics devices;

authenticating the discovered video analytics devices;

obtaining software capabilities of a video analytics devices;

disposing a communication layer between the device and the application and having a video analytics protocol and an application program interface, the communication layer being independent of the physical network; and

sending the messages between the device and the application using the video analytics protocol, the messages including protocol data, device configuration data comprising information about the video analytics supported by the device and includes video analytics output formats, channel configuration data comprising information about each video analytics channel on the device including a list of video analytics channels and supported video analytics capabilities for each channel, rule management data, event output data, and video analytics metadata output data comprising metadata generated by the device and including target descriptions for targets detected and output mechanisms defined according to the communication protocol.

13. The communication method of claim 12, further comprising analyzing the metadata to determine events that occurred during post real-time analysis.

14. A method for communication in a video analytics system including a plurality of devices, the method comprising:

discovering video analytics devices;

authenticating the discovered video analytics devices;

obtaining software capabilities of a video analytics devices;

sending a message from a device to other devices in the system via a video analytics protocol independent of the system, the message including protocol data, device configuration data comprising information about the video analytics supported by the device, including video analytics output formats, channel configuration data comprising information about each video analytics channel on the device, including a list of video analytics channels and supported video analytics capabilities for each channel, rule management data, event output data, and video analytics metadata output data comprising metadata generated by the device and including object descriptions for objects detected and output mechanisms;

receiving at the device messages from other devices in the system via a video analytics protocol independent of the system, the received message including protocol data, device configuration data comprising information about the video analytics supported by the device, including video analytics output formats, channel configuration data comprising information about each video analytics channel on the device, including a list of video analytics channels and supported video analytics capabilities for each channel, rule management data, event output data, user management data, and video analytics metadata output data comprising metadata generated by the device and including object descriptions for objects detected and output mechanisms; and

setting up the system of devices based on the exchanged messages.

15. A non-transitory computer-readable medium comprising software that, when executed by a computer, causes the computer to perform a method comprising:

discovering video analytics devices;

authenticating the discovered video analytics devices;

obtaining software capabilities of a video analytics device including;

obtaining information regarding the protocol supported by the device;

obtaining information regarding the device configuration comprising information about the video analytics supported by the device, including video analytics output formats;

obtaining information regarding any channels of the device comprising information about each video analytics channel on the device, including a list of video analytics channels and supported video analytics capabilities for each channel;

obtaining information regarding views provided by the device; and

obtaining information regarding rules defined for the device;

receiving an output from the video analytics device, including

outputting information regarding events detected by the device;

outputting information regarding targets tracked by the device; and

outputting information used in frame analysis; and

sending the output to a user device,

wherein a communication layer is independent of and disposed between the devices and the computer and having a video analytics communication protocol and an application program interface, the video analytics communication protocol.

16. A system, comprising:

a plurality of video analytics devices which capture and manipulate video data;

a plurality of user devices;

an application running on a computer, the devices and the application communicating with each other via a physical network, the application discovering video analytics devices, authenticating the discovered video analytics devices, and obtaining software capabilities of a video analytics device; and

an interface which couples any one of the plurality of video analytics devices to any one of the plurality of user devices, the interface being independent of the user device and video analytics devices transmitting protocol data, device configuration data comprising information about the video analytics supported by the device, including video analytics output formats, channel configuration data comprising information about each video analytics channel on the device, including a list of video analytics channels and supported video analytics capabilities for each channel, rule management data, event output data, and metadata output data comprising metadata generated by the device and including object descriptions for objects detected and output mechanisms between any one of the plurality of video analytics devices to any one of the plurality of user devices.