PERFORMING REAL-TIME ANALYTICS USING A NETWORK PROCESSING SOLUTION ABLE TO DIRECTLY INGEST IP CAMERA VIDEO STREAMS

• US 20100020172A1
• Filed: 07/25/2008
• Published: 01/28/2010
• Est. Priority Date: 07/25/2008
• Status: Active Grant

• Current Assignee: AirBNB Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Mariadoss, Pandian
• Granted Patent: US 8,325,228 B2
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19669 Event triggers storage or change of storage policy
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/443 OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

The present invention discloses a solution for an intelligent video surveillance (IVS) system able to perform real-time analytics on internet protocol (IP) video streams which are directly ingested by the IVS system. An internet protocol camera can be identified and connected to the intelligent video surveillance system which lacks an intermediate video management component. The raw video stream can be received directly from the camera in the form of a real-time video stream such as real-time streaming protocol (RTSP). One or more real-time analytics can be performed on said video stream based on one or more system criteria and user established criteria. When an incident event is detected one or more programmatic actions can be performed in response to analytics enacted.

Claims

1. A system for performing video analytics comprising:

an intelligent video surveillance system configured to directly ingest video streams from at least one network connected IP camera, wherein said intelligent video surveillance system is further configured to perform real-time video analytics on the directly ingested video stream.

2. The system of claim 1, further comprising:

a filter specific to the network connected IP camera that is an application programming interface (API) configured to decode the video steam from the network connected IP camera before conveying the decoding video stream to the intelligent video surveillance system.

3. The system of claim 1, wherein the real-time video analytics comprise at least one of face recognition, object tracking, and motion detection.

4. The system of claim 1, further comprising:

a plurality of camera modules stored on a storage medium, wherein each camera model comprises programmatic instructions permitting the intelligent video surveillance system to interface with a vender specific IP camera.

5. The system of claim 1, wherein the intelligent video surveillance system is configured to convey commands to the at least one network connected IP camera, where the commands result in an IP camera adjustment, which affects an aspect of the video stream captured by the IP camera.

6. The system of claim 1, wherein the intelligent video surveillance system provides at least one Web service that provides the real-time video analytics on the directed ingested video stream.

7. The system of claim 1, wherein the at least one network connected IP camera comprises a plurality of network connected IP cameras geographically proximate to each other, wherein the intelligent video surveillance system is configured to perform the real time analytics on multiple video streams from different ones of the plurality of network connected IP cameras.

8. The system of claim 1, further comprising:

a software engine configured to perform at least one programmatic action responsive to results produced by an analytics engine that performs the real-time analytics, wherein at least one action that the software engine is configured to perform is a notification action that conveys a notification to a previously designated user when a previously established condition is detected by the analytics engine.

9. The system of claim 8, further comprising:

a storage media configured to store profiles for entities responsible for a geographic region, wherein images of the geographic region are captured within the directly ingested video stream, wherein entity specific configuration settings are included in the stored profiles, wherein the entity specific configuration settings specify conditions to be detected by the analytics engine and a programmatic actions to be automatically performed when the specified conditions are detected, wherein each network connected IP camera is indexed within a database system against a stored profile.

10. A method for intelligent video surveillance comprising:

identifying a raw, real-time video stream from a remotely located internet protocol camera connected to a network;

processing the raw real-time video stream using an application program interface;

conveying the processed video stream to an analytics engine; and

performing at least one video analytics programmatic action against the processed video stream.

11. The method of claim 10, wherein the analytics engine is a component of an intelligent video surveillance system that is unable to process the raw real-time video stream in absence of the application program interface.

12. The method of claim 10, wherein the application program interface is a filter specific to the internet protocol camera.

13. The method of claim 10, wherein the video analytics programmatic action comprises at least one of face recognition, object tracking, and motion detection.

14. The method of claim 10, further comprising:

comparing a metric extracted from the processed video stream responsive to the video analytics programmatic action against at least one previously established condition;

when comparing results match the metrics and the previously established condition, automatically initiating at least one resulting programmatic action.

15. The method of claim 14, wherein said programmatic action is at least one of a notification, an alert, and an action altering the state of a localized entity.

16. The method of claim 14, wherein the at least one previously established condition and the at least one resulting programmatic action are user configurable by an authorized entity, wherein said authorized entity is an entity having responsibility over a region captured within the processed video stream.

17. The method of claim 10, further comprising:

identifying a different raw, real time video steam from a different remotely located internet protocol camera connected to the network;

processing the different raw, real-time video stream using the application program interface;

conveying the different processed video stream to the analytics engine; and

performing at least one video analytics programmatic action against the processed video stream and the different processed video stream.

18. A computer program product for intelligent video surveillance comprising:

a computer usable medium having computer usable program code embodied therewith, the computer usable program code comprising;

computer usable program code configured to identify a raw, real-time video stream from a remotely located internet protocol camera connected to a network;

computer usable program code configured to identify process the raw real-time video stream using an application program interface;

computer usable program code configured to identify convey the processed video stream to an analytics engine; and

computer usable program code configured to identify perform at least one video analytics programmatic action against the processed video stream.

19. The computer program product of claim 18, wherein the analytics engine is a component of an intelligent video surveillance system that is unable to process the raw real-time video stream in absence of the application program interface.

20. The computer program product of claim 18, wherein the application program interface is a filter specific to the internet protocol camera.