Video surveillance system and method using IP-based networks

• US 9,277,165 B2
• Filed: 01/08/2009
• Issued: 03/01/2016
• Est. Priority Date: 01/17/2008
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Hiroike, Atsushi, Kagehiro, Tatsuhiko, Akira, Naoto, Toumura, Kunihiko, Urano, Takehiro
• Primary Examiner(s): RUBIN, BLAKE J
• Application Number:
  US12/350,512
• Publication Number:
  US 20090185784A1
• Time in Patent Office: 2,609 Days
• Field of Search: 348/143
• US Class Current: 1/1
• CPC Class Codes: G06F 16/784 the detected or recognised objects being people
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19663 Surveillance related processing done local to the camera
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/91 Television signal processing therefor

Abstract

A technique capable of preventing an increase in the load of a system and a IP-based network that perform both a process of transmitting information in real time and a process of storing and searching history information and of improving the scalability of the system. A video surveillance system includes: plural cameras that capture images; a monitoring apparatus that displays the images captured by the cameras; an information generating apparatus that generates information for searching the images captured by the cameras; and a search apparatus that searches the images captured by the cameras. The information generating apparatus acquires the images captured by the cameras, generates retrieval data from the acquired images, and transmits the generated retrieval data to the search apparatus. The search apparatus stores the retrieval data received from the information generating apparatus in a storage device, and notifies the monitoring apparatus that the retrieval data has been stored.

Claims

1. A video surveillance system comprising:

a plurality of cameras that capture images;

a display apparatus that displays the images captured by the cameras;

an information generating apparatus that generates information for searching the images captured by the cameras;

a search apparatus that searches the images captured by the cameras; and

an image storage apparatus that stores the images captured by the cameras,

wherein the information generating apparatus acquires the images captured by the cameras, generates retrieval data from the acquired images, and when an event is detected, transmits the generated retrieval data to the search apparatus,

wherein image features are used as the retrieval data,

wherein the search apparatus stores the retrieval data received from the information generating apparatus in a storage device, searches the retrieval data of the acquired images in the image storage apparatus, and transmits, to the display apparatus, the stored retrieval data, a registration event notice indicating that the retrieval data has been registered together with an identifier of the retrieval data registered, and results of searching the stored retrieval data,

wherein the display apparatus receives the retrieval data and the identifier of the retrieval data registered, determines whether an image related to the retrieval data is required based on the retrieval data received from the search apparatus, and transmits an image transmission request to the image storage apparatus to transmit the image related to the retrieval data when determining that the image related to the retrieval data is required,

wherein the image storage apparatus transmits the requested image data to the display apparatus, which is a request source, in response to the image transmission request from the display apparatus, and

wherein the display apparatus displays the image data acquired from the image storage apparatus.

2. The video surveillance system according to claim 1,

wherein the image storage apparatus requests the information generating apparatus to transmit the images captured by the cameras in a predetermined timing, and

wherein the information generating apparatus transmits the images captured by the cameras in response to the image transmission request from the image storage apparatus.

3. The video surveillance system according to claim 2,

wherein the image storage apparatus adjusts the time interval of the images acquired from the information generating apparatus based on information included in the images acquired from the information generating apparatus, and stores the acquired images in a storage device.

4. The video surveillance system according to claim 1,

wherein the information generating apparatus detects a motion component from the image captured by the camera, and

wherein, when no motion component is detected, the information generating apparatus does not transmit the retrieval data to the search apparatus.

5. The video surveillance system according to claim 1,

wherein the information generating apparatus detects a face region from the image captured by the camera, and

wherein, when no face region is detected, the information generating apparatus does not transmit the retrieval data to the search apparatus.

6. The video surveillance system according to claim 5,

wherein the information generating apparatus detects the face region from the image captured by the camera and extracts an image feature of the detected face region,

wherein the information generating apparatus detects a moving object region from the image captured by the camera, and extracts an image feature of the detected moving object region, and

wherein the information generating apparatus uses the extracted image features as the retrieval data.

7. The video surveillance system according to claim 6,

wherein, when a motion component is detected from the image captured by the camera, the information generating apparatus detects the face region and the moving object region, and

wherein, when the motion component is detected, but neither the face region nor the moving object region is detected, the information generating apparatus does not transmit the retrieval data to the search apparatus.

8. The video surveillance system according to claim 1,

wherein the information generating apparatus is connected to some of the plurality of cameras, and generates information for searching the images captured by the connected cameras.

9. The video surveillance system according to claim 1,

wherein the information generating apparatus is formed integrally with the cameras, and generates information for searching the images captured by the integrated cameras.

10. A video data management method in a video surveillance system including a plurality of cameras that capture images, a search apparatus that searches the images captured by the cameras, an information generating apparatus that generates information for searching the images captured by the cameras, an image storage apparatus that stores the images captured by the cameras, and a display apparatus that displays the images captured by the cameras, the method comprising:

requesting, by the image storage apparatus, the information generating apparatus to transmit the images captured by the cameras in a predetermined timing;

transmitting, by the information generating apparatus the images captured by the cameras in response to the image transmission request from the image storage apparatus;

acquiring, by the information generating apparatus, the images captured by the cameras, generating retrieval data from the acquired images, and when an event is detected, transmitting the generated retrieval data to the search apparatus,

wherein image features are used as the retrieval data;

storing, by the search apparatus, the retrieval data received from the information generating apparatus, searching the retrieval data of the acquired images in the image storage apparatus, and transmitting, to the display apparatus, the stored retrieval data, a registration event notice indicating that the retrieval data has been registered together with an identifier of the retrieval data registered, and results of searching the stored retrieval data;

receiving, by the display apparatus, the retrieval data and the identifier of the retrieval data registered;

determining, by the display apparatus, whether an image related to the retrieval data is required based on the retrieval data received from the search apparatus, and transmitting an image transmission request to the image storage apparatus to transmit the image related to the retrieval data when determining that the image related to the retrieval data is required;

transmitting, by the image storage apparatus, the requested image data to the display apparatus, which is a request source, in response to the image transmission request from the display apparatus; and

displaying, by the display apparatus, the image data acquired from the image storage apparatus.