IMAGE SURVEILLANCE/RETRIEVAL SYSTEM

• US 20070248244A1
• Filed: 10/05/2006
• Published: 10/25/2007
• Est. Priority Date: 04/06/2006
• Status: Active Grant

• Current Assignee: Mitsubishi Electric Corporation
• Original Assignee: Mitsubishi Electric Corporation
• Inventors: Sato, Kazuya, Haga, Tetsuji
• Granted Patent: US 7,627,199 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream

Abstract

An object processing unit divides each image frame of received image data into block areas, extracts an object from each image frame, and extracts, as metadata, the features of this object for each block area. A real-time detection processing unit compares the metadata extracted for each block area with a received real-time detection query, and detects an object which satisfies the real-time detection query. A post-retrieval processing unit compares the metadata for each block area stored in a metadata storage unit with a received post-retrieval query, and retrieves an object which satisfies the post-retrieval query.

Claims

1. An image surveillance/retrieval system comprising:

an image input unit for receiving image data;

an object processing unit for dividing each image frame of the image data into a plurality of block areas, for detecting each individual object from each image frame, for extracting, as one object, a series of appearances of each identical object in a plurality of image frames, and for extracting features of the object extracted as metadata for each of the plurality of block areas;

a metadata storage unit for storing the metadata obtained by said object processing for each of the plurality of block areas;

a query input unit for receiving a real-time detection query or a post-retrieval query;

a real-time detection processing unit for comparing the metadata for each of the plurality of block areas with the real-time detection query received by said query input unit, and for detecting an object which satisfies the real-time detection query;

a post-retrieval processing unit for comparing the metadata for each of the plurality of block areas which is stored in said metadata storage unit with the post-retrieval query received by said query input unit, and for retrieving an object which satisfies the post-retrieval query; and

a display unit for displaying either the object detected by said real-time detection processing unit or the object retrieved by said post-retrieval processing unit.

2. The image surveillance/retrieval system according to claim 1, wherein said object processing unit extracts, as the metadata for each of the plurality of block areas, one of a traveling direction in which the object has traveled, a distance traveled by the object, and a travel time required for the object to travel in each of the plurality of block areas.

3. The image surveillance/retrieval system according to claim 1, including a block shape determination processing unit for setting a size of each of the plurality of block areas into which each image frame of the image data is divided by said object processing unit.

4. The image surveillance/retrieval system according to claim 1, including a block shape determination processing unit for setting a size of each of the plurality of block areas into which each image frame of said image data is divided by said object processing unit based on average size or average movement of the object as measured by said object processing unit.

5. The image surveillance/retrieval system according to claim 1, including a block shape determination processing unit for adjusting size of each of the plurality of block areas into which each image frame of the image data is divided by said object processing unit based on size or movement of the object as measured by said object processing unit.

6. The image surveillance/retrieval system according to claim 1, including an image transformation processing unit for projective transformation of a specified screen area in the image data by said image input unit into a rectangular area, and transmitting this rectangular area to said object processing unit.

7. The image surveillance/retrieval system according to claim 1, including an image transformation processing unit for adjusting an angle between an object to be shot in a screen area and direction of an optical axis extending from a camera which is shooting the object for projective transformation of the screen area into a rectangular area.