Image processing apparatus, image processing system, and filter setting method

• US 8,797,403 B2
• Filed: 06/29/2007
• Issued: 08/05/2014
• Est. Priority Date: 06/30/2006
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Suzuki, Masafumi, Tsukuda, Kazuma, Yanai, Shin, Ohara, Isao
• Primary Examiner(s): Donabed, Ninos
• Application Number:
  US11/823,875
• Publication Number:
  US 20080018737A1
• Time in Patent Office: 2,594 Days
• Field of Search: None
• US Class Current: 348/143
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 16/735 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/322 used signal is digitally coded

Abstract

Disclosed herein is an image processing apparatus including an image data acquisition section, a metadata acquisition section, a display section, a filter setting section, and a combination setting section. The image data acquisition section is configured to acquire image data from a camera. The metadata acquisition section is configured to acquire, from the camera, metadata representing information concerning an object of surveillance. The display section is configured to display a setting screen usable for setting a plurality of filters. The filter setting section is configured to perform filter setting using the information of the metadata. The combination setting section is configured to set a combination of the plurality of filters. The filter setting section and the combination setting section are provided on the same setting screen.

Claims

1. An image processing apparatus used in a surveillance system, the apparatus comprising:

a control device configured to acquire image data from a camera;

acquire metadata representing information concerning an object of surveillance;

control a display to display a setting screen usable for setting a plurality of filters;

perform filter setting using the information of the metadata; and

set a combination of the plurality of filters,

wherein said filter setting and setting of said combination of the plurality of filters are provided on the same setting screen,

wherein said control device is configured to select a type of the combination of the plurality of filters being provided in the setting screen, and wherein a set combination of the plurality of filters is displayed in the setting screen with a plurality of filter types that can be set for each of the filters of the set combination,

wherein a filter is used for detecting an event in a surveillance area in an image corresponding to the acquired image data, and

wherein options of the type of the combination of the plurality of filters include a first mode and a second mode of the control device, in which;

the first mode is a mode in which an alarm information is output each time when conditions of at least one of the plurality of filters in the combination is satisfied with situations based on the metadata, and

the second mode is a mode in which an alarm trigger is output when the conditions of all filters in the combination are satisfied with situations based on the metadata.

2. The image processing apparatus according to claim 1, wherein said control device is configured to specify whether or not each of the plurality of filters is used, specifying of whether or not each of the plurality of filters is used being provided in the setting screen.

3. The image processing apparatus according to claim 1, wherein said control device performs the filter setting by drawing a figure on a screen provided at a part of the setting screen and showing the image data acquired from the camera.

4. The image processing apparatus according to claim 1, wherein a predetermined action is performed based on the alarm information.

5. The image processing apparatus according to claim 1, wherein a predetermined action is performed based on continuous time of occurring of the alarm information.

6. The image processing apparatus according to claim 1, wherein a predetermined action is performed based on generation frequency of the alarm information in a predetermined period.

7. An image processing system used in a surveillance system, the image processing system comprising:

a camera configured to generate image data of an image; and

an image processing apparatus including

a control device configured to

acquire the image data from said camera,

acquire metadata representing information concerning an object of surveillance,

control a display to display a setting screen usable for setting a plurality of filters,

perform filter setting using the information of the metadata, and

set a combination of the plurality of filters,

wherein the filter setting and setting of the combination of the plurality of filters are provided on the same setting screen,

wherein said control device is configured to select a type of the combination of the plurality of filters being provided in the setting screen, and wherein a set combination of the plurality of filters is displayed in the setting screen with a plurality of filter types that can be set for each of the filters of the set combination,

wherein a filter is used for detecting an event in a surveillance area in an image corresponding to the acquired image data, and

wherein options of the type of the combination of the plurality of filters include a first mode and a second mode of the control device, in which;

the first mode is a mode in which an alarm information is output each time when conditions of at least one of the plurality of filters in the combination is satisfied with situations based on the metadata, and

the second mode is a mode in which an alarm trigger is output when the conditions of all filters in the combination are satisfied with situations based on the metadata.

8. The image processing system according to claim 7, wherein a predetermined action is performed based on the alarm information.

9. The image processing system according to claim 7, wherein a predetermined action is performed based on continuous time of occurring of the alarm information.

10. The image processing system according to claim 7, wherein a predetermined action is performed based on generation frequency of the alarm information in a predetermined period.

11. A filter setting method used in a surveillance system, the method comprising the steps of:

acquiring image data from a camera;

acquiring metadata representing information concerning an object of surveillance;

controlling a display to display a setting screen having a function of setting a plurality of filters and a function of setting a combination of the plurality of filters;

performing, with the setting screen, filter setting using the information of the metadata; and

setting the combination of the plurality of filters with the setting screen,

wherein said setting step includes selecting a type of the combination of the plurality of filters being provided in the setting screen, and wherein a set combination of the plurality of filters is displayed in the setting screen with a list f a plurality of filter types that can be set for each of the filters of the set combination,

wherein a filter is used for detecting an event in a surveillance area in an image corresponding to the acquired image data, and

wherein options of the type of the combination of the plurality of filters include a first mode and a second mode, in which;

the first mode is a mode in which an alarm information is output each time when conditions of at least one of the plurality of filters in the combination is satisfied with situations based on the metadata, and

the second mode is a mode in which an alarm trigger is output when the conditions of all filters in the combination are satisfied with situations based on the metadata.

12. The method according to claim 11, wherein a predetermined action is performed based on the alarm information.

13. The method according to claim 11, wherein a predetermined action is performed based on continuous time of occurring of the alarm information.

14. The method according to claim 11, wherein a predetermined action is performed based on generation frequency of the alarm information in a predetermined period.

15. An image processing apparatus, comprising:

a control device configured to

acquire image data from a camera;

acquire, from the camera, metadata representing information concerning an object of surveillance;

display a setting screen usable for setting a plurality of filters;

perform filter setting using the information of the metadata; and

set a combination of the plurality of filters,

wherein said filter setting and setting of said combination of the plurality of filters are provided on the same setting screen,

wherein said control device is configured to switch a type of the combination of the plurality of filters, switching of the type of the combination of the plurality of filters being provided in the setting screen, and wherein the filter setting is provided in the setting screen to display a set combination of the plurality of filters with a list of a plurality of filter types that can be set for each of the filters of the set combination,

wherein a filter is used for detecting an event in a surveillance area in an image corresponding to the acquired image data, and

wherein options of the type of the combination of the plurality of filters are;

a first mode of the control device configured to output an alarm each time a condition of any of the plurality of filters is satisfied by the metadata acquired from the camera, and

a second mode of the control device configured to output one alarm when the conditions of the plurality of filters are satisfied by the metadata acquired from the camera in a set order.