Image pickup apparatus and method for detecting an entrance or exit event of an object in a frame image and medium storing a program causing a computer to function as the apparatus

• US 9,237,266 B2
• Filed: 10/12/2010
• Issued: 01/12/2016
• Est. Priority Date: 10/19/2009
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Tojo, Hiroshi
• Primary Examiner(s): CHEN, CHIA WEI A
• Application Number:
  US12/902,639
• Publication Number:
  US 20110090358A1
• Time in Patent Office: 1,918 Days
• Field of Search: 348143-160, 348169-172, 348/231.5, 348/231.3, 382/103, 382115-124
• US Class Current: 1/1
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An information processing apparatus includes: an object detection unit to detect an object included in a frame image based on a feature amount of the frame image, and generate and output object information concerning the detected object; an event detection unit to detect an event of the object based on the object information output by the object detection unit, and generate and output event concern information concerning the detected event of the object; and a transmission unit to transmit the frame image, the event concern information, concerning the frame image, output by the event detection unit, and time information concerning the frame image, as associating them with others. Thus, even in a case where event detection timing and event occurrence timing are different from each other, it is possible to perform a display by which a user can easily confirm the event.

Claims

1. An image pickup apparatus comprising:

an object detection unit configured to detect an object included in a frame image of video data on the basis of a feature amount of the frame image;

an event detection unit configured to detect a misplacement event of the object based on an activity state and an existing time of the object, and to generate event information including the existing time of the object and an identifier of the frame image in which the misplacement event of the object has been detected;

a storage control unit configured to store in a storage device the frame image and the event information;

a determination unit configured to determine an event occurrence time at which the misplacement event occurred based on the identifier of the frame image in which the misplacement event has been detected and the existing time of the object in the event information; and

display control unit configured to obtain the frame image corresponding to the determined event occurrence time from the storage device and display the obtained frame image corresponding to the determined event occurrence time on a display device.

2. An image pickup apparatus according to claim 1, wherein the event information includes event discrimination information for discriminating the event.

3. An image pickup apparatus according to claim 2, wherein the event information further includes coordinate information concerning the position of the object and time information of the frame image.

4. An image pickup apparatus according to claim 1, wherein

the object detection unit detects a size of the object;

and

the event detection unit detects the misplacement event of the object based on the size of the object.

5. An information processing method comprising:

causing an image pickup apparatus to detect an object included in a frame image of video data on the basis of a feature amount of the frame image;

causing the image pickup apparatus to detect a misplacement event of the object based on an activity state and an existing time of the object, and generate event information including the existing time of the object and an identifier of the frame image in which the misplacement event of the object has been detected;

storing in a storage device the frame image and the event information;

determining an event occurrence time at which the misplacement event occurred based on the identifier of the frame image in which the misplacement event has been detected and the existing time of the object in the event information; and

obtaining the frame image corresponding to the determined event occurrence time from the storage device and display the obtained frame image corresponding to the determined event occurrence time on a display device.

6. A non-transitory storage medium which stores a program to cause a computer to function as:

an object detection unit configured to detect an object included in a frame image of video data on the basis of a feature amount of the frame image;

an event detection unit configured to detect a misplacement event of the object based on an activity state and an existing time of the object, and generate event information including the existing time of the object and an identifier of the frame image in which the misplacement event of the object has been detected;

a storage control unit configured to store in a storage device the frame image and the event information;

a determination unit configured to determine an event occurrence time at which the misplacement event occurred based on the identifier of the frame image in which the misplacement event has been detected and the existing time of the object in the event information; and

display control unit configured to obtain the frame image corresponding to the determined event occurrence time from the storage device and display the obtained frame image corresponding to the determined event occurrence time on a display device.