IMAGE PICKUP APPARATUS, INFORMATION PROCESSING APPARATUS, AND INFORMATION PROCESSING METHOD

• US 20110090358A1
• Filed: 10/12/2010
• Published: 04/21/2011
• Est. Priority Date: 10/19/2009
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Tojo, Hiroshi
• Granted Patent: US 9,237,266 B2
• Time in Patent Office: Days
• US Class Current: 348/222.1
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An information processing apparatus comprises: an object detection unit to detect an object included in a frame image based on a feature amount of the frame image, and generate and output object information concerning the detected object; an event detection unit to detect an event of the object based on the object information output by the object detection unit, and generate and output event concern information concerning the detected event of the object; and a transmission unit to transmit the frame image, the event concern information, concerning the frame image, output by the event detection unit, and time information concerning the frame image, as associating them with others. Thus, even in a case where event detection timing and event occurrence timing are different from each other, it is possible to perform a display by which a user can easily confirm the event.

Claims

1. An image pickup apparatus comprising:

an object detection unit configured to detect an object included in a frame image on the basis of a feature amount of the frame image, and generate and output object information concerning the detected object;

an event detection unit configured to detect an event of the object on the basis of the object information output by the object detection unit, and generate and output event concern information concerning the detected event of the object; and

a transmission unit configured to transmit the frame image, the event concern information, concerning the frame image, output by the event detection unit, and time information concerning the frame image, as associating the frame image, the event concern information and the time information with others.

2. An image pickup apparatus according to claim 1, wherein the event detection unit generates the event concern information which includes event discrimination information for discriminating the event, and existing time information concerning an existing time of the object.

3. An image pickup apparatus according to claim 1, wherein the event detection unit generates the event concern information which includes event discrimination information for discriminating the event, coordinate information concerning a position of the object, and hour information of the frame image.

4. An image pickup apparatus according to claim 1, further comprising an object tracking unit configured to assign, to the object information, same object discrimination information for the same object on the basis of the object information output by the object detection unit, and output the obtained object information,

wherein the event detection unit detects an entrance and exit event of the object on the basis of the object information output by the object tracking unit, and generates and outputs the event concern information concerning the entrance and exist event of the object.

5. An information processing apparatus comprising:

a reception unit configured to receive a frame image, event concern information, associated with the frame image, concerning an event of an object included in the frame image, and time information concerning the frame information;

a storage control unit configured to store in a storage apparatus the frame image and the time information received by the reception unit, as associating the frame image and the time information with each other;

an obtaining unit configured to determine, on the basis of the event concern information received by the reception unit, an event occurrence time concerning occurrence of the event included in the corresponding frame image, and obtain from the storage apparatus the frame image corresponding to the determined event occurrence time; and

a display control unit configured to display on a display apparatus the frame image obtained by the obtaining unit.

6. An information processing apparatus according to claim 5, wherein

the event concern information includes event discrimination information for discriminating the event, and existing time information concerning an existing time of the object, and

the obtaining unit judges, on the basis of the event discrimination information included in the event concern information, whether or not the event is an event of a detection-delayed type that detection is performed after an hour when the event occurred, and, in a case where it is judged that the event is the event of the detection-delayed type, the obtaining unit determines as the event occurrence time a time from a current hour to the existing time indicated by the existing time information, and obtains from the storage apparatus the corresponding frame image on the basis of the determined event occurrence time.

7. An information processing apparatus according to claim 5, wherein

the event concern information includes event discrimination information for discriminating the event, coordinate information concerning a position of the object, and hour information of the frame image, and

the obtaining unit judges, on the basis of the event discrimination information included in the event concern information, whether or not the event is an event of a detection-delayed type that detection is performed after an hour when the event occurred, and, in a case where it is judged that the event is the event of the detection-delayed type, the obtaining unit specifies from the stored past event concern information the event concern information which corresponds to the coordinate information and of which the event discrimination information indicates appearance, and obtains from the storage apparatus the corresponding frame image on the basis of the hour information included in the specified event concern information.

8. An information processing apparatus according to claim 5, wherein

the event concern information includes event discrimination information for discriminating the event, object discrimination information for discriminating the object, and hour information of the frame image, and

the obtaining unit judges, on the basis of the event discrimination information included in the event concern information, whether or not the event is an entrance and exist event, and, in a case where it is judged that the event is the entrance and exit event, the obtaining unit specifies from the stored past event concern information the event concern information which corresponds to the object discrimination, and obtains from the storage apparatus the corresponding frame image on the basis of the hour information included in the specified event concern information.

9. An information processing apparatus comprising:

an object detection unit configured to detect an object included in a frame image on the basis of a feature amount of the frame image, and generate and output object information concerning the detected object;

an event detection unit configured to detect an event of the object on the basis of the object information output by the object detection unit, and generate and output event concern information concerning the detected event of the object;

a storage control unit configured to store in a storage apparatus the frame image and time information concerning the frame image, as associating the frame image and the time information with each other;

an obtaining unit configured to determine, on the basis of the event concern information output by the event detection unit, an event occurrence time concerning occurrence of the event included in the corresponding frame image, and obtain from the storage apparatus the frame image corresponding to the determined event occurrence time; and

a display control unit configured to display on a display apparatus the frame image obtained by the obtaining unit.

10. An information processing method comprising:

causing an image pickup apparatus to detect an object included in a frame image on the basis of a feature amount of the frame image, and generate and output object information concerning the detected object;

causing the image pickup apparatus to detect an event of the object on the basis of the output object information, and generate and output event concern information concerning the detected event of the object; and

causing the image pickup apparatus to transmit the frame image, the output event concern information concerning the frame image, and time information concerning the frame image, as associating the frame image, the event concern information and the time information with others.

11. An information processing method comprising:

causing an information processing apparatus to receive a frame image, event concern information, associated with the frame image, concerning an event of an object included in the frame image, and time information concerning the frame information;

causing the information processing apparatus to store in a storage apparatus the received frame image and the received time information, as associating the frame image and the time information with each other;

causing the information processing apparatus to determine, on the basis of the received event concern information, an event occurrence time concerning occurrence of the event included in the corresponding frame image, and obtain from the storage apparatus the frame image corresponding to the determined event occurrence time; and

causing the information processing apparatus to display on a display apparatus the obtained frame image.

12. An information processing method comprising:

causing an information processing apparatus to detect an object included in a frame image on the basis of a feature amount of the frame image, and generate and output object information concerning the detected object;

causing the information processing apparatus to detect an event of the object on the basis of the output object information, and generate and output event concern information concerning the detected event of the object;

causing the information processing apparatus to store in a storage apparatus the frame image and time information concerning the frame image, as associating the frame image and the time information with each other;

causing the information processing apparatus to determine, on the basis of the output event concern information, an event occurrence time concerning occurrence of the event included in the corresponding frame image, and obtain from the storage apparatus the frame image corresponding to the determined event occurrence time; and

causing the information processing apparatus to display on a display apparatus the obtained frame image.

13. A non-transitory storage medium which stores a program to cause a computer to function as:

an object detection unit configured to detect an object included in a frame image on the basis of a feature amount of the frame image, and generate and output object information concerning the detected object;

an event detection unit configured to detect an event of the object on the basis of the object information output by the object detection unit, and generate and output event concern information concerning the detected event of the object; and

a transmission unit configured to transmit the frame image, the event concern information, concerning the frame image, output by the event detection unit, and time information concerning the frame image, as associating the frame image, the event concern information and the time information with others.

14. A non-transitory storage medium which stores a program to cause a computer to function as:

a reception unit configured to receive a frame image, event concern information, associated with the frame image, concerning an event of an object included in the frame image, and time information concerning the frame information;

a storage control unit configured to store in a storage apparatus the frame image and the time information received by the reception unit, as associating the frame image and the time information with each other;

an obtaining unit configured to determine, on the basis of the event concern information received by the reception unit, an event occurrence time concerning occurrence of the event included in the corresponding frame image, and obtain from the storage apparatus the frame image corresponding to the determined event occurrence time; and

a display control unit configured to display on a display apparatus the frame image obtained by the obtaining unit.

15. A non-transitory storage medium which stores a program to cause a computer to function as:

an object detection unit configured to detect an object included in a frame image on the basis of a feature amount of the frame image, and generate and output object information concerning the detected object;

an event detection unit configured to detect an event of the object on the basis of the object information output by the object detection unit, and generate and output event concern information concerning the detected event of the object;

a storage control unit configured to store in a storage apparatus the frame image and time information concerning the frame image, as associating the frame image and the time information with each other;

an obtaining unit configured to determine, on the basis of the event concern information output by the event detection unit, an event occurrence time concerning occurrence of the event included in the corresponding frame image, and obtain from the storage apparatus the frame image corresponding to the determined event occurrence time; and

a display control unit configured to display on a display apparatus the frame image obtained by the obtaining unit.