Information processing apparatus with display control unit configured to display on a display apparatus a frame image, and corresponding information processing method, and medium

• US 9,679,202 B2
• Filed: 11/30/2015
• Issued: 06/13/2017
• Est. Priority Date: 10/19/2009
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Tojo, Hiroshi
• Primary Examiner(s): CHEN, CHIA WEI A
• Application Number:
  US14/953,559
• Publication Number:
  US 20160078296A1
• Time in Patent Office: 561 Days
• Field of Search: 348143-160, 348169-172, 3482311-23199
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An information processing apparatus includes: an object detection unit to detect an object included in a frame image based on a feature amount of the frame image, and generate and output object information concerning the detected object; an event detection unit to detect an event of the object based on the object information output by the object detection unit, and generate and output event concern information concerning the detected event of the object; and a transmission unit to transmit the frame image, the event concern information, concerning the frame image, output by the event detection unit, and time information concerning the frame image, as associating them with others. Thus, even in a case where event detection timing and event occurrence timing are different from each other, it is possible to perform a display by which a user can easily confirm the event.

Claims

1. An information processing apparatus comprising:

a receiving unit configured to receive a frame image, event concern information, associated with the frame image, concerning an event of an object included in the frame image, and time information concerning the frame information, the event concern information including event discrimination information for discriminating a type of the event;

a storage control unit configured to store in a storage apparatus the frame image and the time information received by the receiving unit, so as to associate the frame image and the time information with each other;

a type determination unit configured to determine, on the basis of the event discrimination information received by the receiving unit, whether or not the event is an event of a detection-delayed type in which detection is performed after a certain time from the occurrence of the event;

a time determination unit configured to determine, in a case where it is determined that the event is the event of the detection-delayed type, an event occurrence time concerning the occurrence of the event based on a current time and an existing time of the object;

an obtaining unit configured to obtain from the storage apparatus the frame image associated with the time information corresponding to the determined event occurrence time; and

a display control unit configured to control a display apparatus to display the frame image obtained by the obtaining unit.

2. An information processing apparatus according to claim 1, wherein the existing time of the object is obtained as a number of frames in which the object exists, and the event occurrence time determined by the time determination unit is represented as a frame number.

3. An information processing apparatus according to claim 1, wherein the time determination unit determines the event occurrence time by subtracting the existing time from the current time.

4. An information processing apparatus according to claim 1, wherein

the obtaining unit obtains a sequence of frame images including the frame image corresponding to the event occurrence time, and

the display control unit controls the display apparatus to display the sequence of frame images including the frame image corresponding to the event occurrence time.

5. An information processing apparatus comprising:

a receiving unit configured to receive a frame image and event concern information, associated with the frame image, concerning an event of an object included in the frame image, and time information concerning the frame information, the event concern information including event discrimination information for discriminating a type of the event, position information concerning a position of the object, and hour information of the frame image;

a storage control unit configured to store in a storage apparatus the frame image and the time information received by the receiving unit so as to associate the frame image and the time information with each other;

a type determination unit configured to determine, on the basis of the event discrimination information received by the receiving unit, whether or not the event is an event of a detection-delayed type in which detection is performed after a certain time from the occurrence of the event;

a specifying unit configured to specify, in a case where it is determined that the event is the event of the detection-delayed type, from the stored past event concern information the event concern information which corresponds to the position information and of which the event discrimination information indicates information on an appearance event;

an obtaining unit configured to obtain from the storage apparatus the corresponding frame image on the basis of the hour information included in the specified event concern information; and

a display control unit configured to display on a display apparatus the frame image obtained by the obtaining unit.

6. An information processing method of an information processing apparatus comprising:

a receiving step of receiving with a receiving unit a frame image, event concern information, associated with the frame image, concerning an event of an object included in the frame image, and time information concerning the frame information, the event concern information including event discrimination information for discriminating a type of the event;

a storage control step of storing, with a storage control unit, in a storage apparatus the frame image and the time information received in the receiving step so as to associate the frame image and the time information with each other;

a type determination step of determining, with a type determination unit, on the basis of the event discrimination information received in the receiving step, whether or not the event is an event of a detection-delayed type in which detection is performed after a certain time from the occurrence of the event;

a time determination step of determining, with a time determination unit, in a case where it is determined that the event is the event of the detection-delayed type, an event occurrence time concerning the occurrence of the event based on a current time and an existing time of the object;

an obtaining step of obtaining, with an obtaining unit, from the storage apparatus, the frame image associated with the time information corresponding to the determined event occurrence time; and

a display control step of controlling a display apparatus, with a display control unit, to display the frame image obtained in the obtaining step.

7. A non-transitory storage medium that stores a computer program to cause a computer to perform:

a receiving step of receiving a frame image, event concern information, associated with the frame image, concerning an event of an object included in the frame image, and time information concerning the frame information, the event concern information including event discrimination information for discriminating a type of the event;

a storage control step of storing in a storage apparatus the frame image and the time information received in the receiving step so as to associate the frame image and the time information with each other;

a type determination step of determining on the basis of the event discrimination information received in the receiving step, whether or not the event is an event of a detection- delayed type in which detection is performed after a certain time from the occurrence of the event;

a time determination step of determining, in a case where it is determined that the event is the event of the detection-delayed type, an event occurrence time concerning the occurrence of the event based on a current time and an existing time of the object;

an obtaining step of obtaining, from the storage apparatus, the frame image associated with the time information corresponding to the determined event occurrence time; and

a display control step of controlling a display apparatus to display the frame image obtained in the obtaining step.

8. An information processing method of an information processing apparatus comprising:

a receiving step of receiving, with a receiving unit, a frame image and event concern information, associated with the frame image, concerning an event of an object included in the frame image, and time information concerning the frame information, the event concern information including event discrimination information for discriminating a type of the event, position information concerning a position of the object, and hour information of the frame image;

a storage step of storing, with a storage control unit, in a storage apparatus the frame image and the time information received in the receiving step so as to associate the frame image and the time information with each other;

a type determination step of determining, with a type determination unit, on the basis of the event discrimination information received in the receiving step, whether or not the event is an event of a detection-delayed type in which detection is performed after a certain time from the occurrence of the event;

a specifying step of specifying, with a specifying unit, in a case where it is determined that the event is the event of the detection-delayed type, from the stored past event concern information the event concern information which corresponds to the position information and of which the event discrimination information indicates information on an appearance event;

an obtaining step of obtaining, with an obtaining unit, from the storage apparatus the corresponding frame image on the basis of the hour information included in the specified event concern information; and

a display control step of controlling, with a display control unit, a display apparatus to display the frame image obtained in the obtaining step.

9. A non-transitory storage medium that stores a computer program to cause a computer to perform:

a receiving step of receiving a frame image and event concern information, associated with the frame image, concerning an event of an object included in the frame image, and time information concerning the frame information, the event concern information including event discrimination information for discriminating a type of the event, position information concerning a position of the object, and hour information of the frame image;

a storage step of storing in a storage apparatus the frame image and the time information received in the receiving step so as to associate the frame image and the time information with each other;

a type determination step of determining on the basis of the event discrimination information received in the receiving step, whether or not the event is an event of a detection-delayed type in which detection is performed after a certain time from the occurrence of the event;

a specifying step of specifying, in a case where it is determined that the event is the event of the detection-delayed type, from the stored past event concern information the event concern information which corresponds to the position information and of which the event discrimination information indicates information on an appearance event;

an obtaining step of obtaining from the storage apparatus the corresponding frame image on the basis of the hour information included in the specified event concern information; and

a display control step of controlling a display apparatus to display the frame image obtained in the obtaining step.

10. An information processing apparatus comprising:

a receiving unit configured to receive a plurality of frame images;

a storage control unit configured to store in a storage apparatus the plurality of frame images in association with time information which indicates receiving times at which respective frame images were received;

an object detection unit configured to detect an object from a frame image in the plurality of frame images;

an event detection unit configured to detect a leaving event in which the object has been left behind based on a status and an existing time of the object;

a time determination unit configured to determine an event occurrence time indicating occurrence of the leaving event based on a detection time at which the leaving event was detected and the existing time of the object;

an obtaining unit configured to obtain from the storage apparatus a frame image corresponding to the determined event occurrence time; and

a display control unit configured to control a display apparatus to display the frame image obtained by the obtaining unit.

11. An information processing apparatus according to claim 10, wherein the existing time information is represented as a number of frames in which the object exists, and the event occurrence time is represented as a frame number.

12. An information processing apparatus according to claim 10, wherein the time determination unit determines the event occurrence time by subtracting the existing time of the object from the detection time at which the leaving event was detected.

13. An information processing apparatus according to claim 10, wherein

the obtaining unit obtains a sequence of frame images including a frame image corresponding to the event occurrence time, and

the display control unit controls the display apparatus to display the sequence of frame images including the frame image corresponding to the event occurrence time.

14. An information processing method comprising:

receiving a plurality of frame images;

storing in a storage apparatus the plurality of frame images in association with time information which indicates receiving times at which respective frame images were received;

detecting an object from a frame image in the plurality of frame images;

detecting a leaving event in which the object has been left behind based on a status and an existing time of the object;

determining an event occurrence time indicating occurrence of the leaving event based on a detection time at which the leaving event was detected and the existing time of the object;

obtaining from the storage apparatus a frame image corresponding to the determined event occurrence time; and

controlling a display apparatus to display the obtained frame image.

15. A non-transitory storage medium which stores a program to cause a computer to function as:

a receiving unit configured to receive a plurality of frame images;

a storage control unit configured to store in a storage apparatus the plurality of frame images in association with time information which indicates receiving times at which respective frame images were received;

an object detection unit configured to detect an object from a frame image in the plurality of frame images;

an event detection unit configured to detect a leaving event in which the object has been left behind based on a status and an existing time of the object;

a time determination unit configured to determine an event occurrence time indicating occurrence of the leaving event based on a detection time at which the leaving event was detected and the existing time of the object;

an obtaining unit configured to obtain from the storage apparatus a frame image corresponding to the determined event occurrence time; and

a display control unit configured to control a display apparatus to display the frame image obtained by the obtaining unit.