IMAGE PICKUP APPARATUS, INFORMATION PROCESSING APPARATUS, AND INFORMATION PROCESSING METHOD

• US 20170236010A1
• Filed: 05/01/2017
• Published: 08/17/2017
• Est. Priority Date: 10/19/2009
• Status: Abandoned Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Tojo, Hiroshi
• Application Number:
  US15/583,323
• Publication Number:
  US 20170236010A1
• Time in Patent Office: Days
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An information processing apparatus comprises: an object detection unit to detect an object included in a frame image based on a feature amount of the frame image, and generate and output object information concerning the detected object; an event detection unit to detect an event of the object based on the object information output by the object detection unit, and generate and output event concern information concerning the detected event of the object; and a transmission unit to transmit the frame image, the event concern information, concerning the frame image, output by the event detection unit, and time information concerning the frame image, as associating them with others. Thus, even in a case where event detection timing and event occurrence timing are different from each other, it is possible to perform a display by which a user can easily confirm the event.

Claims

1-15. -15. (canceled)

16. An image processing apparatus comprising:

a receiving unit configured to receive a plurality of frame images;

a storage control unit configured to store in a storage apparatus the plurality of frame images in association with time information which indicates receiving times at which respective frame images were received;

an object detection unit configured to detect an object from a frame image in the plurality of frame images;

an event detection unit configured to detect a leaving event in which the object has been left behind based on a status of the object and a duration time of the status;

a determination unit configured to determine an event occurrence time indicating occurrence of the leaving event based on a detection time at which the leaving event was detected and the existing time of the object;

an obtaining unit configured to obtain from the storage apparatus a frame image corresponding to the determined event occurrence time; and

a display control unit configured to control a display apparatus to display the frame image obtained by the obtaining unit.

17. The image processing apparatus according to claim 16, wherein the event detection unit detects the leaving event if the status of the object is a stationary state and the duration time of the stationary state is equal to or longer than a threshold.

18. The image processing apparatus according to claim 16, wherein the duration time of the status is represented as a number of frames in which the object is in the status, and the event occurrence time is represented as a frame number.

19. The image processing apparatus according to claim 16, wherein the determination unit determines the event occurrence time by subtracting the duration time of the status from the detection time at which the leaving event was detected.

20. The image processing apparatus according to claim 16, wherein

the obtaining unit obtains a sequence of frame images including a frame image corresponding to the event occurrence time, and

the display control unit controls the display apparatus to display the sequence of frame images including the frame image corresponding to the event occurrence time.

21. The image processing apparatus according to claim 16, wherein

the display control unit controls the display apparatus to display the frame image corresponding to the determined event occurrence time in a sub window.

22. The image processing apparatus according to claim 16, wherein

the display control unit controls the display apparatus to display the frame image corresponding to the determined event occurrence time with a message indicating the event occurrence.

23. An image processing method comprising:

receiving a plurality of frame images;

storing in a storage apparatus the plurality of frame images in association with time information which indicates receiving times at which respective frame images were received;

detecting an object from a frame image in the plurality of frame images;

detecting a leaving event in which the object has been left behind based on a status and a duration time of the status;

determining an event occurrence time indicating occurrence of the leaving event based on a detection time at which the leaving event was detected and the existing time of the object;

obtaining from the storage apparatus a frame image corresponding to the determined event occurrence time; and

controlling a display apparatus to display the obtained frame image.

24. A non-transitory computer-readable storage medium which stores a program to cause a computer to function as:

a receiving unit configured to receive a plurality of frame images;

a storage control unit configured to store in a storage apparatus the plurality of frame images in association with time information which indicates receiving times at which respective frame images were received;

an object detection unit configured to detect an object from a frame image in the plurality of frame images;

an event detection unit configured to detect a leaving event in which the object has been left behind based on a status and a duration time of the status;

a time determination unit configured to determine an event occurrence time indicating occurrence of the leaving event based on a detection time at which the leaving event was detected and the existing time of the object;

an obtaining unit configured to obtain from the storage apparatus a frame image corresponding to the determined event occurrence time; and

a display control unit configured to control a display apparatus to display the frame image obtained by the obtaining unit.