Summary view of video objects sharing common attributes

• US 8,831,281 B2
• Filed: 12/14/2011
• Issued: 09/09/2014
• Est. Priority Date: 12/24/2010
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Shellshear, Andrew John
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): Lesnick, Alexander J
• Application Number:
  US13/326,098
• Publication Number:
  US 20120163657A1
• Time in Patent Office: 1,000 Days
• Field of Search: None
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 20/47 Detecting features for summarising video content

Abstract

Disclosed herein are a method, system, and computer program product for displaying on a display device (214, 410) a track summary (411, 412) of an object in a scene of a video sequence. The method includes the steps of: determining a plurality of detected track elements of the object in the scene of the video sequence; receiving a selection criterion; identifying at least one characteristic of interest of the object, based on the selection criterion; selecting a track element from the plurality of detected track elements, said selected track element corresponding to the at least one identified characteristic of interest; determining a parameter of the selected track elements depending on the at least one characteristic of interest; and displaying the track summary derived from said detected track elements, based on the determined parameter.

Claims

1. A computer-implemented method of displaying on a display device a track summary of an object in a scene of a video sequence, said method comprising the steps of:

determining a plurality of track elements of the object detected in the scene of the video sequence, wherein each of the plurality of track elements indicates the detected object in a frame and a track of the object in a collection of track elements in a video sequence;

receiving a selection criterion;

identifying at least one characteristic of interest of the object, based on the selection criterion;

selecting a track element from the plurality of track elements in the track, said selected track element satisfying the at least one identified characteristic of interest; and

displaying the plurality of track elements in the track as the track summary, wherein the selected track element is displayed differently from other track elements of the plurality of track elements.

2. The method according to claim 1, wherein the track summary comprises a union of a plurality of bitmasks associated with the plurality of track elements.

3. The method according to claim 2, wherein the union of the plurality of bitmasks applies a logical AND operator to the plurality of bitmasks.

4. The method according to claim 1, wherein said track summary is derived from a weighted superimposition of a plurality of bitmasks associated with the plurality of track elements.

5. The method according to claim 4, wherein said plurality of bitmasks associated with the detected track elements are partially opaque.

6. The method according to claim 5, wherein the level of opacity associated with each bitmask of each track element is dependent upon said selection criteria and a determined parameter of said each track element.

7. The method according to claim 1, wherein the displayed plurality of track elements in the track summary are presented as a semi-opaque overlay of a plurality of bitmasks associated with the plurality of track elements.

8. The method according to claim 1, wherein the displayed plurality of track elements in the track summary are presented as a heat map.

9. The method according to claim 1, wherein the at least one characteristic of interest of the object includes the apparent size of the object from the perspective of the display device.

10. The method according to claim 1, wherein the selection criterion is a region in the scene of the video sequence designated by a user.

11. A non-transitory computer readable storage medium having recorded thereon a computer program for displaying on a display device a track summary of an object in a scene of a video sequence, said computer program comprising code for performing the steps of:

determining a plurality of track elements of the object detected in the scene of the video sequence, wherein each of the plurality of track elements indicates the detected object in a frame and a track of the object in a collection of track elements in a video sequence;

receiving a selection criterion;

identifying at least one characteristic of interest of the object, based on the selection criterion;

selecting a track element from the plurality of track elements in the track, said selected track element satisfying the at least one identified characteristic of interest; and

displaying the plurality of track elements in the track as the track summary, wherein the selected track element is displayed differently from other track elements of the plurality of track elements.

12. An apparatus for displaying on a display device a track summary of an object in a scene of a video sequence, said apparatus comprising:

a storage device for storing a computer program; and

a processor for executing the program, said program comprising code for performing the method steps of;

determining a plurality of track elements of the object detected in the scene of the video sequence, wherein each of the plurality of track elements indicates the detected object in a frame and a track of the object in a collection of track elements in a video sequence;

receiving a selection criterion;

identifying at least one characteristic of interest of the object, based on the selection criterion;

selecting a track element from the plurality of track elements in the track, said selected track element satisfying the at least one identified characteristic of interest; and

displaying on the display device the plurality of track elements in the track as the track summary, wherein the selected track element is displayed differently from other track elements of the plurality of track elements.