Summary View of Video Objects Sharing Common Attributes

• US 20120163657A1
• Filed: 12/14/2011
• Published: 06/28/2012
• Est. Priority Date: 12/24/2010
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: SHELLSHEAR, Andrew John
• Granted Patent: US 8,831,281 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 20/47 Detecting features for summarising video content

Abstract

Disclosed herein are a method, system, and computer program product for displaying on a display device (214, 410) a track summary (411, 412) of an object in a scene of a video sequence. The method includes the steps of: determining a plurality of detected track elements of the object in the scene of the video sequence; receiving a selection criterion; identifying at least one characteristic of interest of the object, based on the selection criterion; selecting a track element from the plurality of detected track elements, said selected track element corresponding to the at least one identified characteristic of interest; determining a parameter of the selected track elements depending on the at least one characteristic of interest; and displaying the track summary derived from said detected track elements, based on the determined parameter.

Claims

1. A computer-implemented method of displaying on a display device a track summary of an object in a scene of a video sequence, said method comprising the steps of:

determining a plurality of detected track elements of the object in the scene of the video sequence;

receiving a selection criterion;

identifying at least one characteristic of interest of the object, based on the selection criterion;

selecting a track element from the plurality of detected track elements, said selected track element corresponding to the at least one identified characteristic of interest;

determining a parameter of the selected track elements depending on the at least one characteristic of interest; and

displaying the track summary derived from said detected track elements, based on the determined parameter.

2. The method according to claim 1, wherein the track summary comprises a union of a plurality of bitmasks associated with the plurality of detected track elements.

3. The method according to claim 2, wherein the union of the plurality of bitmasks applies a logical AND operator to the plurality of bitmasks.

4. The method according to claim 1, wherein said track summary is derived from a weighted superimposition of a plurality of bitmasks associated with the plurality of detected track elements.

5. The method according to claim 4, wherein said plurality of bitmasks associated with the detected track elements are partially opaque.

6. The method according to claim 5, wherein the level of opacity associated with each bitmask of each track element is dependent upon said selection criteria and said determined parameter of said each track element.

7. The method according to claim 1, wherein the displayed plurality of detected track elements in the track summary are presented as a semi-opaque overlay of a plurality of bitmasks associated with the plurality of detected track elements.

8. The method according to claim 1, wherein the displayed plurality of detected track elements in the track summary are presented as a heat map.

9. The method according to claim 1, wherein the at least one characteristic of interest of the object includes the apparent size of the object from the perspective of the display device.

10. The method according to claim 1, wherein the selection criterion is a region in the scene of the video sequence designated by a user.

11. A computer readable storage medium having recorded thereon a computer program for displaying on a display device a track summary of an object in a scene of a video sequence, said computer program comprising code for performing the steps of:

determining a plurality of detected track elements of the object in the scene of the video sequence;

receiving a selection criterion;

identifying at least one characteristic of interest of the object, based on the selection criterion;

selecting a track element from the plurality of detected track elements, said selected track element corresponding to the at least one identified characteristic of interest;

determining a parameter of the selected track elements depending on the at least one characteristic of interest; and

displaying the track summary derived from said detected track elements, based on the determined parameter.

12. An apparatus for displaying on a display device a track summary of an object in a scene of a video sequence, said apparatus comprising:

a storage device for storing a computer program; and

a processor for executing the program, said program comprising code for performing the method steps of;

determining a plurality of detected track elements of the object in the scene of the video sequence;

receiving a selection criterion;

identifying at least one characteristic of interest of the object, based on the selection criterion;

selecting a track element from the plurality of detected track elements, said selected track element corresponding to the at least one identified characteristic of interest;

determining a parameter of the selected track elements depending on the at least one characteristic of interest; and

displaying on the display device the track summary derived from said detected track elements, based on the determined parameter.

13. A computer-implemented method of displaying a track summary of an object detected in a scene of a video sequence, said method comprising the steps of:

selecting a set of track elements associated with said object, dependent upon selection criteria;

modifying a bitmask associated with each track element in said selected set of track elements, by;

identifying at least one characteristic of interest associated with said object, dependent upon said selection criteria; and

applying a weight to the bitmask associated with each track element in said selected set of track elements, based on said identified characteristic of interest; and

displaying said track summary, derived from said selected set of track elements, dependent upon said modified set of bitmasks associated with the track elements.

14. The method according to claim 13, wherein said weight relates to a level of opacity associated with each bitmask of said track element.

15. A computer-implemented method of displaying on a display device a track summary of an object in a scene of a video sequence, said method comprising:

receiving a selection criterion;

selecting a track summary of the object based on the received selection criterion;

identifying at least one characteristic of interest of the object, based on the selection criterion;

selecting at least one track element from the plurality of detected track elements, said selected track elements corresponding to the at least one identified characteristic of interest;

determining a parameter of the selected track elements to be displayed depending on at least one characteristic of interest; and

displaying the track summary derived from said selected track elements having the determined parameter.

16. The method according to claim 15, wherein the selection criterion is a region in the scene of the video sequence designated by a user.

17. The method according to claim 16, wherein the selecting step selects a track summary of the object that overlaps with the designated region, said overlap satisfying a predefined criterion.

18. A computer-implemented method of displaying on a display device a track summary of an object in a scene of a video sequence, said method comprising:

identifying at least one characteristic of interest of the object;

selecting at least one track element from the plurality of detected track elements associated with the object, said selected track elements corresponding to the at least one identified characteristic of interest; and

displaying the track summary comprising said selected track elements having a parameter, said parameter of the selected track elements depending on the at least one characteristic of interest.

19. The method according to claim 18, wherein the selection criterion is a region in the scene of the video sequence designated by a user.

20. The method according to claim 19, wherein the selecting step selects a track summary of the object that overlaps with the designated region, said overlap satisfying a predefined criterion.