Video content detection method and system leveraging data-compression constructs

• US 6,714,594 B2
• Filed: 05/14/2001
• Issued: 03/30/2004
• Est. Priority Date: 05/14/2001
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Salomons, Edwin, McGee, Thomas, Dimitrova, Nevenka, Mekenkamp, Gerhardus Engbertus
• Primary Examiner(s): Kelley, Chris
• Assistant Examiner(s): Bugg, George A
• Application Number:
  US09/854,511
• Publication Number:
  US 20020186768A1
• Time in Patent Office: 1,051 Days
• Field of Search: 382/156, 382/224, 382/228, 386/94, 386/96, 375/240.12, 375/240.16, 348/700
• US Class Current: 375/240.16
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

The process of compressing video requires the calculation of a variety data that are used in the process of compression. The invention exploits some or all of these data for purposes of content detection. For example, these data may be leveraged for purposes of commercial detection. The luminance, motion vector field, residual values, quantizer, bit rate, etc. may all be used either directly or in combination, as signatures of content. A process for content detection may employ one or more features as indicators of the start and/or end of a sequence containing a particular type of content and other features as verifiers of the type of content bounded by these start/end indicators. The features may be combined and/or refined to produce higher-level feature data with good computational economy and content-classification utility.

Claims

1. A content editor, comprising:

a video compression encoder that generates first and second feature data from a video sequence as part of a compression process resulting in a compressed version of video data;

said first and second feature data being separate from said compressed version of video data;

an analysis engine programmed to receive said first and second feature data and calculate at least a third feature datum from at least one of said first and second feature data;

a playback selector programmed to edit said compressed version of video data responsively to said at least a third feature datum, wherein said third data includes an identifier of a transition between letterbox format and non-letterbox format.

17. A content editor as in claim 1, wherein said editing process controller includes a playback selector.

2. A content editor, comprising:

a video compression encoder that generates first and second feature data from a video sequence as part of a compression process resulting in a compressed version of video data;

said first and second feature data being separate from said compressed version of video data;

an analysis engine programmed to receive said first and second feature data and calculate at least a third feature datum from at least one of said first and second feature data;

a playback selector programmed to edit said compressed version of video data responsively to said at least a third feature datum, wherein said third data includes an identifier of a transition between interlaced and progressive video.

3. A content editor, comprising:

a video compression encoder that generates first and second feature data from a video sequence as part of a compression process resulting in a compressed version of video data;

said first and second feature data being separate from said compressed version of video data;

an analysis engine programmed to receive said first and second feature data and calculate at least a third feature datum from at least one of said first and second feature data;

a playback selector programmed to edit said compressed version of video data responsively to said at least a third feature datum, wherein said third data includes an identifier of an average of multiple substantially different frequencies of scene cuts.

4. A video content detector, comprising:

a video compression encoder capable of receiving uncompressed video data and generating compressed video data;

said analysis engine being connected to receive first data from the video compression encoder, said first data being separate from said compressed video data;

said first data being generated as a result of a compression process;

said analysis engine being programmed to generate an identifier of a beginning of a type of content in said compressed video responsively to said first data, wherein said analysis engine is programmed to identify, responsively to said first data, the presence or absence of a letterbox in said uncompressed video data and to generate an identifier of a location in a sequence of said compressed video data coinciding with said presence or absence.

5. A video content detector, comprising:

video compression encoder capable of receiving uncompressed video data and generating compressed video data;

said analysis engine being connected to receive first data from the video compression encoder, said first data being separate from said compressed video data;

said first data being generated as a result of a compression process;

said analysis engine being programmed to generate an identifier of a beginning of a type of content in said compressed video responsively to said first data, wherein said analysis engine is programmed to identify, responsively to said first data, the presence of interlaced or progressive video format in said uncompressed video data and to generate an identifier of a location in a sequence of said compressed video data coinciding with said interlaced or progressive video format.

6. A video content detector, comprising:

a video compression encoder capable of receiving uncompressed video data and generating compressed video data;

said analysis engine being connected to receive first data from the video compression encoder, said first data being separate from said compressed video data;

said first data being generated as a result of a compression process;

said analysis engine being programmed to generate an identifier of a beginning of a type of content in said compressed video responsively to said first data, wherein said analysis engine is programmed to identify, responsively to said first data, an indicator of an average of multiple substantially different frequencies of scene cuts.

7. A content editor, comprising:

a video processor configured to generate feature data from a video sequence;

said feature data including an identifier of a transition between letterbox format and non-letterbox format;

a playback selector programmed to receive said identifier and edit said compressed version of video data responsively to said identifier.

8. A content editor, comprising:

a video processor configured to generate first and second feature data from a video sequence;

said first and second feature data being separate from said compressed version of video data;

an analysis engine programmed to receive said first and second feature data and calculate at least a third feature datum from at least one of said first and second feature data;

a playback selector programmed to edit said compressed version of video data responsively to said at least a third feature datum, wherein said third data includes an identifier of a transition between interlaced and progressive video.

9. A video content detector, comprising:

a video analysis engine programmed to generate an identifier of a change in a type of content in a video data stream at least in part by calculating an average frequency of scene cuts in a segment of said video data stream and generating an identifier of a location of said segment responsively to said average frequency;

an editing process controller configured to receive said identifier and control and editing process thereof responsively to said identifier, wherein said average is taken over substantially different frequencies of scene cuts.

10. A content editor, comprising:

a video processor configured to generate first and second feature data from a video sequence;

said first and second feature data being separate from said video sequence;

an analysis engine programmed to receive said first and second feature data and calculate at least a third feature datum from at least one of said first and second feature data;

a playback selector programmed to edit said video data responsively to said at least a third feature datum, wherein said third feature datum includes an identifier of a transition between letterbox format and non-letterbox format.

11. A content editor, comprising:

a video processor configured to recognize a letterbox format in a video stream and output an indication of a presence or absence of a letterbox in respective portions of said video stream, an analysis engine programmed to receive said indication of a presence and to output, in response thereto, an indication of a content of said video stream;

a playback selector programmed to edit said video data responsively to said indication of a content.

12. A content editor as in claim 11, wherein said indication of a content indicates a transition between letterbox format and non-letterbox format.

13. A content editor, comprising:

a video processor that generates feature data from a video sequence;

said feature data being separate from said video data;

an analysis engine programmed to receive said feature data and identify a transition between interlaced and progressive video and output an identification thereof;

a playback selector programmed to edit said video data responsively to said identification.

14. A content editor, comprising:

a video processor tat generates feature data from a video sequence;

said feature data being separate from said video data;

an analysis engine programmed to receive said feature data and calculate an avenge frequency of scene cuts in respective portions of said video data and to output an indication of program content responsively to said average frequency of scene cuts;

an editing process controller configured to edit said video data responsively to said indication, wherein said average is taken over substantially different frequencies of scene cuts.

15. A content editor as in claim 14, wherein said editing process controller includes a playback selector.

16. A video content detector, comprising:

a video analysis engine programmed to generate an identifier of a change in a type of content in a video data stream at least in part by detecting a change in a video format and generating an identifier of a location in said video data stream of said change;

an editing process controller configured to receive said identifier and control and editing process thereof responsively to said identifier.

18. A video content detector, comprising:

a video analysis engine programmed to generate an identifier of a change in a type of content in a video data stream at least in part by detecting a change of letterbox size and generating an identifier of a location in said video data stream of said change;

an editing process controller configured to receive said identifier and control and editing process thereof responsively to said identifier.

19. A content editor as in claim 18, wherein said editing process controller includes a playback selector.