SELECTION OF CONTENT FROM A STREAM OF VIDEO OR AUDIO DATA

• US 20090226148A1
• Filed: 08/09/2005
• Published: 09/10/2009
• Est. Priority Date: 08/12/2004
• Status: Active Grant

• Current Assignee: Roku, Inc.
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Nagorski, Igor Alexandrovich, Aarts, Ronaldus Maria, Nesvadba, Jan Alexis Daniel
• Granted Patent: US 8,406,607 B2
• Time in Patent Office: Days
• US Class Current: 386/248
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2389 Multiplex stream processing, e.g. multiplex stream encrypting
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/2541 Rights Management protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/4135 external recorder interface circuits between an apparatus for recording television signals and a television receiver H04N5/775
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4383 Accessing a communication channel
• CPC Class Codes: H04N 21/4385 Multiplex stream processing, e.g. multiplex stream decrypting
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8549 : Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739
• CPC Class Codes: H04N 5/50 : Tuning indicators; Automatic tuning control

Abstract

A main stream contains successive content elements of video and/or audio information that encode video and/or audio information at a first data rate. A computation circuit (144) computes main fingerprints from the successive content elements. A reference stream is received having a second data rate lower than the first data rate. The reference stream defines a sequence of the reference fingerprints. A comparator unit (144) compares the main fingerprints with the reference fingerprints. The main stream is monitored for the presence of inserted content elements between original content elements, where the original content elements have main fingerprints that match successive reference fingerprints and the inserted content elements have main fingerprints that do not match reference fingerprints. Rendering of inserted content elements to be skipped. In an embodiment when more than one content element matches only one is rendered. In another embodiment matching is used to control zapping to or from the main stream. In another embodiment matching is used to control linking of separately received mark-up information such as subtitles to points in the main stream.

Claims

1. An apparatus for selection of content from a stream of audio and/or video data, the apparatus comprising:

an input (140) for receiving a main stream, the main stream comprising successive content elements of video and/or audio data;

a computation circuit (144) for computing a main fingerprint from the successive content elements;

a comparator unit (144) for comparing the main fingerprint with a reference fingerprint; and

a control unit (146) arranged to select all content elements from the main stream for which the main fingerprint matches the reference fingerprint or to select all content elements from the main stream for which the main fingerprint mismatches the reference fingerprint.

2. An apparatus according to claim 1, wherein the control unit (146) selects content elements from the main stream if the main fingerprint mismatches the reference fingerprint and the control unit (146) causes rendering of the content elements to be skipped.

3. An apparatus according to claim 2, wherein the comparator unit (144) is arranged to detect whether the main fingerprint matches the reference fingerprint more than once, the control unit (146) being arranged to cause no more than one of the corresponding content elements to be rendered in response to this detection.

4. An apparatus according to claim 1, comprising a storage device (142) for storing the main stream upon reception, the control unit (146) being arranged to select content items for which the main fingerprint matches the reference fingerprint for selective retrieval from the storage device (142).

5. An apparatus according to claim 1, comprising a storage device (142) for storing the main stream upon reception, as well as mark-up information, the comparator unit (144) being arranged to cause linking information to be stored indicating where the main fingerprint matches linking points in the reference fingerprint.

6. An apparatus according to claim 1, comprising a channel selection unit (56), arranged to switch to rendering of a further stream when the main fingerprint mismatches the reference fingerprint and to switch back to rendering of the main stream when the main fingerprint matches the reference fingerprint.

7. An apparatus according to claim 1, wherein the input (140) for receiving the main stream and an input (141) for receiving the reference fingerprint are arranged to receive the main stream and the reference fingerprint from mutually different distribution media.

8. An apparatus according to claim 1, wherein the input (140) for receiving the main stream is arranged to receive the main stream via a broadcast channel.

9. An apparatus according to claim 8, comprising a storage device (142) for recording the main stream upon reception, content items for which the main fingerprint mismatches the reference fingerprint being discarded for retention in the storage device (142).

10. An apparatus according to claim 1, wherein the computation circuit (144) is arranged to compute the reference fingerprint from lower resolution versions of the content elements.

11. A method of selecting content from a stream of audio and/or video data, the method comprising:

receiving the main stream, the main stream comprising successive content elements (22a-g) of video and/or audio information;

computing a main fingerprint for the successive content elements (22a-g);

comparing the main fingerprints with a reference fingerprint; and

selecting all content elements from the main stream for which the main fingerprint matches the reference fingerprint or selecting all content elements from the main stream for which the main fingerprint mismatches the reference fingerprint.

12. A method according to claim 11, wherein content elements are selected from the main stream if the main fingerprint mismatches the reference fingerprint and the method further comprises the step of causing rendering of the content elements to be skipped.

13. A computer program product comprising a program of instructions that, when executed by a programmable machine for selecting content from a stream of audio and/or video data, causes the machine to:

receive the main stream, the main stream comprising successive content elements of video and/or audio information;

compute a main fingerprint for the successive content elements;

compare the main fingerprints with a reference fingerprint;

select all content elements from the main stream for which the main fingerprint matches the reference fingerprint or select all content elements from the main stream for which the main fingerprint mismatches the reference fingerprint.