Methods and apparatus for filtering and inserting content into a presentation stream using signature data

• US 8,588,579 B2
• Filed: 05/04/2009
• Issued: 11/19/2013
• Est. Priority Date: 12/24/2008
• Status: Active Grant

• Current Assignee: Dish Technologies LLC (Dish Network Corporation)
• Original Assignee: Echostar Technologies LLC (Echostar Corporation)
• Inventors: Casagrande, Steven M., Kummer, David A.
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): Wendmagegn, Girumsew
• Application Number:
  US12/434,746
• Publication Number:
  US 20100158484A1
• Time in Patent Office: 1,660 Days
• Field of Search: 386/291, 386/239
• US Class Current: 386/239
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/4351 involving reassembling additional data, e.g. rebuilding an executable program from recovered modules
• CPC Class Codes: H04N 21/4542 Blocking scenes or portions of the received content, e.g. censoring scenes
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/91 Television signal processing therefor
• CPC Class Codes: H04N 9/8063 using time division multiplex of the PCM audio and PCM video signals
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

Described herein are methods and apparatus for the identification of locations in a presentation stream based on metadata associated with the presentation stream. Locations within a presentation stream are identified using signature data associated with the presentation stream. The identified locations within a presentation stream may be utilized to identify boundaries of segments within the presentation stream, such as segments of a show and interstitials (e.g., commercials) of the show. The identified portions of a presentation stream may then be utilized for filtering segments of content during presentation. Additionally, supplemental content is identified and inserted into the presentation stream during presentation.

Claims

1. A method for processing an audio/video stream, the method comprising:

providing a first audio/video stream including at least one segment of a show, at least one interstitial of the show and closed captioning data;

receiving location information for the first audio/video stream, the location information including a text string associated with a particular video location within the first audio/video stream, and the location information including search boundary offsets relative to the particular video location;

receiving a signature of a portion of the first audio/video stream, wherein the signature refers to waveform characteristics of the portion of the first audio/video stream;

processing the closed captioning data to locate an instance of the text string in the closed captioning data, and to locate a beginning of the instance of the text string in the closed captioning data;

identifying an intermediate video location in the first audio/video stream, the identified intermediate video location corresponding to the beginning of the text string located in the closed captioning data;

identifying search boundaries within the first audio/video stream by applying the search boundary offsets to the identified intermediate video location;

processing content of the first audio/video stream within the identified search boundaries, wherein the processing searches for the signature to identify a signature-based video location in the first audio/video stream;

locating boundaries of a segment of the show by applying segment boundary offsets to the identified signature-based video location;

identifying supplemental content for presentation in association with the segment of the show; and

outputting a second audio/video stream for presentation by a display device, the second audio/video stream including the segment of the show and the supplemental content, wherein the outputting uses the identified boundaries of the segment of the show.

2. The method of claim 1, wherein outputting the second audio/video stream for presentation by the display device further comprises:

replacing the interstitial with the supplemental content.

3. The method of claim 1, wherein outputting the second audio/video stream for presentation by the display device further comprises:

outputting the supplemental content before the segment of the show in the second audio/video stream.

4. The method of claim 1, wherein outputting the second audio/video stream for presentation by the display device further comprises:

outputting the supplemental content after the segment of the show in the second audio/video stream.

5. A method for processing a stream of data, the method comprising:

providing a first presentation stream of video data including at least one segment of a show and at least one interstitial of the show;

receiving location information referencing a location within the first presentation stream, the location information including a text string corresponding to closed captioning data for the first presentation stream;

receiving a signature of a portion of the first presentation stream corresponding with the location, the signature identifying a transition in the video data from a first luminance value for a first frame of the video data to a second luminance value for a second frame of the video data;

receiving search boundary offsets specified relative to the location referenced by the received location information;

processing the closed captioning data to locate an instance of the text string in the closed captioning data;

identifying an intermediate video location within the first presentation stream, the identified intermediate video location corresponding to the instance of the text string located in the closed captioning data;

identifying search boundaries within the first presentation stream by applying the search boundary offsets to the identified intermediate video location;

computing average luminance values for a plurality of frames of the video data of the first presentation stream, wherein the plurality of frames are within the search boundaries;

processing the average luminance values to identify the transition from the first luminance value to the second luminance value based on the signature, the transition corresponding with a signature-based video location within the first presentation stream;

processing the first presentation stream to identify boundaries of the segment of the show based on the signature-based video location and the at least one segment boundary offset;

identifying supplemental content to present in association with the segment of the show; and

outputting a second presentation stream for presentation on a presentation device, the second presentation stream including the segment of the show and the supplemental content, wherein the outputting uses the identified boundaries of the segment of the show.

6. The method of claim 5, wherein receiving the location information, the signature and the at least one off-set further comprise:

receiving the location information, in association with the signature and the search boundary offsets, separately from the first presentation stream.

7. An apparatus comprising:

a communication interface that receives a first presentation stream of video data including a segment of a show, an interstitial of the show, and that receives location information referencing a location within the first presentation stream, a signature of a portion of the first presentation stream corresponding with the location, and search boundary offsets specified relative to the location referenced by the received location information, the signature identifying a transition in the video data from a first luminance value for a first frame of the video data to a second luminance value for a second frame of the video data, wherein the location information also includes a text string corresponding to closed captioning data for the first presentation stream;

control logic communicatively coupled to the communication interface configured to;

process the first presentation stream to identify search boundaries within the first presentation stream based on the closed captioning data, the location information, and the search boundary offsets;

compute average luminance values for a plurality of frames of the video data of the first presentation stream, wherein the plurality of frames are within the identified search boundaries;

process the average luminance values to identify the transition from the first luminance value to the second luminance value based on the signature, the transition corresponding with a signature-based video location within the first presentation stream;

process the first presentation stream to identify boundaries of the segment of the show based on the signature-based video location and the at least one segment boundary offset;

identify supplemental content to present in association with the segment of the show; and

an audio/video interface that outputs a second presentation stream for presentation by a presentation device, the second presentation stream including the segment of the show and the supplemental content, wherein the audio/video interface uses the identified boundaries of the segment of the show to output the second presentation stream.

8. The apparatus of claim 7, wherein the communication interface receives the location information, in association with the signature and the search boundary offsets, separately from the first presentation stream.

9. A digital video recorder comprising:

a communication interface that receives a first audio/video stream including a segment of a show, an interstitial of the show, and closed captioning data, and that receives location information for the first audio/video stream, the location information including a text string associated with a particular video location within the first audio/video stream, and the location information including search boundary offsets relative to the particular video location, and that receives a signature of a portion of the first audio/video stream, wherein the signature refers to waveform characteristics of the portion of the first audio/video stream;

a storage medium;

control logic communicatively coupled to the communication interface and the storage medium that;

processes the closed captioning data to locate an instance of the text string in the closed captioning data, and to locate a beginning of the instance of the text string in the closed captioning data;

identifies an intermediate video location in the first audio/video stream, the identified intermediate video location corresponding to the beginning of the text string located in the closed captioning data;

identifies search boundaries within the first audio/video stream by applying the search boundary offsets to the identified intermediate video location;

processes content of the first audio/video stream within the identified search boundaries, wherein the content of the first audio/video stream is processed to search for the signature to identify a signature-based video location in the first audio/video stream;

locates boundaries of the segment of the show by applying segment boundary offsets to the identified signature-based video location; and

identifies supplemental content for presentation in association with the segment of the show; and

an audio/video interface communicatively coupled to the control logic that outputs a second audio/video stream for presentation by a display device, the second audio/video stream including the segment of the show and the supplemental content, wherein the audio/video interface uses the identified boundaries of the segment of the show to output the second audio/video stream.

10. The digital video recorder of claim 9, wherein the control logic identifies the supplemental content based on user viewing characteristics.

11. The digital video recorder of claim 9, wherein the control logic identifies the supplemental content based on characteristics of the segment of the show.

12. The digital video recorder of claim 9, wherein the control logic identifies the supplemental content based on characteristics of the interstitial.