Extensible content identification and indexing

• US 20060218617A1
• Filed: 03/22/2005
• Published: 09/28/2006
• Est. Priority Date: 03/22/2005
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Kotzenberg, Bernhard G., Pritchett, Thaddeus C., Bradstreet, John, Gates, Matthijs A., Hofmeyr, Jan M.
• Application Number:
  US11/086,147
• Publication Number:
  US 20060218617A1
• Time in Patent Office: Days
• US Class Current: 725/135
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/466 Learning process for intelligent management, e.g. learning user preferences for recommending movies services using the results of monitoring in broadcast systems H04H60/61
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/775 between a recording apparatus and a television receiver
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 7/163 by receiver means only
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

Innovative techniques for identifying and distinguishing content, such as commercials, can be used with means for marking key frames within the commercials to facilitate replacement of commercials and other programming segments in such a way as to provide improved focus and relevance for targeted advertising based on known and/or dynamic conditions. The identification of commercial features can also be used to provide improved trick play functionality while the commercial or other programming is rendered.

Claims

1. A method for rendering programming with intelligent identification and indexing comprising:

receiving programming that includes at least one scene that is associated with a tag that includes at least a first portion that references identifying features of the television scene, including at least a beginning portion of the television scene;

processing the programming to decrypt the first portion when the first portion is encrypted and to access the identifying features;

processing the programming to determine whether it is appropriate to replace or modify the scene; and

upon determining it is appropriate to replace or modify the scene, identifying and obtaining at least one appropriate replacement segment and replacing or modifying the scene with the at least one appropriate replacement segment.

2. A method as recited in claim 1, wherein the tag is received with the programming.

3. A method, as recited in claim 1, where the tag is computed by first analyzing features in the programming and then matching the features to a pattern received prior to the programming

4. A method as recited in claim 1, where the scene is a commercial.

5. A method as recited in claim 2, wherein the tag includes license information corresponding to a license that specifies at least when or how said commercial can be replaced with one or more substitute programming segments.

6. A method as recited in claim 2, wherein processing the programming to determine whether it is appropriate to replace the commercial includes determining whether it is appropriate to replace only a portion of the commercial.

7. A method as recited in claim 2, wherein determining it is appropriate to replace the commercial and identifying and obtaining at least one appropriate replacement segment is based on dynamic factors received independent of the programming.

8. A method as recited in claim 7, wherein synchronization of the at least one appropriate replacement segment is computed by analyzing features in the programming

9. A method as recited in claim 1, wherein determining it is appropriate to replace the scene and identifying and obtaining at least one appropriate replacement segment is based on viewer preferences.

10. A method as recited in claim 1, wherein obtaining at least one appropriate replacement segment includes extracting the at least one appropriate replacement segment from previously received programming.

11. A method as recited in claim 1, wherein receiving said programming includes recording said programming and accessing the programming from memory at a later time, and wherein said scene in the programming comprises a previous replacement segment that was used to replace at least a previous portion of a scene that was in the recorded programming at one time.

12. A method as recited in claim 1, wherein replacing the scene includes replacing said scene without overwriting said scene in the programming with the at least one appropriate replacement segment.

13. A method as recited in claim 1, further including time-shifting the programming to compensate for said at least one appropriate replacement segment being either longer or shorter than said scene.

14. A method as recited in claim 1, wherein the method further includes replacing the scene dynamically while the programming is played.

15. A method as recited in claim 14, wherein the method further includes replacing the scene while the programming is played from a live broadcast.

16. A method as recited in claim 1, wherein the method further includes extracting and storing replacement segments from the programming to be used for subsequent replacement in other programming.

17. A method as recited in claim 1, wherein the method involves modifying some portion of the programming rather than completely replacing it.

18. A computer program product comprising one or more computer-readable media having computer-executable instructions for implementing a method for rendering programming with intelligent identification and indexing, wherein the method comprises:

receiving programming that includes at least one scene that is associated with a tag that includes at least a first portion that references identifying features of the television scene, including at least a beginning portion of the television scene;

processing the programming to decrypt the first portion when the first portion is encrypted and to access the identifying features;

processing the programming to determine whether it is appropriate to replace or modify the scene; and

upon determining it is appropriate to replace or modify the scene, identifying and obtaining at least one appropriate replacement segment, and replacing or modifying the scene with the at least one appropriate replacement segment.

19. A method for rendering programming with intelligent identification and indexing comprising:

receiving programming that includes at least one segment with a beginning point, an ending point and at least one key frame that are all intended to be displayed to a viewer;

processing the programming to identify the key frame and the beginning point of the programming; and

upon receiving instructions to perform trick mode functionality involving the program segment, advancing to and displaying the key frame, as designated by one or more tags associated with the programming.

20. A method as recited in claim 19, further including:

upon receiving user input to play the programming at any point while the segment is being played, rewinding back to and begin playing of the beginning point of the segment.