System and method for providing user control over repeating objects embedded in a stream

• US 20050066352A1
• Filed: 11/12/2004
• Published: 03/24/2005
• Est. Priority Date: 07/01/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Herley, Cormac
• Granted Patent: US 7,653,921 B2
• Time in Patent Office: Days
• US Class Current: 725/19
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4332 by placing content in organized collections, e.g. local EPG data repository interfaces, Database management systems or updating for information retrieval G06F16/23; details of retrieval of video data and associated meta data in video database G06F16/739
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4756 for rating content, e.g. scoring a recommended movie
• CPC Class Codes: H04N 21/8113 comprising music, e.g. song in MP3 format
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 7/16 Analogue secrecy systems; Analogue subscription systems
• CPC Class Codes: H04N 7/163 by receiver means only
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Many media streams contain “objects” that repeat. Repeating objects in a media stream are defined as any section of non-negligible duration, i.e., a song, video, advertisement, jingle, etc., which would be considered to be a logical unit by a human listener or viewer. An “object controller” identifies such repeating objects as they occur, and provides an interactive user interface for allowing users to specify how individual repeating objects are to be handled either in real time, or upon subsequent occurrences of particular repeating objects. In general, the object controller includes a mechanism for identifying repeating objects, a mechanism for identifying temporal endpoints of those objects, a user interface for specifying actions to be taken when a particular object repeats within a media stream, and, in one embodiment, a buffer having sufficient length to allow for real-time deletion of objects from the media stream without obvious interruption in the str.

Claims

1. A system for controlling repeating media objects a media stream, comprising using a computing device to:

provide a buffered playback of a media stream;

examine the buffered media stream to identify at least one instance when one or more unique media objects repeats in the buffered media stream;

align a portion of the buffered media stream centered around one or more repeating instances of one or more unique media object with portions of the buffered media stream centered around one or more other repeating instances of those unique media objects;

compare the aligned portions of the buffered media stream to determine pairs of temporal endpoints for delimiting one or more repeating instance of one or more unique media object in the media stream; and

automatically perform at least one user specified action associated with one or more repeating instances of particular media objects during the buffered playback of the media stream.

2. The system of claim 1 wherein at the least one action to be taken is specified during the buffered playback of the media stream, said action being automatically associated with one or more successive repeating instances of the media object currently being played at the time that the at least one action is specified.

3. The system of claim 1 further comprising a user interface for specifying the at least one user specified action.

4. The system of claim 3 wherein the user interface is accessed by the user via a remote control device for specifying the at least one user specified action.

5. The system of claim 3 wherein the user interface is accessed by the user via a voice recognition system for specifying the at least one user specified.

6. The system of claim 1 wherein the at least one user specified action includes fast forwarding through a media object during playback of the media stream.

7. The system of claim 1 wherein the at least one user specified action includes slowing playback of the media object during playback of the media stream.

8. The system of claim 1 wherein the at least one user specified action includes changing the media stream during playback of the media stream.

9. The system of claim 1 wherein the at least one user specified action includes adding a media object to a favorites list during playback of the media stream.

10. The system of claim 1 wherein the at least one user specified action includes rating a media object during playback of the media stream.

11. The system of claim 1 wherein the at least one user specified action includes automatically changing a playback volume for particular media objects during playback of the media stream.

12. The system of claim 1 wherein the at least one user specified action includes automatically blanking a display screen when a particular media object is detected during playback of the media stream.

13. The system of claim 1 wherein the at least one user specified action includes skipping to the end of a currently playing media object during playback of the media stream.

14. The system of claim 1 wherein the at least one user specified action includes deleting each repeating instance of a particular media object from the media stream during playback of the media stream.

15. The system of claim 1 wherein the at least one user specified action includes automatically extracting and saving a copy of a currently playing media object during playback of the media stream.

16. The system of claim 1 wherein the at least one user specified action includes limiting a particular media object to a maximum number of repeating occurrences during a predefined period during playback of the media stream.

17. The system of claim 1 wherein the at least one user specified action includes limiting a relative frequency of playback of one or more particular media objects relative to other media objects.

18. The system of claim 1 wherein the at least one user specified action includes automatically replacing particular media objects in the media stream with another previously stored media object during playback of the media stream.

19. The system of claim 1 wherein the at least one user specified action includes automatically jumping from a buffered playback of the media stream to a real-time playback of the media stream during the buffered playback of the media stream.

20. The system of claim 19 wherein the at least one user specified action includes automatically jumping from the real-time playback to the buffered playback of the media stream.

21. The system of claim 1 wherein the at least one user specified action includes rewinding to the beginning of a particular media object during playback.

22. A computer-readable medium having computer executable instructions for controlling repeating media objects within a media stream, comprising steps for:

buffering an incoming media stream for a predetermined period of time;

providing a buffered playback of the buffered media stream;

extracting a segment of the media stream;

comparing the extracted segment of the buffered media stream to the remainder of the currently buffered media stream to identify repeating content in the media stream where at least a part of the extracted segment matches one or more other parts of the media stream;

for at least one instance of repeating content within the currently buffered media stream, aligning a portion of the media stream centered on that instance of repeating content with a portion of the media stream centered on at least one other instance of repeating content;

comparing each of the aligned portions of the media stream to identify a pair of temporal endpoints for defining temporal boundaries of each repeating media object; and

specifying at least one command to be associated with at least one repeating media object, said command to be executed upon each instance of the repeating media object identified within the currently buffered media stream.

23. The computer-readable medium of claim 22 further comprising a step for flagging each portion of the media stream between each pair of temporal endpoints as being identified.

24. The computer-readable medium of claim 23 further comprising a step for continuing to extract new segments of the media stream from one or more portions of the media stream which have not been flagged as being identified, and identifying repeating media objects corresponding to the each extracted segment.

25. The computer-readable medium of claim 22 wherein the media stream is an audio media stream.

26. The computer-readable medium of claim 22 wherein the media stream is a video stream.

27. The computer-readable medium of claim 22 wherein the media objects are any of songs, music, advertisements, video clips, station identifiers, speech, images, and image sequences.

28. The computer-readable medium of claim 22 further comprising a step for storing at least one representative copy of each repeating media object on a computer readable medium.

29. The computer-readable medium of claim 22 further comprising at least one of:

a computer user interface for specifying the at least one command during the buffered playback of the media stream;

a remote control device for specifying the at least one command during the buffered playback of the media stream; and

a voice recognition system for specifying the at least one command during the buffered playback of the media stream.

30. The computer-readable medium of claim 22 wherein specifying the at least one command comprises specifying at least one of:

fast forwarding through a media object during playback of the media stream;

slowing playback of the media object during playback of the media stream;

changing the media stream during playback of the media stream;

adding a media object to a favorites list during playback of the media stream;

rating a media object during playback of the media stream;

automatically changing a playback volume for particular media objects during playback of the media stream;

automatically blanking a display screen when a particular media object is detected during playback of the media stream;

skipping to the end of particular media objects within the media stream during playback of the media stream;

deleting particular media objects from the media stream during playback of the media stream;

extracting and saving a copy of particular media objects from the media stream during playback of the media stream;

limiting a particular media object to a maximum number of occurrences during a predefined period during playback of the media stream;

limiting a relative frequency of playback of one or more particular media objects relative to other media objects;

rewinding to the beginning of a particular media object during playback;

automatically replacing particular media objects in the media stream with another previously stored media object during playback of the media stream;

automatically jumping from a buffered playback of the media stream to a real-time playback of the media stream on the occurrence of one or more predefined events during playback of the media stream;

automatically jumping from a real-time playback to a buffered playback on the occurrence of one or more predefined events; and

user defined actions.

31. A computer-implemented process for controlling repeating media objects within a media stream, comprising:

buffering a media stream providing a playback of the buffered media stream;

on an ongoing basis during playback of the buffered media stream, selecting a portion of the media stream;

sequentially comparing each selected portion of the media stream to subsequent portions of the media stream to identify at least one instance within the buffered media stream wherein a part of the selected portion at least partially matches a part of any of the subsequent portions;

extracting a segment of the buffered media stream centered on the matching part of at least one of the compared portions;

simultaneously aligning two or more of the extracted segments with each other;

determining locations within the media stream of repeating media objects by determining forward and backward points where the simultaneously aligned segments of the media stream diverge; and

automatically performing any command associated with at least one identified repeat instance of particular media objects during playback of the buffered media stream relative to the locations within the media stream of the identified repeating media objects.

32. The computer-implemented process of claim 31 further comprising automatically specifying at least one additional command to be associated with one or more media objects during playback of the at least one media stream.

33. The computer-implemented process of claim 31 further comprising a user interface for manually specifying at least one additional command to be associated with one or more media objects during playback of the at least one media stream.

34. The computer-implemented process of claim 33 wherein the computer user interface is a text-based computer user interface.

35. The computer-implemented process of claim 33 wherein the computer user interface is a graphical computer user interface.

36. The computer-implemented process of claim 33 wherein the user interface includes a remote control device for specifying at least one additional command to be associated with one or more media objects during playback of the at least one media stream.

37. The computer-implemented process of claim 33 wherein the user interface includes a voice recognition system for specifying at least one additional command to be associated with one or more media objects during playback of the at least one media stream.