Creating and viewing customized multimedia segments

• US 9,106,949 B2
• Filed: 01/15/2011
• Issued: 08/11/2015
• Est. Priority Date: 06/22/2006
• Status: Active Grant

• Current Assignee: TiVo Solutions Inc. (Adeia Inc.)
• Original Assignee: TiVo Inc. (Adeia Inc.)
• Inventors: Smith, Kevin P., Stevens, Paul, Feder, Adam, Barton, James M.
• Primary Examiner(s): DUFFIELD, JEREMY S
• Application Number:
  US13/007,619
• Publication Number:
  US 20110110646A1
• Time in Patent Office: 1,669 Days
• Field of Search: 725135-142
• US Class Current: 1/1
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: H04H 20/31 using in-band signals, e.g. subsonic or cue signal
• CPC Class Codes: H04H 60/13 Arrangements for device control affected by the broadcast information
• CPC Class Codes: H04H 60/27 Arrangements for recording or accumulating broadcast information or broadcast-related information
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/73 using meta-information
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/43 Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware real-time communication protocols in data switching networks H04L65/00
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/433 Content storage operation, e.g. storage operation in response to a pause request, caching operations
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/47214 for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8545 : for generating interactive applications
• CPC Class Codes: H04N 21/858 : Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
• CPC Class Codes: H04N 5/782 : on tape
• CPC Class Codes: H04N 7/0885 : for the transmission of subtitles

Abstract

A system for creating and viewing customized multimedia segments allows a user to create event identification data from in-band data in a program stream. The in-band data is processed and compiled into event identification data associated with the content stream. The event identification data identifies patterns or sequences of in-band data associated with events in the content stream. Metadata are also included in the event identification data. The event identification data is provided to multimedia devices which receive multimedia content streams containing content streams with in-band data. The in-band data are parsed and compared to the event identification data. If a match occurs, the multimedia device uses the metadata to identify events or perform specified actions.

Claims

1. A method comprising:

receiving, during a playback or a recording of a content stream comprising an in-band data stream, input selecting a location in the content stream;

in response to receiving the input selecting the location in the content stream;

generating a sequence of at least two hash values from a portion of the in-band data stream preceding the selected location within the content stream;

determining at least one time offset value representing a difference between a first time value associated with one hash value of the sequence of at least two hash values and a second time value associated with another hash value of the sequence of at least two hash values; and

storing location identification data comprising the sequence of at least two hash values and the at least one time offset value.

2. The method of claim 1, wherein the content stream comprises a plurality of sub-streams, one sub-stream of the plurality of sub-streams comprising the in-band data.

3. The method of claim 1, further comprising:

in response to receiving the input selecting the location in the content stream, determining a timestamp indicating the location within the content stream.

4. The method of claim 1, further comprising:

receiving input indicating an action or event associated with the location within the content stream;

determining metadata that represents the action or event; and

storing the location identification data comprising the metadata.

5. A method comprising:

during a playback or a recording of a content stream comprising an in-band data stream;

receiving first input selecting a first location within the content stream;

generating a first sequence of at least two hash values from a first portion of the in-band data stream preceding the first location within the content stream;

determining at least one first time offset value representing a difference between a first time value associated with one hash value of the first sequence of at least two hash values and a second time value associated with another hash value of the first sequence of at least two hash values;

receiving second input selecting a second location within the content stream;

generating a second sequence of at least two hash values from a second portion of the in-band data stream preceding the second location in the content stream;

determining at least one second time offset representing a difference between a third time value associated with one hash value of the second sequence of at least two second hash values and a fourth time value associated with another hash value of the second sequence of at least two hash values;

storing segment identification data comprising the first sequence of at least two hash values, the second sequence of at least two hash values, the at least one first time offset, and the at least one second time offset.

6. The method of claim 5, further comprising:

receiving input indicating an action or event associated with a segment of the content stream defined by the first location and the second location;

determining-metadata that represents the action or event; and

storing the segment identification data comprising the metadata.

7. The method of claim 6, wherein the action or event indicates that the segment, when identified in a content stream based at least in part upon the segment identification data, is to be skipped.

8. The method of claim 6, wherein the action or event indicates that the segment, when identified in a content stream based at least in part upon the segment identification data, is to be stored.

9. An apparatus comprising:

a subsystem, implemented at least partially in hardware, that receives, during a playback or a recording of a content stream comprising an in-band data stream, input selecting a location in the content stream;

a subsystem, implemented at least partially in hardware, that, in response to receiving the input selecting the location in the content stream;

generates a sequence of at least two hash values from a portion of the in-band data stream preceding the selected location within the content stream;

determines at least one time offset value representing a difference between a first time value associated with one hash value of the sequence of at least two hash values and a second time value associated with another hash value of the sequence of at least two hash values; and

in response to receiving the input selecting the location, stores location identification data comprising the sequence of at least two hash values and the at least one time offset value.

10. The apparatus of claim 9, wherein the content stream comprises a plurality of sub-streams, one sub-stream of the plurality of sub-streams comprising the in-band data.

11. The apparatus of claim 9, further comprising:

a subsystem, implemented at least partially in hardware, that, in response to receiving the input selecting the location in the content stream, determines a timestamp indicating the location within the content stream.

12. The apparatus of claim 9, further comprising:

a subsystem, implemented at least partially in hardware, that receives input indicating an action or event associated with the location within the content stream;

a subsystem, implemented at least partially in hardware, that determines metadata that represents the action or event; and

a subsystem, implemented at least partially in hardware, that stores the location identification data comprising the metadata.

13. An apparatus comprising:

during a playback or a recording of a content stream comprising an in-band data stream;

a subsystem, implemented at least partially in hardware, that receives first input selecting a first location within the content stream;

a subsystem, implemented at least partially in hardware, that generates a first sequence of at least two hash values from a first portion of the in-band data stream preceding the first location within the content stream;

a subsystem, implemented at least partially in hardware, that determines at least one first time offset value representing a difference between a first time value associated with one hash value of the first sequence of at least two hash values and a second time value associated with another hash value of the first sequence of at least two hash values;

a subsystem, implemented at least partially in hardware, that receives second input selecting a second location within the content stream;

a subsystem, implemented at least partially in hardware, generates a second sequence of at least two hash values from a second portion of the in-band data stream preceding the second location in the content stream;

a subsystem, implemented at least partially in hardware, that determines at least one second time offset representing a difference between a third time value associated with one hash value of the second sequence of at least two second hash values and a fourth time value associated with another hash value of the second sequence of at least two hash values;

a subsystem, implemented at least partially in hardware, that stores segment identification data comprising the first sequence of at least two hash values, the second sequence of at least two hash values, the at least one first time offset, and the at least one second time offset.

14. The apparatus of claim 13, further comprising:

a subsystem, implemented at least partially in hardware, that receives input indicating an action or event associated with a segment of the content stream defined by the first location and the second location;

a subsystem, implemented at least partially in hardware, that determines metadata that represents the action or event; and

a subsystem, implemented at least partially in hardware, that stores the segment identification data comprising the metadata.

15. The apparatus of claim 14, wherein the action or event indicates that the segment, when identified in a content stream based at least in part upon the segment identification data, is to be skipped.

16. The apparatus of claim 14, wherein the action or event indicates that the segment, when identified in a content stream based at least in part upon the segment identification data, is to be stored.

17. A computer-readable non-transitory medium having computer-executable instructions thereon implementing a method comprising:

receiving, during a playback or a recording of a content stream comprising an in-band data stream, input selecting a location in the content stream;

in response to receiving the input selecting the location in the content stream;

generating a sequence of at least two hash values from a portion of the in-band data stream preceding the selected location within the content stream;

determining at least one time offset value representing a difference between a first time value associated with one hash value of the sequence of at least two hash values and a second time value associated with another hash value of the sequence of at least two hash values; and

storing location identification data comprising the sequence of at least two hash values and the at least one time offset value.

18. The medium of claim 17, wherein the content stream comprises a plurality of sub-streams, one sub-stream of the plurality of sub-streams comprising the in-band data.

19. The medium of claim 17, further comprising:

in response to receiving the input selecting the location in the content stream, determining a timestamp indicating the location within the content stream.

20. The medium of claim 17, further comprising:

receiving input indicating an action or event associated with the location within the content stream;

determining metadata that represents the action or event; and

storing the location identification data comprising the metadata.

21. A computer-readable non-transitory medium having computer-executable instructions thereon implementing a method comprising:

during a playback or a recording of a content stream comprising an in-band data stream;

receiving first input selecting a first location within the content stream;

generating a first sequence of at least two hash values from a first portion of the in-band data stream preceding the first location within the content stream;

determining at least one first time offset value representing a difference between a first time value associated with one hash value of the first sequence of at least two hash values and a second time value associated with another hash value of the first sequence of at least two hash values;

receiving second input selecting a second location within the content stream;

generating a second sequence of at least two hash values from a second portion of the in-band data stream preceding the second location in the content stream;

determining at least one second time offset representing a difference between a third time value associated with one hash value of the second sequence of at least two second hash values and a fourth time value associated with another hash value of the second sequence of at least two hash values;

storing segment identification data comprising first sequence of at least two hash values, the second sequence of at least two hash values, the at least one first time offset, and the at least one second time offset.

22. The medium of claim 21, further comprising:

receiving input indicating an action or event associated with a segment of the content stream defined by the first location and the second location;

determining metadata that represents the action or event; and

storing the segment identification data comprising the metadata.

23. The medium of claim 22, wherein the action or event indicates that the segment, when identified in a content stream based at least in part upon the segment identification data, is to be skipped.

24. The medium of claim 23, wherein the action or event indicates that the segment, when identified in a content stream based at least in part upon the segment identification data, is to be stored.