Closed caption tagging system

• US 8,660,410 B2
• Filed: 02/14/2011
• Issued: 02/25/2014
• Est. Priority Date: 07/30/1998
• Status: Expired due to Fees

• Current Assignee: TiVo Solutions Inc. (Adeia Inc.)
• Original Assignee: TiVo Inc. (Adeia Inc.)
• Inventors: Barton, Jim, Smith, Kevin, Chamberlin, David, Look, Howard
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): Chowdhury, Nigar
• Application Number:
  US13/027,117
• Publication Number:
  US 20110200300A1
• Time in Patent Office: 1,107 Days
• Field of Search: 386/248, 386291-296, 386/241
• US Class Current: 386/291
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/47214 for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8455 : involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/445 : for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 5/76 : Television signal recording
• CPC Class Codes: H04N 5/775 : between a recording apparatus and a television receiver
• CPC Class Codes: H04N 5/781 : on disks or drums
• CPC Class Codes: H04N 5/782 : on tape
• CPC Class Codes: H04N 5/783 : Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/85 : on discs or drums
• CPC Class Codes: H04N 7/088 : the inserted signal being digital
• CPC Class Codes: H04N 7/165 : Centralised control of user terminal subsequent to an upstream request signal H04N7/17345; Registering at central by two-way working H04N7/17309
• CPC Class Codes: H04N 9/79 : Processing of colour television signals in connection with recording
• CPC Class Codes: H04N 9/7921 : for more than one processing mode
• CPC Class Codes: H04N 9/8042 : involving data reduction
• CPC Class Codes: H04N 9/8063 : using time division multiplex of the PCM audio and PCM video signals
• CPC Class Codes: H04N 9/8205 : involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8233 : the additional signal being a character code signal

Abstract

A closed caption tagging system provides a mechanism for inserting tags into an audio or video television broadcast stream prior to or at the time of transmission. The tags contain command and control information that the receiver translates and acts upon. The receiver receives the broadcast stream and detects and processes the tags within the broadcast stream which is stored on a storage device that resides on the receiver. Program material from the broadcast stream is played back to the viewer from the storage device. Tags indicate the start and end points of a program segment. Program segments such as commercials are automatically replaced by the receiver with new program segments that are selected based on various criteria.

Claims

1. A method comprising:

receiving a media stream at a receiver, the media stream comprising at least;

a) a plurality of video frames; and

b) a plurality of video frame-specific tags within the media stream, the video frame-specific tags including at least command and control information instructing the receiver to perform certain actions;

detecting the video frame-specific tags within the media stream, each of the video frame-specific tags specific to a particular video frame of the media stream;

processing the video frame-specific tags within the media stream;

performing one or more appropriate actions in response to the video frame-specific tags within the media stream, based at least on the command and control information instructing the receiver to perform the certain actions.

2. The method of claim 1, further comprising,

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

while displaying program material from the media stream, skipping over at least a portion of the program segment in response to receiving viewer input, based at least on the start point and the end point indicated by the one or more tags.

3. The method of claim 1, further comprising,

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

while displaying program material from the media stream, automatically skipping at least a portion of the program segment based at least on the start point and the end point indicated by the one or more tags.

4. The method of claim 1, wherein the one or more appropriate actions include displaying a menu based at least on specific command and control information included in one or more of the video frame-specific tags.

5. The method of claim 1, wherein the one or more appropriate actions include:

displaying multiple icons;

accepting viewer input information;

scrolling through the multiple icons based on the viewer input information;

selecting a particular icon based on the viewer input information; and

performing an action associated with the selected icon.

6. The method of claim 1, wherein the one or more appropriate actions include:

while displaying program material from the media stream, displaying an icon based at least on information included in one or more of the video frame-specific tags;

while displaying the icon, receiving viewer input information;

in response to receiving the viewer input information while displaying the icon, performing one or more additional actions based on at least a subset of the command and control information;

saving an exit point in the program material prior to performing the one or more additional actions; and

returning to the exit point upon completion of the one or more actions.

7. The method of claim 6, wherein performing the one or more additional actions further comprises:

presenting a plurality of menus for generating a lead; and

forwarding contact information to a third party upon input indicating viewer approval.

8. The method of claim 6, wherein performing the one or more additional actions further comprises:

presenting a plurality of menus for generating a sale of an advertised product or service; and

forwarding purchase information to a proper merchant.

9. The method of claim 6, wherein performing the one or more additional actions further comprises:

presenting a set of program recording options; and

scheduling program material based on recording options selected.

10. The method of claim 6, wherein performing the one or more additional actions further comprises:

presenting content of a Web site'"'"'s Web page based on the viewer input information; and

interacting with the Web site based on the viewer input information.

11. The method of claim 1, wherein the video frame-specific tags allow a system administrator to remotely configure the receiver.

12. The method of claim 1, further comprising:

marking indexes in the media stream based at least on information included in one or more of the video frame-specific tags; and

jumping to an index selected by viewer input.

13. The method of claim 1, further comprising:

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

while rewinding program material from the media stream, without showing the program segment;

detecting an end tag at the end point of the program segment;

in response to detecting the end tag, locating a start tag at the start point of the program segment; and

skipping over or replacing at least a portion of the program segment based on the start tag and the end tag.

14. The method of claim 1, further comprising:

storing the media stream on one or more storage devices coupled to the receiver.

15. The method of claim 1, further comprising:

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

storing the media stream on one or more storage devices coupled to the receiver;

wherein the one or more appropriate actions include replacing or removing the program segment in the stored media stream.

16. The method of claim 1, further comprising:

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

storing the media stream on one or more storage devices coupled to the receiver;

while rewinding program material from the media stream, without showing the program segment;

detecting an end tag at the end point of the program segment;

in response to detecting the end tag, locating a start tag at the start point of the program segment; and

skipping over or replacing at least a portion of the program segment based on the start tag and the end tag.

17. The method of claim 1, further comprising selecting a particular menu, choice, or screen to present in response to a particular video frame-specific tag based upon viewing habits or program preferences.

18. An apparatus comprising:

a module that receives a media stream at a receiver, the media stream comprising at least;

a) a plurality of video frames; and

b) a plurality of video frame-specific tags within the media stream, the video frame-specific tags including at least command and control information instructing the receiver to perform certain actions;

a module that detects the video frame-specific tags within the media stream, each of the video frame-specific tags specific to a particular video frame of the media stream;

a module that processes the video frame-specific tags within the media stream;

a module that causes the apparatus to perform one or more appropriate actions in response to the video frame-specific tags within the media stream, based at least on the command and control information instructing the receiver to perform the certain actions.

19. The apparatus of claim 18, further comprising:

a module that detects at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated video frame specific tags;

a module that, while the apparatus displays program material from the media stream, skips over at least a portion of the program segment in response to receiving viewer input, based at least on the start point and the end point indicated by the one or more tags.

20. The apparatus of claim 18, further comprising:

a module that detects at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated video frame specific tags;

a module that, while the apparatus displays program material from the media stream, automatically skips at least a portion of the program segment based at least on the start point and the end point indicated by the one or more tags.

21. The apparatus of claim 18, wherein the one or more appropriate actions include displaying a menu based at least on specific command and control information included in one or more of the video frame-specific tags.

22. The apparatus of claim 18, wherein the one or more appropriate actions include:

displaying multiple icons;

accepting viewer input information;

scrolling through the multiple icons based on the viewer input information;

selecting a particular icon based on the viewer input information; and

performing an action associated with the selected icon.

23. The apparatus of claim 18, wherein the one or more appropriate actions include:

while displaying program material from the media stream, displaying an icon based at least on information included in one or more of the video frame-specific tags;

while displaying the icon, receiving viewer input information;

in response to receiving the viewer input information while displaying the icon, performing one or more additional actions based on at least a subset of the command and control information;

saving an exit point in the program material prior to performing the one or more additional actions; and

returning to the exit point upon completion of the one or more actions.

24. The apparatus of claim 23, wherein performing the one or more additional actions further comprises:

presenting a plurality of menus for generating a lead; and

forwarding contact information to a third party upon input indicating viewer approval.

25. The apparatus of claim 23, wherein performing the one or more additional actions further comprises:

presenting a plurality of menus for generating a sale of an advertised product or service; and

forwarding purchase information to a proper merchant.

26. The apparatus of claim 23, wherein performing the one or more additional actions further comprises:

presenting a set of program recording options; and

scheduling program material based on recording options selected.

27. The apparatus of claim 23, wherein performing the one or more additional actions further comprises:

presenting content of a Web site'"'"'s Web page based on the viewer input information; and

interacting with the Web site based on the viewer input information.

28. The apparatus of claim 18, wherein the video frame-specific tags allow a system administrator to remotely configure the receiver.

29. The apparatus of claim 18, further comprising a module that marks indexes in the media stream based at least on information included in one or more of the video frame-specific tags, and jumps to an index selected by viewer input.

30. The apparatus of claim 18, further comprising:

a module that detects at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated video frame specific tags;

a module that, while the apparatus rewinds program material from the media stream, without showing the program segment;

detecting an end tag at the end point of the program segment;

in response to detecting the end tag, locating a start tag at the start point of the program segment; and

skipping over or replacing at least a portion of the program segment based on the start tag and the end tag.

31. The apparatus of claim 18, further comprising:

a module that stores the media stream on one or more storage devices coupled to the receiver.

32. The apparatus of claim 18, further comprising:

a module that detects at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated video frame specific tags;

a module that stores the media stream on one or more storage devices coupled to the receiver;

wherein the one or more appropriate actions include replacing or removing the program segment in the stored media stream.

33. The apparatus of claim 18, further comprising:

a module that detects at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated video frame specific tags;

a module that stores the media stream on one or more storage devices coupled to the receiver;

a module that, while rewinding program material from the media stream, without showing the program segment;

detects an end tag at the end point of the program segment;

in response to detecting the end tag, locates a start tag at the start point of the program segment; and

skipping over or replacing at least a portion of the program segment based on the start tag and the end tag.

34. The apparatus of claim 18, further comprising:

a module that selects a particular menu, choice, or screen to present in response to a particular video frame-specific tag based upon viewing habits or program preferences.

35. One or more non-transitory storage media storing instructions that, when executed by one or more computing devices, cause performance of:

receiving a media stream at a receiver, the media stream comprising at least;

a) a plurality of video frames; and

b) a plurality of video frame-specific tags within the media stream, the video frame-specific tags including at least command and control information instructing the receiver to perform certain actions;

detecting the video frame-specific tags within the media stream, each of the video frame-specific tags specific to a particular video frame of the media stream;

processing the video frame-specific tags within the media stream;

performing one or more appropriate actions in response to the video frame-specific tags within the media stream, based at least on the command and control information instructing the receiver to perform the certain actions.

36. The one or more non-transitory storage media of claim 35, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

while displaying program material from the media stream, skipping over at least a portion of the program segment in response to receiving viewer input, based at least on the start point and the end point indicated by the one or more tags.

37. The one or more non-transitory storage media of claim 35, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

while displaying program material from the media stream, automatically skipping at least a portion of the program segment based at least on the start point and the end point indicated by the one or more tags.

38. The one or more non-transitory storage media of claim 35, wherein the one or more appropriate actions include displaying a menu based at least on specific command and control information included in one or more of the video frame-specific tags.

39. The one or more non-transitory storage media of claim 35, wherein the one or more appropriate actions include:

displaying multiple icons;

accepting viewer input information;

scrolling through the multiple icons based on the viewer input information;

selecting a particular icon based on the viewer input information; and

performing an action associated with the selected icon.

40. The one or more non-transitory storage media of claim 35, wherein the one or more appropriate actions include:

while displaying program material from the media stream, displaying an icon based at least on information included in one or more of the video frame-specific tags;

while displaying the icon, receiving viewer input information;

in response to receiving the viewer input information while displaying the icon, performing one or more additional actions based on at least a subset of the command and control information;

saving an exit point in the program material prior to performing the one or more additional actions; and

returning to the exit point upon completion of the one or more actions.

41. The one or more non-transitory storage media of claim 40, wherein performing the one or more additional actions further comprises:

presenting a plurality of menus for generating a lead; and

forwarding contact information to a third party upon input indicating viewer approval.

42. The one or more non-transitory storage media of claim 40, wherein performing the one or more additional actions further comprises:

presenting a plurality of menus for generating a sale of an advertised product or service; and

forwarding purchase information to a proper merchant.

43. The one or more non-transitory storage media of claim 40, wherein performing the one or more additional actions further comprises:

presenting a set of program recording options; and

scheduling program material based on recording options selected.

44. The one or more non-transitory storage media of claim 40, wherein performing the one or more additional actions further comprises:

presenting content of a Web site'"'"'s Web page based on the viewer input information; and

interacting with the Web site based on the viewer input information.

45. The one or more non-transitory storage media of claim 35, wherein the video frame-specific tags allow a system administrator to remotely configure the receiver.

46. The one or more non-transitory storage media of claim 35, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

marking indexes in the media stream based at least on information included in one or more of the video frame-specific tags; and

jumping to an index selected by viewer input.

47. The one or more non-transitory storage media of claim 35, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

while rewinding program material from the media stream, without showing the program segment;

detecting an end tag at the end point of the program segment;

in response to detecting the end tag, locating a start tag at the start point of the program segment; and

skipping over or replacing at least a portion of the program segment based on the start tag and the end tag.

48. The one or more non-transitory storage media of claim 35, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

storing the media stream on one or more storage devices coupled to the receiver.

49. The one or more non-transitory storage media of claim 35, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

storing the media stream on one or more storage devices coupled to the receiver;

wherein the one or more appropriate actions include replacing or removing the program segment in the stored media stream.

50. The one or more non-transitory storage media of claim 35, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

detecting at least a start point and an end point of a program segment within the media stream, the start point and the end point indicated by one or more tags of the video frame specific tags;

storing the media stream on one or more storage devices coupled to the receiver;

while rewinding program material from the media stream, without showing the program segment;

detecting an end tag at the end point of the program segment;

in response to detecting the end tag, locating a start tag at the start point of the program segment; and

skipping over or replacing at least a portion of the program segment based on the start tag and the end tag.

51. The one or more non-transitory storage media of claim 35, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

selecting a particular menu, choice, or screen to present in response to a particular video frame-specific tag based upon viewing habits or program preferences.