In-band data recognition and synchronization system

• US 7,661,121 B2
• Filed: 06/22/2006
• Issued: 02/09/2010
• Est. Priority Date: 06/22/2006
• Status: Active Grant

• Current Assignee: TiVo Solutions Inc. (Adeia Inc.)
• Original Assignee: TiVo Inc. (Adeia Inc.)
• Inventors: Smith, Kevin P., Stevens, Paul, Feder, Adam, Barton, James M.
• Primary Examiner(s): SHELEHEDA, JAMES R
• Application Number:
  US11/473,543
• Publication Number:
  US 20070300249A1
• Time in Patent Office: 1,328 Days
• Field of Search: 725/135, 725/136, 725/137
• US Class Current: 725/135
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04H 20/31 using in-band signals, e.g. subsonic or cue signal
• CPC Class Codes: H04H 60/13 Arrangements for device control affected by the broadcast information
• CPC Class Codes: H04H 60/27 Arrangements for recording or accumulating broadcast information or broadcast-related information
• CPC Class Codes: H04H 60/73 using meta-information
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4135 external recorder interface circuits between an apparatus for recording television signals and a television receiver H04N5/775
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/47214 for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/76 : Television signal recording
• CPC Class Codes: H04N 5/765 : Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/85 : on discs or drums
• CPC Class Codes: H04N 5/907 : using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence
• CPC Class Codes: H04N 9/8205 : involving the multiplexing of an additional signal and the colour video signal

Abstract

A method and apparatus for recognizing and synchronizing to in-band data at a multimedia device is provided. A content stream includes in-band data. The in-band data is processed and in-band data pattern data associated with the content stream are created. Metadata are attached to the event identification data. The event identification data are provided to multimedia devices which receive broadcasted multimedia content streams containing video programs with in-band data. The in-band data are processed and compared to the event identification data. If a match occurs, the multimedia device uses the metadata to perform specified actions.

Claims

1. A method for processing in-band data, comprising:

receiving a multimedia content stream, wherein the multimedia content stream contains in-band data;

processing the in-band data, including computing at least two hash values from the in-band data and a time period between generation of the at least two computed hash values;

determining that the at least two computed hash values and the time period between generation of the at least two computed hash values match, within a margin of error, a particular pattern associated with one or more events; and

performing the one or more events responsive to determining that the particular pattern is matched within the margin of error,

wherein the method is performed by a multimedia device comprising one or more processors.

2. The method of claim 1, wherein the in-band data is closed-caption data.

3. The method of claim 1, wherein the in-band data is Enhanced Television (ETV) signaling data.

4. The method of claim 1, wherein performing the one or more events comprises displaying an icon to a user on a display screen as the multimedia content stream is displayed to a user.

5. The method of claim 1, further comprising the step of:

in response to determining that the particular pattern associated with the one or more events is matched, storing one or more segments of the multimedia content stream on the multimedia device that are related to the one or more identified events.

6. The method of claim 1, wherein the determining step further comprises:

processing metadata associated with the matched particular pattern.

7. The method of claim 6, wherein the metadata instructs the multimedia device to perform an action.

8. The method of claim 6, wherein the metadata instructs the multimedia device to skip over a segment of the multimedia content stream.

9. The method of claim 6, wherein the metadata instructs the multimedia device to re-order two or more segments of the multimedia content stream.

10. The method of claim 9, further comprising:

creating, at the multimedia device, a customized multimedia content stream containing the two or more re-ordered segments; and

displaying the customized multimedia content stream to a user.

11. The method of claim 6, wherein metadata associated with the matched particular pattern instructs the multimedia device to store one or more segments of the content stream on a storage device, and wherein the storage device contains one or more extracted segments from one or more different content streams.

12. The method of claim 11, further comprising:

creating, at the multimedia device, a customized multimedia content stream containing any combinations of segments stored on the storage device; and

displaying the customized content stream to a user.

13. The method of claim 1, wherein a user can skip to an identified event.

14. The method of claim 1, further comprising:

receiving event identification data associating one or more patterns of in-band data with one or more events; and

storing the received event identification data on a storage device as part of the plurality of patterns.

15. The method of claim 14, wherein the storage device is a hard disk drive.

16. The method of claim 14, wherein the storage device is any type of removable storage media.

17. The method of claim 14, wherein the storage device is any type of volatile and/or non-volatile storage medium.

18. The method of claim 1, wherein the multimedia content stream is a television broadcast stream.

19. An apparatus for processing in-band data at a multimedia device, comprising:

one or more processors;

a module for receiving a multimedia content stream, wherein the multimedia content stream contains in-band data;

a module for processing the in-band data, wherein the module for processing in-band data computes at least two hash values from the in-band data and a time period between generation of the at least two computed hash values;

a module for determining that the at least two computed hash values and the time period between generation of the at least two computed hash values match, within a margin of error, a particular pattern associated with one or more events; and

a module for performing the one or more events responsive to determining that the particular pattern is matched.

20. The apparatus of claim 19, wherein the in-band data is closed-caption data.

21. The apparatus of claim 19, wherein the in-band data is Enhanced Television (ETV) signaling data.

22. The apparatus of claim 19, wherein performing the one or more events comprises displaying an icon to a user on a display screen as the multimedia content stream is displayed to a user.

23. The apparatus of claim 19, further comprising:

a module for, in response to determining that the particular pattern associated with the one or more events is matched, storing one or more segments of the multimedia content stream on the multimedia device that are related to the one or more identified events.

24. The apparatus of claim 19, wherein the module for determining further comprises:

a module for processing metadata associated with the matched particular pattern.

25. The apparatus of claim 24, wherein the metadata instructs the multimedia device to perform an action.

26. The apparatus of claim 24, wherein the metadata instructs the multimedia device to skip over a segment of the multimedia content stream.

27. The apparatus of claim 24, wherein the metadata instructs the multimedia device to re-order two or more segments of the multimedia content stream.

28. The apparatus of claim 27, further comprising:

a module for creating, at the multimedia device, a customized multimedia content stream containing the two or more re-ordered segments; and

a module for displaying the customized multimedia content stream to a user.

29. The apparatus of claim 24, wherein metadata associated with the matched particular pattern instructs the second device to store one or more segments of the second content stream on a storage device, and wherein the storage device contains one or more extracted segments from one or more different content streams.

30. The apparatus of claim 29, further comprising:

a module for creating, at the multimedia device, a customized multimedia content stream containing any combination of segments stored on the storage device; and

a module for displaying the customized content stream to a user.

31. The apparatus of claim 19, wherein a user can skip to an identified event.

32. The apparatus of claim 19, further comprising:

a module for receiving event identification data associating one or more patterns of in-band data with one or more events; and

a module for storing the received event identification data on a storage device as part of the plurality of patterns.

33. The apparatus of claim 32, wherein the storage device is a hard disk drive.

34. The apparatus of claim 32, wherein the storage device is any type of removable storage media.

35. The apparatus of claim 32, wherein the storage device is any type of volatile and/or non-volatile storage medium.

36. The apparatus of claim 19, wherein the multimedia content stream is a television broadcast stream.

37. A computer-readable storage medium carrying one or more sequences of instructions for processing in-band data at a multimedia device, which instructions, when executed by one or more processors, cause the one or more processors to carry out the steps of:

receiving a multimedia content stream, wherein the multimedia content stream contains in-band data;

processing the in-band data, including computing at least two hash values from the in-band data and a time period between generation of the at least two computed hash values;

determining that the at least two computed hash values and the time period between generation of the at least two computed hash values match, within a margin of error, a particular pattern associated with one or more events; and

performing the one or more events responsive to determining that the particular pattern is matched within the margin of error.

38. The computer-readable storage medium of claim 37, wherein the in-band data is closed-caption data.

39. The computer-readable storage medium of claim 37, wherein the in-band data is Enhanced Television (ETV) signaling data.

40. The computer-readable storage medium of claim 37, wherein performing the one or more events comprises displaying an icon to a user on a display screen as the content stream is displayed to a user.

41. The computer-readable storage medium of claim 37, further comprising instructions for:

in response to determining that the particular pattern associated with the one or more events is matched, storing one or more segments of the multimedia content stream on the multimedia device that are related to the one or more identified events.

42. The computer-readable storage medium of claim 37, wherein the determining step further comprises:

processing metadata associated with the matched particular pattern.

43. The computer-readable storage medium of claim 42, wherein the metadata instructs the multimedia device to perform an action.

44. The computer-readable storage medium of claim 42, wherein the metadata instructs the multimedia device to skip over a segment of the multimedia content stream.

45. The computer-readable storage medium of claim 42, wherein the metadata instructs the multimedia device to re-order two or more segments of the multimedia content stream.

46. The computer-readable storage medium of claim 45, further comprising instructions for:

creating, at the multimedia device, a customized multimedia content stream containing the two or more re-ordered segments; and

displaying the customized multimedia content stream to a user.

47. The computer-readable storage medium of claim 42, wherein metadata associated with the matched particular pattern instructs the multimedia device to store one or more segments of the content stream on a storage device, and wherein the storage device contains one or more extracted segments from one or more different content streams.

48. The computer-readable storage medium of claim 47, further comprising instructions for:

creating, at the multimedia device, a customized multimedia content stream containing any combination of segments stored on the storage device; and

displaying the customized content stream to a user.

49. The computer-readable storage medium of claim 37, wherein a user can skip to an identified event.

50. The computer-readable storage medium of claim 37, further comprising instructions for:

receiving event identification data associating one or more patterns of in-band data with one or more events; and

storing the received event identification data on a storage device as part of the plurality of patterns.

51. The computer-readable storage medium of claim 50, wherein the storage device is a hard disk drive.

52. The computer-readable storage medium of claim 50, wherein the storage device is any type of removable storage media.

53. The computer-readable storage medium of claim 50, wherein the storage device is any type of volatile and/or non-volatile storage medium.

54. The computer-readable storage medium of claim 37, wherein the multimedia content stream is a television broadcast stream.

55. A method for processing in-band data, comprising:

reading a multimedia content stream from a removable storage medium, wherein the multimedia content stream contains in-band data;

processing the in-band data, including computing at least two hash values from the in-band data and a time period between generation of the at least two computed hash values;

determining that the at least two computed hash values and the time period between generation of the at least two computed hash values match, within a margin of error, a particular pattern associated with one or more events; and

performing the one or more events responsive to determining that the particular pattern is matched within the margin of error,

wherein the method is performed by a multimedia device comprising one or more processors.

56. The method of claim 55, wherein the in-band data is closed-caption data.

57. The method of claim 55, wherein the in-band data is Enhanced Television (ETV) signaling data.

58. The method of claim 55, wherein performing the one or more events comprises displaying an icon to a user on a display screen as the multimedia content stream is displayed to a user.

59. The method of claim 55, wherein the determining step further comprises:

processing metadata associated with the matched particular pattern.

60. The method of claim 59, wherein the metadata instructs the multimedia device to perform an action.

61. The method of claim 59, wherein the metadata instructs the multimedia device to skip over a segment of the multimedia content stream.

62. The method of claim 59, wherein the metadata instructs the multimedia device to re-arrange two or more segments of the multimedia content stream.

63. The method of claim 62, wherein the multimedia device re-arranges the two or more segments into a customized multimedia content stream.

64. The method of claim 63, further comprising:

creating, at the multimedia device, a customized multimedia content stream containing the two or more re-ordered segments; and

displaying the customized multimedia content stream to a user.

65. The method of claim 59, wherein metadata associated with the matched particular pattern instructs the multimedia device to store one or more segments of the content stream on a storage device, and wherein the storage device contains one or more extracted segments from one or more different content streams.

66. The method of claim 65, further comprising:

creating, at the multimedia device, a customized multimedia content stream containing any combination of segments stored on the storage device; and

displaying the customized content stream to a user.

67. The method of claim 55, further comprising:

receiving event identification data associating one or more patterns of in-band data with one or more events; and

storing the received event identification data on a storage device as part of the plurality of patterns.

68. The method of claim 67, wherein the storage device is a hard disk drive.

69. The method of claim 67, wherein the storage device is any type of removable storage media.

70. The method of claim 67, wherein the storage device is any type of volatile and/or non-volatile storage medium.

71. The method of claim 55, wherein the multimedia content stream is a television broadcast stream.

72. An apparatus for processing in-band data at a multimedia device, comprising:

one or more processors;

a module for reading a multimedia content stream from a removable storage medium, wherein the multimedia content stream contains in-band data;

a module for processing the in-band data, wherein the module for processing the in-band data computes at least two hash values from the in-band data and a time period between generation of the at least hash values;

a module for determining that the at least two computed hash values and the time period between generation of the at least two hash values match, within a margin of error, a particular pattern associated with one or more events; and

a module for performing the one or more events responsive to determining that the particular pattern is matched within the margin of error.

73. The apparatus of claim 72, wherein the in-band data is closed-caption data.

74. The apparatus of claim 72, wherein the in-band data is Enhanced Television (ETV) signaling data.

75. The apparatus of claim 72, wherein performing the one or more events comprises displaying an icon to a user on a display screen as the multimedia content stream is displayed to a user.

76. The apparatus of claim 72, wherein the module for determining further comprises:

a module for processing metadata associated with the matched particular pattern.

77. The apparatus of claim 76, wherein the metadata instructs the multimedia device to perform an action.

78. The apparatus of claim 76, wherein the metadata instructs the multimedia device to skip over a segment of the multimedia content stream.

79. The apparatus of claim 76, wherein the metadata instructs the multimedia device to re-order two or more segments of the multimedia content stream.

80. The apparatus of claim 79, further comprising:

a module for creating, at the multimedia device, a customized multimedia content stream containing the two or more re-ordered segments; and

a module for displaying the customized multimedia content stream to a user.

81. The apparatus of claim 76, wherein metadata associated with the matched particular pattern instructs the multimedia device to store one or more segments of the content stream on a storage device, and wherein the storage device contains one or more extracted segments from one or more different content streams.

82. The apparatus of claim 81, further comprising:

a module for creating, at the multimedia device, a customized multimedia content stream containing any combination of segments stored on the storage device; and

a module for displaying the customized content stream to a user.

83. The apparatus of claim 72, wherein a user can skip to an identified event.

84. The apparatus of claim 72, further comprising:

a module for receiving event identification data associating one or more patterns of in-band data with one or more events; and

a module for storing the received event identification data on a storage device as part of the plurality of patterns.

85. The apparatus of claim 84, wherein the storage device is a hard disk drive.

86. The apparatus of claim 84, wherein the storage device is any type of removable storage media.

87. The apparatus of claim 84, wherein the storage device is any type of volatile and/or non-volatile storage medium.

88. The apparatus of claim 72, wherein the multimedia content stream is a television broadcast stream.