Multimedia time warping system

• US 20050132418A1
• Filed: 02/04/2005
• Published: 06/16/2005
• Est. Priority Date: 07/30/1998
• Status: Abandoned Application

• Current Assignee: TiVo Solutions Inc. (Adeia Inc.)
• Original Assignee: TiVo Inc. (Adeia Inc.)
• Inventors: Barton, James M., Goodman, Andrew Martin, Moskowitz, Alan S., McInnis, Roderick James, Chow, Ching Tong, Kao, Jean Swey
• Application Number:
  US11/051,347
• Publication Number:
  US 20050132418A1
• Time in Patent Office: Days
• US Class Current: 725/134
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G11B 2220/216 Rewritable discs
• CPC Class Codes: G11B 2220/2562 DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
• CPC Class Codes: G11B 2220/2575 DVD-RAMs
• CPC Class Codes: G11B 2220/455 said record carriers being in one device and being used as primary and secondary/backup media, e.g. HDD-DVD combo device, or as source and target media, e.g. PC and portable player
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/002 Programmed access in sequence to a plurality of record carriers or indexed parts, e.g. tracks, thereof, e.g. for editing; transfer of record carriers from magazine G11B15/68, G11B17/10; G11B17/22
• CPC Class Codes: G11B 27/024 on tapes G11B27/028, G11B27/029 take precedence
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/032 on tapes G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/3027 used signal is digitally coded
• CPC Class Codes: G11B 27/3054 Vertical Interval Time code [VITC]
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/42615 involving specific demultiplexing arrangements
• CPC Class Codes: H04N 21/4263 involving specific tuning arrangements, e.g. two tuners
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/43076 : of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/432 : Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/4334 : Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/4341 : Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/4344 : Remultiplexing of multiplex streams, e.g. by modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/4345 : Extraction or processing of SI, e.g. extracting service information from an MPEG stream
• CPC Class Codes: H04N 21/4402 : involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/440281 : by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783
• CPC Class Codes: H04N 21/4532 : involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 : Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/472 : End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/47214 : for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4884 : for displaying subtitles
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8547 : involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/76 : Television signal recording
• CPC Class Codes: H04N 5/775 : between a recording apparatus and a television receiver
• CPC Class Codes: H04N 5/781 : on disks or drums
• CPC Class Codes: H04N 5/782 : on tape
• CPC Class Codes: H04N 5/783 : Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 9/7921 : for more than one processing mode
• CPC Class Codes: H04N 9/8042 : involving data reduction
• CPC Class Codes: H04N 9/8063 : using time division multiplex of the PCM audio and PCM video signals

Abstract

A multimedia time warping system allows the user to store selected television broadcast programs while the user is simultaneously watching or reviewing another program. The system accepts television (TV) input streams in a multitude of forms that are converted to an encoded formatted stream for internal transfer and manipulation and are parsed. Events are recorded that indicate the type of component that has been found, where it is located, and when it occurred. The program logic is notified that an event has occurred and the data is extracted from the buffers. The encoded streams are stored on a storage device and a decoder converts the encoded stream into TV output signals. User control commands affect the flow of the encoded stream.

Claims

1. An apparatus for storage and playback of audiovisual data, comprising:

a local storage device;

a first circuit, coupled to said local storage device, that parses an encoded stream of audiovisual data to generate event data, stores said event data, writes said encoded stream of audiovisual data to said local storage device, and utilizes said event data to facilitate reading said encoded stream of audiovisual data from said local storage device.

2. The apparatus according to claim 1, wherein said local storage device is a hard drive.

3. The apparatus according to claim 1, wherein said first circuit includes a media switch.

4. The apparatus according to claim 2, wherein said first circuit includes a media switch.

5. The apparatus according to claim 1, wherein said first circuit includes a central processing unit.

6. The apparatus according to claim 2, wherein said first circuit includes a central processing unit.

7. The apparatus according to claim 3, wherein said first circuit includes a central processing unit.

8. The apparatus according to claim 4, wherein said first circuit includes a central processing unit.

9. The apparatus according to claim 1, wherein said stream of audiovisual data is an MPEG stream.

10. The apparatus according to claim 2, wherein said stream of audiovisual data is an MPEG stream.

11. The apparatus according to claim 3, wherein said stream of audiovisual data is an MPEG stream.

12. The apparatus according to claim 4, wherein said stream of audiovisual data is an MPEG stream.

13. The apparatus according to claim 5, wherein said stream of audiovisual data is an MPEG stream.

14. The apparatus according to claim 6, wherein said stream of audiovisual data is an MPEG stream.

15. The apparatus according to claim 7, wherein said stream of audiovisual data is an MPEG stream.

16. The apparatus according to claim 8, wherein said stream of audiovisual data is an MPEG stream.

17. The apparatus according to claim 9, wherein said event data comprises data indicating the start of a video I-frame.

18. The apparatus according to claim 10, wherein said event data comprises data indicating the start of a video I-frame.

19. The apparatus according to claim 11, wherein said event data comprises data indicating the start of a video I-frame.

20. The apparatus according to claim 12, wherein said event data comprises data indicating the start of a video I-frame.

21. The apparatus according to claim 13, wherein said event data comprises data indicating the start of a video I-frame.

22. The apparatus according to claim 14, wherein said event data comprises data indicating the start of a video I-frame.

23. The apparatus according to claim 15, wherein said event data comprises data indicating the start of a video I-frame.

24. The apparatus according to claim 16, wherein said event data comprises data indicating the start of a video I-frame.

25. An apparatus for storage and playback of audiovisual data, comprising:

a local storage device;

a control unit; and

a first circuit, coupled to said local storage device and to said control unit, that accepts and parses an encoded stream of audiovisual data to generate event data, writes said event data into an event buffer, transmits said parsed encoded stream of audiovisual data to said local storage device, notifies said control unit when said event data are written into said event buffer, subsequently extracts said parsed encoded stream of audiovisual data from said local storage device, and transmits said extracted encoded stream of audiovisual data to a decoder, wherein said first circuit transmits said parsed encoded stream of audiovisual data to said local storage device autonomously with respect to said control unit.

27. The apparatus of claims 25 or 26, wherein said stream of audiovisual data is an MPEG stream.

28. The apparatus according to claims 25 or 26, wherein said local storage device is a hard drive.

29. The apparatus according to claims 25 or 26, wherein said local storage device is a hard drive and said stream of audiovisual data is an MPEG stream.

30. The apparatus according to claim 27, wherein said event data comprises data indicating the start of a video I-frame.

31. The apparatus according to claim 29, wherein said event data comprises data indicating the start of a video I-frame.

26. An apparatus for storage and playback of audiovisual data, comprising:

a local storage device;

a central processing unit; and

a first circuit, coupled to said local storage device and to said central processing unit, comprising means for accepting an encoded stream of audiovisual data, means for parsing said encoded stream of audiovisual data to generate event data, means for writing said event data into an event buffer, means for transmitting said parsed encoded stream of audiovisual data to said local storage device, means for notifying said control unit when said event data are written to said event buffer, means for subsequently extracting said parsed encoded stream of audiovisual data from said local storage device, and means for transmitting said extracted encoded stream of audiovisual data to a decoder, wherein said first circuit transmits said parsed encoded stream of audiovisual data to said local storage device autonomously with respect to said central processing unit.

32. An apparatus for storage and playback of audiovisual data, comprising:

a local storage device;

a central processing unit; and

a first circuit, coupled to said local storage device and asynchronously coupled to said central processing unit, comprising an input interface module for parsing an MPEG stream to generate event data and for writing said event data into an event buffer, a local storage device interface module for transmitting said parsed MPEG stream to said local storage device and for subsequently extracting said parsed MPEG stream from said local storage device, and an output interface module for transmitting said extracted MPEG stream to a decoder, wherein said first circuit transmits said parsed encoded stream of audiovisual data to said local storage device autonomously with respect to said central processing unit.

33. The apparatus according to claim 32, wherein said local storage device is a hard drive.

34. The apparatus of claim 32 or 33, wherein said central processing unit executes program logic and said first circuit communicates with said program logic via an interrupt mechanism.

35. The apparatus of claim 32, 33, or 34, further comprising a memory, wherein said first circuit further comprises a memory interface module for buffering said parsed MPEG stream into said memory.

36. The apparatus according to claim 32, wherein said event data comprises data indicating the start of a video I-frame.

37. A method for storage and playback of audiovisual data, comprising:

receiving an encoded stream of audiovisual data;

parsing said encoded stream of audiovisual data to generate event data;

writing said event data into an event buffer;

transmitting said encoded stream of audiovisual data from a first circuit to a local storage device;

transmitting said encoded stream of audiovisual data from said local storage device to said first circuit;

storing said encoded stream of audiovisual data in an output buffer; and

varying a flow of said encoded audiovisual data from said output buffer to an output device upon receipt of one or more control commands from a user.

39. The method according to claims 37 or 38, wherein said local storage device is a hard drive.

40. The apparatus according to claims 37 or 38, wherein said stream of audiovisual data is an MPEG stream.

41. The apparatus according to claims 39 or 40, wherein said local storage device is a hard drive and said stream of audiovisual data is an MPEG stream.

42. The method according to claim 37, wherein said control commands comprise any of:

a reverse control command, a play control command, a fast forward control command, or a pause control command.

43. The apparatus according to claim 40, wherein said event data comprises data indicating the start of a video I-frame.

44. The apparatus according to claim 41, wherein said event data comprises data indicating the start of a video I-frame.

38. A method for storage and playback of audiovisual data, comprising:

receiving an encoded stream of audiovisual data;

parsing said encoded stream of audiovisual data to generate event data;

transmitting said encoded stream of audiovisual data from a first circuit to a local storage device; and

utilizing said event data to facilitate subsequently reading said encoded stream of audiovisual data from said local storage device.

45. A method for storage and playback of audiovisual data, comprising:

receiving an encoded stream of audiovisual data;

parsing said encoded stream of audiovisual data to generate event data;

storing said event data in an event buffer;

transmitting said encoded stream of audiovisual data from a first circuit to a local storage device; and

utilizing said stored event data to facilitate subsequently reading said encoded stream of audiovisual data from said local storage device.

47. The method according to claims 45 or 46, wherein said local storage device is a hard drive.

48. The method according to claims 45 or 46, wherein said stream of audiovisual data is an MPEG stream.

49. The method according to claims 45 or 46, wherein said local storage device is a hard drive and said stream of audiovisual data is an MPEG stream.

50. The method according to claims 45 or 46 further comprising the step of buffering said parsed encoded stream of audiovisual data into a memory.

51. The method according to claims 45 or 46, wherein said local storage device is a hard drive and said stream of audiovisual data is an MPEG stream, and further comprising the step of buffering said parsed encoded stream of audiovisual data into a memory.

52. The method according to claim 48, wherein said event data comprises data indicating the start of a video I-frame.

53. The method according to claim 49, wherein said event data comprises data indicating the start of a video I-frame.

54. The method according to claim 51, wherein said event data comprises data indicating the start of a video I-frame.

46. A method for storage and playback of audiovisual data, comprising the steps of:

accepting an encoded stream of audiovisual data;

parsing said encoded stream of audiovisual data to generate event data;

storing said event data in an event buffer;

transmitting said parsed encoded stream of audiovisual data to a local storage device;

extracting said parsed encoded stream of audiovisual data from said local storage device;

transmitting said extracted encoded stream of audiovisual data to a decoder;

communicating asynchronously via an interrupt mechanism with program logic executed by a central processing unit to control said storage and playback of said audiovisual data.

55. An apparatus for storage and playback of audiovisual data, comprising:

a local storage device;

a central processing unit executing program logic; and

a first circuit, coupled to said local storage device and to said central processing unit, for accepting an encoded stream of audiovisual data, parsing said encoded stream of audiovisual data to generate event data indicating the start of video or audio components within said encoded stream of audiovisual data, writing said event data into an event buffer, transmitting said parsed encoded stream of audiovisual data to said local storage device, subsequently extracting said parsed encoded stream of audiovisual data from said local storage device, transmitting said extracted encoded stream of audiovisual data to a decoder, and notifying said program logic when said event data are written into said event buffer, wherein said event data contains the location of said video or audio components in said event buffer.

57. The method according to claims 55 or 56, wherein said local storage device is a hard drive.

58. The method according to claims 55 or 56, wherein said stream of audiovisual data is an MPEG stream.

59. The method according to claims 55 or 56, wherein said local storage device is a hard drive and said stream of audiovisual data is an MPEG stream.

60. The method according to claims 55 or 56, further comprising the step of buffering said parsed encoded stream of audiovisual data into a memory.

61. The method according to claims 55 or 56, wherein said local storage device is a hard drive and said stream of audiovisual data is an MPEG stream, and further comprising the step of buffering said parsed encoded stream of audiovisual data into a memory.

62. The method according to claim 58, wherein said event data comprises data indicating the start of a video I-frame.

63. The method according to claim 59, wherein said event data comprises data indicating the start of a video I-frame.

64. The method according to claim 61, wherein said event data comprises data indicating the start of a video I-frame.

56. An apparatus for storage and playback of audiovisual data, comprising:

a local storage device;

a central processing unit executing program logic; and

a first circuit, coupled to said local storage device and to said central processing unit, comprising means for accepting an encoded stream of audiovisual data, means for parsing said encoded stream of audiovisual data to generate event data indicating the start of video or audio components within said encoded stream of audiovisual data, means for writing said event data into an event buffer, means for transmitting said parsed encoded stream of audiovisual data to said local storage device, means for subsequently extracting said parsed encoded stream of audiovisual data from said local storage device, means for transmitting said extracted encoded stream of audiovisual data to a decoder, and means for notifying said program logic when said event data are written into said event buffer, wherein said event data contains the location of said video or audio components in said event buffer.

65. An apparatus for storage and playback of audiovisual data, comprising:

a local storage device; and

a first circuit, coupled to said local storage device, that parses an encoded stream of audiovisual data to generate event data, stores said event data in an event buffer, writes said encoded stream of audiovisual data to said local storage device, subsequently transmits said encoded stream of audiovisual data from said local storage device to an output buffer, and varies a flow of said encoded audiovisual data from said output buffer to an output device upon receipt of one or more control commands from a user.

66. The apparatus according to claim 65, wherein said local storage device is a hard drive.

67. The apparatus according to claim 65, wherein said first circuit includes a media switch.

68. The apparatus according to claim 66, wherein said first circuit includes a media switch.

69. The apparatus according to claim 65, wherein said first circuit includes a central processing unit.

70. The apparatus according to claim 66, wherein said first circuit includes a central processing unit.

71. The apparatus according to claim 67, wherein said first circuit includes a central processing unit.

72. The apparatus according to claim 68, wherein said first circuit includes a central processing unit.

73. The apparatus according to claim 65, wherein said stream of audiovisual data is an MPEG stream.

74. The apparatus according to claim 66, wherein said stream of audiovisual data is an MPEG stream.

75. The apparatus according to claim 67, wherein said stream of audiovisual data is an MPEG stream.

76. The apparatus according to claim 68, wherein said stream of audiovisual data is an MPEG stream.

77. The apparatus according to claim 69, wherein said stream of audiovisual data is an MPEG stream.

78. The apparatus according to claim 70, wherein said stream of audiovisual data is an MPEG stream.

79. The apparatus according to claim 71, wherein said stream of audiovisual data is an MPEG stream.

80. The apparatus according to claim 72, wherein said stream of audiovisual data is an MPEG stream.

81. The apparatus according to claim 73, wherein said event data comprises data indicating the start of a video I-frame.

82. The apparatus according to claim 74, wherein said event data comprises data indicating the start of a video I-frame.

83. The apparatus according to claim 75, wherein said event data comprises data indicating the start of a video I-frame.

84. The apparatus according to claim 76, wherein said event data comprises data indicating the start of a video I-frame.

85. The apparatus according to claim 77, wherein said event data comprises data indicating the start of a video I-frame.

86. The apparatus according to claim 78, wherein said event data comprises data indicating the start of a video I-frame.

87. The apparatus according to claim 79, wherein said event data comprises data indicating the start of a video I-frame.

88. The apparatus according to claim 80, wherein said event data comprises data indicating the start of a video I-frame.

89. The apparatus according to claim 65, wherein said control commands comprise any of:

a reverse control command, a play control command, a fast forward control command, or a pause control command.