Multimedia time warping system

• US 20020146233A1
• Filed: 02/20/2002
• Published: 10/10/2002
• Est. Priority Date: 07/30/1998
• Status: Active Grant

• Current Assignee: TiVo Solutions Inc. (Adeia Inc.)
• Original Assignee: Alan S. Moskowitz, Andrew Martin Goodman, Ching Tong Chow, James M. Barton, Jean Swey Kao, Roderick James Mcinnis
• Inventors: Barton, James M., Goodman, Andrew Martin, Moskowitz, Alan S., McInnis, Roderick James, Chow, Ching Tong, Kao, Jean Swey
• Granted Patent: US 7,529,465 B2
• Time in Patent Office: Days
• US Class Current: 386/46
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G11B 2220/216 Rewritable discs
• CPC Class Codes: G11B 2220/2562 DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
• CPC Class Codes: G11B 2220/2575 DVD-RAMs
• CPC Class Codes: G11B 2220/455 said record carriers being in one device and being used as primary and secondary/backup media, e.g. HDD-DVD combo device, or as source and target media, e.g. PC and portable player
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/002 Programmed access in sequence to a plurality of record carriers or indexed parts, e.g. tracks, thereof, e.g. for editing; transfer of record carriers from magazine G11B15/68, G11B17/10; G11B17/22
• CPC Class Codes: G11B 27/024 on tapes G11B27/028, G11B27/029 take precedence
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/032 on tapes G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/3027 used signal is digitally coded
• CPC Class Codes: G11B 27/3054 Vertical Interval Time code [VITC]
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/42615 involving specific demultiplexing arrangements
• CPC Class Codes: H04N 21/4263 involving specific tuning arrangements, e.g. two tuners
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/43076 : of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/432 : Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/4334 : Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/4341 : Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/4344 : Remultiplexing of multiplex streams, e.g. by modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/4345 : Extraction or processing of SI, e.g. extracting service information from an MPEG stream
• CPC Class Codes: H04N 21/4402 : involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/440281 : by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783
• CPC Class Codes: H04N 21/4532 : involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 : Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/472 : End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/47214 : for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4884 : for displaying subtitles
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8547 : involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/76 : Television signal recording
• CPC Class Codes: H04N 5/775 : between a recording apparatus and a television receiver
• CPC Class Codes: H04N 5/781 : on disks or drums
• CPC Class Codes: H04N 5/782 : on tape
• CPC Class Codes: H04N 5/783 : Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 9/7921 : for more than one processing mode
• CPC Class Codes: H04N 9/8042 : involving data reduction
• CPC Class Codes: H04N 9/8063 : using time division multiplex of the PCM audio and PCM video signals

Abstract

A multimedia time warping system. The invention allows the user to store selected television broadcast programs while the user is simultaneously watching or reviewing another program. A preferred embodiment of the invention accepts television (TV) input streams in a multitude of forms, for example, National Television Standards Committee (NTSC) or PAL broadcast, and digital forms such as Digital Satellite System (DSS), Digital Broadcast Services (DBS), or Advanced Television Standards Committee (ATSC). The TV streams are converted to an Moving Pictures Experts Group (MPEG) formatted stream for internal transfer and manipulation and are parsed and separated it into video and audio components. The components are stored in temporary buffers. Events are recorded that indicate the type of component that has been found, where it is located, and when it occurred. The program logic is notified that an event has occurred and the data is extracted from the buffers. The parser and event buffer decouple the CPU from having to parse the MPEG stream and from the real time nature of the data streams which allows for slower CPU and bus speeds and translate to lower system costs. The video and audio components are stored on a storage device and when the program is requested for display, the video and audio components are extracted from the storage device and reassembled into an MPEG stream which is sent to a decoder. The decoder converts the MPEG stream into TV output signals and delivers the TV output signals to a TV receiver. User control commands are accepted and sent through the system. These commands affect the flow of said MPEG stream and allow the user to view stored programs with at least the following functions: reverse, fast forward, play, pause, index, fast/slow reverse play, and fast/slow play.

Claims

8. A process for a digital video recorder, comprising the steps of:

receiving a plurality of television broadcast signals;

storing each television broadcast signal in a digital form on a storage device;

providing a plurality of output devices;

wherein each output device extracts a specific digital broadcast signal from said storage device;

converting each specific digital broadcast signal into a television output signal;

sending television output signals to at least one display device; and

wherein said converting step allows playback rate and direction of each television output signal to be controlled individually to perform variable rate fast forward and rewind, frame step, pause, and play functions.

9. The process of claim 8, wherein a user controls the playback rate and direction of a television output signal through a remote control.

10. The process of claim 8, further comprising the step of:

providing a multimedia recording device, wherein said converting step sends any of a specific digital broadcast signal or a television output signal to said multimedia recording device for recording.

11. The process of claim 8, further comprising the step of:

inserting on-screen displays into a television output signal.

12. The process of claim 8, further comprising the step of:

providing editing means for creating custom sequences of video and/or audio output; and

wherein said editing means allows any number of video and/or audio segments of digital broadcast signals to be lined up and combined and stored on said storage device.

13. The process of claim 8, wherein a television broadcast signal can contain any of:

software updates or data.

15. The process of claim 14, wherein a user controls the playback rate and direction of a television output signal through a remote control.

16. The process of claim 14, further comprising the step of:

providing a multimedia recording device, wherein said decoding step sends any of a digital stream or a television output signal to said multimedia recording device for recording.

17. The process of claim 14, further comprising the step of:

inserting on-screen displays into a television output signal.

18. The process of claim 14, further comprising the step of:

providing editing means for creating custom sequences of video and/or audio output; and

wherein said editing means allows any number of video and/or audio segments of digital streams to be lined up and combined and stored on said storage device.

19. The process of claim 14, wherein an input stream can contain any of:

software updates or data.

14. A process for a digital video recorder, comprising the steps of:

receiving a plurality of input streams;

storing said plurality of input streams in digital form on a storage device;

providing a plurality of output devices;

wherein each output device extracts a digital stream from said storage device;

decoding each digital stream into a television output signal;

sending television output signals to at least one display device; and

wherein said decoding step allows playback rate and direction of each television output signal to be controlled individually to perform variable rate fast forward and rewind, frame step, pause, and play functions.

20. A process for a digital video recorder, comprising the steps of:

storing a plurality of multimedia programs in digital form on a storage device;

playing back at least two of said multimedia programs from said storage device to at least one television monitor; and

wherein said playing back step allows playback rate and direction of each multimedia program to be controlled individually to perform variable rate fast forward and rewind, frame step, pause, and play functions.

21. The process of claim 20, wherein said playing back step converts said at least two of said multimedia programs into television output signals;

22. The process of claim 21, further comprising the step of:

inserting on-screen displays into a television output signal.

23. The process of claim 20, wherein a user controls the playback rate and direction of a multimedia program through a remote control.

24. The process of claim 20, further comprising the step of:

providing a multimedia recording device, wherein said playing back step sends a multimedia program to said multimedia recording device, allowing a user to record said multimedia program.

25. The process of claim 20, further comprising the step of:

providing editing means for creating custom sequences of video and/or audio output; and

wherein said editing means allows any number of video and/or audio segments of multimedia programs to be lined up and combined and stored on said storage device.

26. The process of claim 20, further comprising the steps of:

providing a plurality of input signal tuners;

wherein said tuners accept analog and digital multimedia program signals;

wherein each of said tuners is individually tuned to a specific multimedia program;

converting analog multimedia programs into a digital representation; and

wherein said storing step separates a digitized analog multimedia program or digital multimedia program into its video and audio components before storing on said storage device.

27. The process of claim 26, further comprising the step of:

providing means for synchronizing video and audio components for proper playback.

28. The process of claim 26, wherein an input signal tuner receives any of:

software updates or data.

30. The apparatus of claim 29, wherein a user controls the playback rate and direction of a television output signal through a remote control.

31. The apparatus of claim 29, further comprising:

a multimedia recording device, wherein said decoding module sends any of a specific video and audio component or a television output signal to said multimedia recording device for recording.

32. The apparatus of claim 29, further comprising:

a module for inserting on-screen displays into a television output signal.

33. The apparatus of claim 29, further comprising:

editing means for creating custom sequences of video and/or audio output; and

wherein said editing means allows any number of video and/or audio segments to be lined up and combined and stored on said storage device.

34. The apparatus of claim 29, further comprising:

means for synchronizing video and audio components for proper playback.

35. The apparatus of claim 29, wherein an input signal tuner receives any of:

software updates or data.

37. The apparatus of claim 36, wherein a user controls the playback rate and direction of a television output signal through a remote control.

38. The apparatus of claim 36, further comprising:

a multimedia recording device, wherein said converting module sends any of a specific digital broadcast signal or a television output signal to said multimedia recording device for recording.

39. The apparatus of claim 36, further comprising:

a module for inserting on-screen displays into a television output signal.

40. The apparatus of claim 36, further comprising:

editing means for creating custom sequences of video and/or audio output; and

wherein said editing means allows any number of video and/or audio segments of digital broadcast signals to be lined up and combined and stored on said storage device.

41. The apparatus of claim 36, wherein a television broadcast signal can contain any of:

software updates or data.

29. An apparatus for a digital video recorder, comprising:

a plurality of input signal tuners;

wherein said tuners accept analog and digital television broadcast signals;

wherein each of said tuners is individually tuned to a specific broadcast signal;

a module for converting analog television broadcast signals into a digital signal;

a module for separating a digital signal or digital television broadcast signal into its video and audio components;

a module for storing said video and audio components on a storage device;

a plurality of output devices;

wherein each output device extracts a specific video and audio component from said storage device;

a module for decoding each specific video and audio component into a television output signal; and

a module for sending television output signals to at least one display device;

wherein said decoding module allows playback rate and direction of each television output signal to be controlled individually to perform variable rate fast forward and rewind, frame step, pause, and play functions.

36. An apparatus for a digital video recorder, comprising:

a module for receiving a plurality of television broadcast signals;

a module for storing each television broadcast signal in a digital form on a storage device;

a plurality of output devices;

wherein each output device extracts a specific digital broadcast signal from said storage device;

a module for converting each specific digital broadcast signal into a television output signal;

a module for sending television output signals to at least one display device; and

wherein said converting module allows playback rate and direction of each television output signal to be controlled individually to perform variable rate fast forward and rewind, frame step, pause, and play functions.

42. An apparatus for a digital video recorder, comprising:

a module for receiving a plurality of input streams;

a module for storing said plurality of input streams in digital form on a storage device;

a plurality of output devices;

wherein each output device extracts a digital stream from said storage device;

a module for decoding each digital stream into a television output signal; and

a module for sending television output signals to at least one display device;

wherein said decoding module allows playback rate and direction of each television output signal to be controlled individually to perform variable rate fast forward and rewind, frame step, pause, and play functions.

1. A process for a digital video recorder, comprising the steps of:

providing a plurality of input signal tuners;

wherein said tuners accept analog and digital television broadcast signals;

wherein each of said tuners is individually tuned to a specific broadcast signal;

converting analog television broadcast signals into a digital signal;

separating a digital signal or digital television broadcast signal into its video and audio components;

storing said video and audio components on a storage device;

providing a plurality of output devices;

wherein each output device extracts a specific video and audio component from said storage device;

decoding each specific video and audio component into a television output signal;

sending television output signals to at least one display device; and

wherein said decoding step allows playback rate and direction of each television output signal to be controlled individually to perform variable rate fast forward and rewind, frame step, pause, and play functions.

2. The process of claim 1, wherein a user controls the playback rate and direction of a television output signal through a remote control.

3. The process of claim 1, further comprising the step of:

providing a multimedia recording device, wherein said decoding step sends any of a specific video and audio component or a television output signal to said multimedia recording device for recording.

4. The process of claim 1, further comprising the step of:

inserting on-screen displays into a television output signal.

5. The process of claim 1, further comprising the step of:

providing editing means for creating custom sequences of video and/or audio output; and

wherein said editing means allows any number of video and/or audio segments to be lined up and combined and stored on said storage device.

6. The process of claim 1, further comprising the step of:

providing means for synchronizing video and audio components for proper playback.

7. The process of claim 1, wherein an input signal tuner receives any of:

software updates or data.

43. The apparatus of claim 42, wherein a user controls the playback rate and direction of a television output signal through a remote control.

44. The apparatus of claim 42, further comprising:

a module for inserting on-screen displays into a television output signal.

45. The apparatus of claim 42, further comprising:

editing means for creating custom sequences of video and/or audio output; and

wherein said editing means allows any number of video and/or audio segments of digital streams to be lined up and combined and stored on said storage device.

46. The apparatus of claim 42, wherein an input stream can contain any of:

software updates or data.

48. The apparatus of claim 47, wherein said playing back step converts said at least two of said multimedia programs into television output signals;

49. The apparatus of claim 48, further comprising:

a module for inserting on-screen displays into a television output signal.

50. The apparatus of claim 47, wherein a user controls the playback rate and direction of a multimedia program through a remote control.

51. The apparatus of claim 47, further comprising:

a multimedia recording device, wherein said playing back module sends a multimedia program to said multimedia recording device, allowing a user to record said multimedia program.

52. The apparatus of claim 47, further comprising:

editing means for creating custom sequences of video and/or audio output; and

wherein said editing means allows any number of video and/or audio segments of multimedia programs to be lined up and combined and stored on said storage device.

53. The apparatus of claim 47, further comprising:

a plurality of input signal tuners;

wherein said tuners accept analog and digital multimedia program signals;

wherein each of said tuners is individually tuned to a specific multimedia program;

a module for converting analog multimedia programs into a digital representation; and

wherein said storing module separates a digitized analog multimedia program or digital multimedia program into its video and audio components before storing on said storage device.

43-1. The apparatus of claim 42, further comprising:

a multimedia recording device, wherein said decoding module sends any of a digital stream or a television output signal to said multimedia recording device for recording.

47. An apparatus for a digital video recorder, comprising:

a module for storing a plurality of multimedia programs in digital form on a storage device;

a module for playing back at least two of said multimedia programs from said storage device to at least one television monitor; and

wherein said playing back module allows playback rate and direction of each multimedia program to be controlled individually to perform variable rate fast forward and rewind, frame step, pause, and play functions.

55. The apparatus of claim 54, further comprising the step of:

means for synchronizing video and audio components for proper playback.

56. The apparatus of claim 54, wherein an input signal tuner receives any of:

software updates or data.