Apparatus and method for combining realtime and non-realtime encoded content

• US 7,810,116 B2
• Filed: 09/08/2004
• Issued: 10/05/2010
• Est. Priority Date: 10/27/1999
• Status: Expired due to Term

• Current Assignee: TiVo Corporation (Adeia Inc.)
• Original Assignee: Comcast IP Holdings I LLC (Comcast Corporation)
• Inventors: Edmonds, Jeremy S., Gordon, Donald F., Bayrakeri, Sadik, Ludvig, Edward A., Comito, John P., Gershtein, Eugene
• Primary Examiner(s): Hirl; Joseph P
• Assistant Examiner(s): RABOVIANSKI, JIVKA A
• Application Number:
  US10/936,183
• Publication Number:
  US 20050034155A1
• Time in Patent Office: 2,218 Days
• Field of Search: 725/39, 725/42, 725/43
• US Class Current: 725/39
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23608 Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4351 involving reassembling additional data, e.g. rebuilding an executable program from recovered modules
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/45 Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen

Abstract

A terminal for decoding and presenting encoded realtime and non-realtime interactive program guide (IPG) content including a realtime video portion and a non-realtime guide graphics portion. The terminal includes a demodulator operative to receive and demodulate a modulated signal to provide a transport stream, and a transport demultiplexer coupled to the demodulator and operative to receive and process the transport stream to provide a sequence of transport packets re-timestamped to synchronize encoded realtime content and encoded non-realtime content included therein. At least one video decoder is coupled to the transport demultiplexer and operative to receive and decode the encoded realtime and non-realtime contents to recover the realtime and non-realtime contents for the user interface.

Claims

1. A terminal for presenting interactive program guide content comprising a sequence of frames with each frame partitioned into a realtime video portion and a non-realtime guide graphics portion, the terminal comprising:

a demodulator operative to receive and demodulate a modulated signal to provide a transport stream comprising data of the video portion of a first frame, data of the video portion of subsequent frames, and data of the guide graphics portion of the first frame of the sequence of frames; and

a transport demultiplexer coupled to the demodulator and operative to receive and process the transport stream to;

extract data of the video portion of a first frame, data of the video portion of subsequent frames, and data of the guide graphics portion of the first frame of the sequence of frames from the transport stream, and

concatenate the extracted data to provide the sequence of frames, wherein the first frame includes the data of the video portion of the first frame concatenated with the data of the guide graphics portion of the first frame, and each subsequent frame respectively includes the data of the video portion of that subsequent frame concatenated with skipped macroblocks indicating that the guide graphics portion of that subsequent frame is the same as the guide graphics portion of a previous frame in the sequence of frames.

2. The terminal of claim 1 wherein:

the transport stream further comprises the skipped macroblocks, and the extracted data is concatenated in exactly the order in which the extracted data arrives at said demultiplexer.

3. The terminal of claim 1, wherein said transport demultiplexer is further operative to:

remap, in the transport stream, packet identifiers identifying the data of the video portion of the first frame, packet identifiers identifying data of the video portion of the subsequent frames, and packet identifiers identifying the data of the guide graphics portion to a pre-defined packet identifier, wherein extracting the data from the transport stream is based on identifying packets in the transport stream having said pre-defined packet identifier.

4. The terminal of claim 1, wherein the video portions include video and audio contents.

5. The terminal of claim 1, wherein the non-realtime guide graphics portion includes guide data.

6. The terminal of claim 1, wherein:

the video portion of the first frame is encoded as one or more reference picture slices, the video portion of each subsequent frame is encoded as one or more predicted picture slices; and

the guide graphic portion of the first frame is encoded as one or more reference picture slices.

7. The terminal of claim 1, wherein:

the transport stream comprises packets,

a first plurality of the packets comprise the data of the video portions and a first packet identifier, and

a second plurality of the packets comprise the data of the guide graphics portion of the first frame and a second packet identifier.

8. The terminal of claim 7, wherein the demodulator is further operative to filter out packets from the transport stream which are not identified with the first or the second packet identifiers.

9. The terminal of claim 7, wherein:

the transport demultiplexer is further operative to extract the data from the transport stream based on a selected packet identifier, and

the packets identified with the first and the second packet identifiers further include information for instructing the transport demultiplexer to change the selected packet identifier for subsequently received packets in the transport stream.

10. The terminal of claim 7:

wherein the demodulator is further operative to filter out packets from the transport stream which do not include a selected packet identifier, and

wherein the packets identified with the first and the second packet identifiers further include information for instructing the demodulator to change the selected packet identifier for subsequently received packets in the transport stream.

11. A terminal comprising:

a demodulator operative to receive and demodulate a modulated signal to provide a transport stream which includes data packets for presenting an interactive program guide, the interactive program guide including a realtime video portion, a first non-realtime guide portion, and a second non-realtime guide portion, wherein;

a first plurality of the packets include data for an image of the first guide portion and a first packet identifier related to the first guide portion,

a second plurality of the packets include data for an image of the second guide portion and a second packet identifier related to the second guide portion, and

a third plurality of the packets include data for a sequence of images of the video portion and a third packet identifier related to the video portion;

a controller operative to select the first or second guide portion for presentation in the interactive program guide and identify the first or second packet identifier related to the selected first or second guide portion; and

a transport demultiplexer coupled to the demodulator and operative to;

extract data from packets in the transport stream which include the third packet identifier and the identified first or second packet identifier, and concatenate the extracted data to provide a video stream of the interactive program guide.

12. The terminal of claim 11, wherein:

the sequence of images of the video portion includes a first video image encoded as one or more reference picture slices and subsequent video images encoded as one or more predicted picture slices; and

the image of the first guide portion and the image of the second guide portion are encoded as one or more reference picture slices.

13. The terminal of claim 11, wherein:

a first frame of the video stream of the interactive program guide comprises a first image of the sequence of images of the video portion and the image of the selected first or second guide portion; and

a second frame of the video stream comprises a second image of the sequence of images of the video portion and skipped macroblocks indicating that the second frame is to be presented with the image of the guide portion in the first frame.

14. The terminal of claim 13, wherein:

the transport stream includes a fourth plurality of the packets which include the skipped macroblocks and the third packet identifier.

15. The terminal of claim 14, wherein the extracted data are concatenated in the order in which the extracted data arrive at the demultiplexer.

16. A method comprising:

demodulating a modulated signal to provide a transport stream which includes data packets for presenting an interactive program guide, the interactive program guide including a realtime video portion, a first non-realtime guide portion, and a second non-realtime guide portion, wherein;

a first plurality of the packets include data for an image of the first guide portion and a first packet identifier related to the first guide portion,

a second plurality of the packets include data for an image of the second guide portion and a second packet identifier related to the second guide portion, and

a third plurality of the packets include data for a sequence of images of the video portion and a third packet identifier related to the video portion;

receiving a selection of the first or second guide portion for presentation in the interactive program guide;

identifying the first or second packet identifier related to the selected first or second guide portion; and

extracting data from packets in the transport stream which include the third packet identifier and the identified first or second packet identifier, and

concatenating the extracted data to provide a video stream of the interactive program guide.

17. The method of claim 16, wherein:

the sequence of images of the video portion includes a first video image encoded as one or more reference picture slices and subsequent video images encoded as one or more predicted picture slices; and

the image of the first guide portion and the image of the second guide portion are encoded as one or more reference picture slices.

18. The method of claim 16, wherein:

a first frame of the video stream of the interactive program guide comprises a first image of the sequence of images of the video portion and the image of the selected first or second guide portion; and

a second frame of the video stream comprises a second image of the sequence of images of the video portion and skipped macroblocks indicating that the second frame is to be presented with the image of the guide portion in the first frame.

19. The method of claim 18, wherein:

the transport stream includes a fourth plurality of the packets which include the skipped macroblocks and the third packet identifier.

20. The method of claim 19, wherein the extracted data are concatenated in the order in which the extracted data arrive at the demultiplexer.