Picture-in-picture and multiple video streams using slice-based encoding

• US 6,481,012 B1
• Filed: 12/09/1999
• Issued: 11/12/2002
• Est. Priority Date: 10/27/1999
• Status: Expired due to Term

• Current Assignee: TiVo Corporation (Adeia Inc.)
• Original Assignee: DIVA Systems Corporation
• Inventors: Edmonds, Jeremy S., Gordon, Donald F., Bayrakeri, Sadik, Ludvig, Edward A., Comito, John P., Gershtein, Eugene
• Primary Examiner(s): Faile, Andrew
• Assistant Examiner(s): Srivastava, Vivek
• Application Number:
  US09/454,216
• Time in Patent Office: 1,069 Days
• Field of Search: H04/N.5445, H04/N.300, 725/39, 725/38, 725/48, 725/56, 725/57, 725/59, 725/54, 345/327, 375/240.12, 375/240.13, 375/240.14, 375/240.26, 348/425.1, 348/409.1
• US Class Current: 725/54
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23608 Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4351 involving reassembling additional data, e.g. rebuilding an executable program from recovered modules
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/45 : Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen

Abstract

Methods for slice-based encoding of program guides and user interfaces. The program guides include multiple video streams for picture-in-picture and other applications. A method for encoding the program guide includes encoding a first set of slices for each of a plurality of graphics pages; and encoding a second set of slices for each of a plurality of video streams. The user interfaces are multi-functional and may be used for electronic commerce and other applications. A method of generating the user interface includes encoding a set of slices for each of a plurality of objects, each object being characterized by an identity, at least one attribute, and at least one operation. In one embodiment of this method, the plurality of objects include an electronic commerce object, where the electronic commerce object is attributed with a first hyper text markup language (HTML) page. A head-end centric system and apparatus for encoding and delivery of realtime content, including: a non-realtime content source for providing non-realtime content; a non-realtime encoder for encoding the non-realtime content into encoded non-realtime content; a realtime encoder source for providing realtime video and audio content; a realtime encoder for encoding the realtime video and audio content into encoded realtime video an audio; a remultiplexor for repacketizing the encoded non-realtime content and the encoded realtime video and audio into transport packets; and a re-timestamp unit coupled to the remultiplexor for providing timestamps to be applied to the transport packets in order to synchronize the realtime and non-realtime content therein.

Claims

1. A method for encoding a program guide having included therein a guide portion and a video portion, the method comprising:

encoding a first set of slices for the guide portion for each of a plurality of guide pages, where the first set of slices are intra-coded; and

encoding a second set of slices for the video portion for each of a plurality of video streams, where the second set of slices are intra-coded;

encoding a third set of slices for the video portion for each of the plurality of video streams, where the third set of slices are predictive-coded; and

encoding a fourth set of slices for the video portion for each of the plurality of video streams, where the fourth set of slices comprise skipped-coded guide portion.

2. The method of claim 1, where the encoding the second set of slices is performed once per group of pictures (GOP) for each of the plurality of video streams.

3. The method of claim 1, where the encoding the third set of slices is performed multiple times per group of pictures (GOP) for each of the plurality of video streams.

4. The method of claim 1, where the encoding the fourth set of slices is performed multiple times per group of pictures (GOP) for each of the plurality of video streams.

5. The method of claim 1, further comprising:

encoding a plurality of audio streams, each audio stream associated with a corresponding video stream.

6. The method of claim 1, further comprising:

forming a first packet stream by multiplexing together first, second, third, and fourth sets of packets, where the first set of packets include the encoded first set of slices, the second set of packets include the encoded second set of slices, the third set of packets include the encoded third set of slices, and the fourth set of packets include the encoded fourth set of slices.

7. The method of claim 6, further comprising:

encoding a plurality of audio streams, each audio stream associated with a corresponding video stream;

forming an audio packet stream by multiplexing together packets for the plurality of audio streams; and

forming a transport stream by multiplexing together the first packet stream and the audio packet stream.

13. The method of claim 6, wherein the forming the first packet stream includes:

scanning slices in the first and second sets,

packetizing and assigning packet identifiers (PIDS) to the first and second sets of packets in conjunction with the scanning of the slices in the first and second sets,

scanning slices in the third and fourth sets,

packetizing and assigning PIDs to the third and fourth set of packets in conjunction with the scanning of the slices in the third and fourth sets, and

interleaving packets from the first, second, third and fourth sets.

14. The method of claim 13, wherein slices in the first, second, third, and fourth sets are scanned serially.

15. The method of claim 13, wherein slices in the first, second, third, and fourth sets are scanned non-serially.

16. The method of claim 7, wherein the packets for the audio packet stream are interleaved with packets for the first packet stream.

17. The method of claim 16, wherein the packets for the audio and first packet streams are interleaved such that packets for the audio packet stream for each time instance are located near packets for the first packet stream for the same time instance.

8. An encoder for encoding a bitstream representing a program guide having included therein a guide portion and a video portion, the bitstream comprising:

a first set of packets comprising a set of intra-coded slices for the guide portion for each of a plurality of guide pages, where the first set of packets are identifiable by a first set of packet identifiers; and

a second set of packets comprising a set of intra-coded slices for the video portion for each of a plurality of video streams, a set of predictive-coded slices for the video portion for each of the plurality of video streams, and a set of skipped-coded slices for the guide portion for each of the plurality of video streams, where the second set of packets are identifiable by a second set of packet identifiers.

9. The encoder of claim 8, further comprising:

a third set of packets including a plurality of audio streams, each audio stream associated with a corresponding video stream.

10. The encoder of claim 8, wherein the plurality of video streams comprise full motion video streams which can be retrieved with a demultiplexer and decoder at a receiving terminal.

11. The encoder of claim 8, wherein the plurality of video streams comprise full motion video streams which can be played interchangeably at a receiving terminal.

12. The encoder of claim 8, wherein the plurality of video streams comprise full motion video streams which can be retrieved with a demultiplexer and a decoder without assistance from a microprocessor.