Method and apparatus for combining and distributing data with pre-formatted real-time video

• US 5,966,120 A
• Filed: 11/21/1995
• Issued: 10/12/1999
• Est. Priority Date: 11/21/1995
• Status: Expired due to Term

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Imedia Corp. (Motorola Solutions, Inc.)
• Inventors: Shen, Paul, Krause, Edward A., Tom, Adam S., Arazi, Efraim
• Primary Examiner(s): FLYNN, NATHAN J
• Application Number:
  US08/561,010
• Time in Patent Office: 1,421 Days
• Field of Search: 348/7, 348/12, 348/13, 348/385, 348/387, 348/386, 348/389, 348/420, 348/423, 348/462, 348/473, 348/489, 455/4.2, 455/5.1, 455/6.1, 370/477, 370/505, 370/506, 370/521, 370/523, 370/528, 375/363
• US Class Current: 715/724
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/23611 Insertion of stuffing data into a multiplex stream, e.g. to obtain a constant bitrate synchronisation arrangements in time-division multiplex systems using bit stuffing for systems with different or fluctuating information rates H04J3/073
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/25841 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; arrangements for identifying locations of receiving stations in broadcast systems H04H60/51; location of the user terminal in data switching networks H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/4508 Management of client data or end-user data
• CPC Class Codes: H04N 21/6405 Multicasting data broadcast and multicast in packet switching networks H04L12/18
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

A system for providing efficient constant bit rate distribution of variable bit-rate encoded video programs while facilitating the distribution of encoded video programs, along with Auxiliary Data of a general character, to one or more receivers. At a particular receiver, a customized augmented video program is created by inserting selected portions of the Auxiliary Data into a selected encoded video program. The encoded video portion of the augmented video program can be transmitted, decoded and displayed in real time, while the Auxiliary Data need not be transmitted in real time but can be stored locally at the receiver for real-time presentation at a later time. Real time presentation might include insertion into the video program while non real-time presentation might include insertion into non-video applications separate from the video program.

Claims

1. A method of modifying a primary data stream, wherein the primary data stream comprises one or more variable bit rate programs, and wherein the primary data stream further comprises fill data, said method comprising:

receiving the primary data stream;

detecting fill data in the primary data stream;

inserting an auxiliary data stream in place of the fill data; and

adding location data for the programs and for the auxiliary data;

to form a modified data stream for distribution to a plurality of receivers configured for individually extracting selected portions of the modified data stream in accordance with the location data.

2. A method of forming a modified data stream for distribution to a plurality of receivers, comprising the steps of:

statistically multiplexing a plurality of encoded video programs;

monitoring the statistically multiplexed encoded video programs for the occurrence of a fill packet;

maintaining a buffer of auxiliary data segments;

replacing the fill packet with at least one segment of the auxiliary data stream from the buffer if the segment is smaller than the size of the fill packet;

adding location data for the encoded video programs and for the auxiliary data;

to form a modified data stream for distribution to a plurality of receivers configured for individually extracting selected portions of the modified data stream in accordance with the location data.

3. The method of claim 2 wherein the step of adding the location data comprises:

monitoring the intermediate data stream for a synchronization signal;

determining an allowable location data duration; and

inserting at least a portion of the location data during the location data duration.

4. The method of claim 3 wherein the modified data stream is encoded in a manner compatible with the MPEG standard.

5. A method of creating a receiver-specific customized display stream for an individual receiver, from a modified data stream sent to a plurality of receivers, comprising the steps of:

receiving a modified data stream at a receiver, the modified data stream comprising;

a statistically multiplexed portion comprising one or more encoded video programs; and

an auxiliary data portion comprising auxiliary data inserted in place of fill data;

determining location data from the modified data stream;

selecting an encoded video program from the statistically multiplexed portion of the modified data stream in accordance with a first predetermined characteristic of the receiver and the location data;

selecting local auxiliary data from the auxiliary data portion of the modified data stream in accordance with a second predetermined characteristic of the receiver and the location data;

storing the local auxiliary data; and

associating the encoded video program and the local auxiliary data to form a receiver-specific augmented video program for decoding and display.

10. The method of claim 5 wherein the step of associating the encoded video program and the local auxiliary data comprises creating a data stream including a first part of video type to be provided to a video display device, and a second part of non-video type to be provided to a non-video device.

6. A method of creating a receiver-specific customized display stream for an individual receiver, from a modified data stream sent to a plurality of receivers, comprising the steps of:

receiving a modified data stream at a receiver;

determining location data from the modified data stream;

selecting an encoded video program in accordance with a first predetermined characteristic of the receiver and the location data;

selecting local auxiliary data from the modified data stream in accordance with a second predetermined characteristic of the receiver and the location data;

storing the local auxiliary data; and

associating the encoded video program and the local auxiliary data to form a receiver-specific augmented video program for decoding and display;

wherein the step of selecting the local auxiliary data from the modified data stream includes temporarily accumulating the selected auxiliary data in a buffer and writing data from the buffer to a local auxiliary data storage in accordance with a fullness indication of the buffer.

7. A method of creating a receiver-specific customized display stream for an individual receiver, from a modified data stream sent to a plurality of receivers, comprising the steps of:

receiving a modified data stream at a receiver;

determining location data from the modified data stream;

selecting an encoded video program in accordance with a first predetermined characteristic of the receiver and the location data;

selecting local auxiliary data from the modified data stream in accordance with a second predetermined characteristic of the receiver and the location data;

storing the local auxiliary data; and

associating the encoded video program and the local auxiliary data to form a receiver-specific augmented video program for decoding and display;

wherein the step of associating the encoded video program and the local auxiliary data includes;

monitoring the encoded video program for at least one insertion interval;

maintaining a buffer of local auxiliary data segments; and

inserting at least one segment of the local auxiliary data into the insertion interval if the segment is smaller than the insertion interval.

8. The method of claim 7 wherein the insertion interval is determined in accordance with the MPEG standard.

9. The method of claim 8 wherein the monitoring the encoded video program for the insertion interval includes the steps of:

determining a presentation interval as a difference between a presentation time stamp and a system clock reference;

determining a duration of a segment of the local auxiliary data; and

providing an insertion enable signal when the presentation interval is larger than the duration of the local auxiliary data segment.

11. A method of creating a customized video program for a viewer, comprising the steps of:

statistically multiplexing a plurality of encoded video programs;

adding an auxiliary data stream to form an intermediate data stream;

adding location data for the encoded video programs and for the auxiliary data to form a modified data stream for distribution to a plurality of receivers;

receiving the modified data stream at a specific receiver;

determining the location data from the modified data stream;

selecting one of the encoded video programs in accordance with a first predetermined characteristic of the receiver and the location data;

selecting local auxiliary data from the modified data stream in accordance with a second predetermined characteristic of the receiver and the location data;

storing the local auxiliary data;

associating the encoded video program and the stored local auxiliary data to form a customized program; and

providing the customized program to a viewer for decoding and display.

12. A system for forming a constant bit rate modified data stream for distribution to a plurality of receivers, comprising:

a program multiplexer for statistically multiplexing a plurality of encoded video programs to the modified data stream;

a data insertion controller coupled to receive a multiplexed program stream from the program multiplexer and for inserting auxiliary data therein to yield a modified data stream; and

a program map insertion controller coupled to receive the modified data stream for adding location data for the encoded video programs and for the auxiliary data to the modified data stream.

13. The system of claim 12 wherein the data insertion controller comprises:

a first detector for providing an insertion signal upon detecting fill packet intervals of a minimum duration within a primary video data stream incorporating the statistically multiplexed encoded video programs;

a first buffer for holding portions of the auxiliary data; and

first multiplexing logic, connected to the first detector and the first buffer, for inserting at least one segment of the auxiliary data into the primary video data stream.

14. The system of claim 13 wherein the program map insertion controller comprises:

a synchronization detector coupled to receive the modified data stream for detecting a synchronization signal therein;

a timing device, connected to communicate with the synchronization detector, for providing a control signal during a predetermined interval after detection of the synchronization signal;

a second buffer for holding at least a portion of the location data; and

second multiplexing logic, responsive to the timing device and to the second buffer, for multiplexing the buffered location data and the received data stream.

15. The system of claim 14 configured to be compatible with the MPEG standard.

16. A system for creating a customized display stream for an individual receiver from a modified data stream sent to a plurality of receivers, comprising:

a program selector coupled to receive a modified data stream for determining location data therefrom, the modified data stream comprising;

a statistically multiplexed portion comprising one or more encoded video programs; and

an auxiliary data portion comprising auxiliary data inserted in place of fill data;

first demultiplexing logic for selecting an encoded video program from the statistically multiplexed portion of the modified data stream responsive to an identifier from the program selector and the location data;

second demultiplexing logic for selecting local auxiliary data from the auxiliary data portion of the modified data stream responsive to a second identifier from the program selector and the location data;

a storage device for storing the local auxiliary data from the second demultiplexing logic; and

an augmentation unit for associating the encoded video program and the stored local auxiliary data to form a receiver-specific augmented video program for decoding and display.

21. The system of claim 16 wherein the augmentation unit outputs a data stream including a first part of video type to be provided to a video display device, and a second part of non-video type to be provided to a non-video device.

17. A system for creating a customized display stream for an individual receiver from a modified data stream sent to a plurality of receivers, comprising:

a program selector coupled to receive a modified data stream for determining location data therefrom;

first demultiplexing logic for selecting an encoded video program from the modified data stream responsive to an identifier from the program selector and the location data;

second demultiplexing logic for selecting local auxiliary data from the modified data stream responsive to a second identifier from the program selector and the location data;

a storage device for storing the local auxiliary data from the second demultiplexing logic; and

an augmentation unit for associating the encoded video program and the stored local auxiliary data to form a receiver-specific augmented video program for decoding and display;

wherein the second demultiplexing logic for selecting local auxiliary data from the modified data stream includes;

a packet selector, connected to the processor, for selecting local auxiliary data from the modified data stream in accordance with the location data; and

a first buffer, connected to the packet selector for temporarily accumulating the selected local auxiliary data, and connected to deliver the selected local auxiliary data to the storage device in accordance with a fullness indication of the buffer.

18. The system of claim 17 wherein the augmentation unit for associating the encoded video program and the local auxiliary data comprises:

a second buffer for holding at least a portion of the local auxiliary data;

an insertion detector for determining an opportunity to insert a segment of the local auxiliary data into the encoded video program; and

augmentation multiplexing logic for inserting the segment of the local auxiliary data into the insertion interval in accordance with a command from the insertion detector.

19. The system of claim 18 configured to be compatible with the MPEG standard.

20. The system of claim 19 wherein the insertion detector includes:

a first extractor for determining a presentation interval as a difference between a presentation time stamp and a system clock reference;

a second extractor for determining a duration of a segment of the local auxiliary data; and

comparing logic, connected to the first and second extractors, for providing the insertion command to the augmentation multiplexing logic when the presentation interval is larger than the duration of the local auxiliary data segment.

22. A system for creating a customized video program for a viewer, comprising:

a multiplexer for statistically multiplexing a plurality of encoded video programs;

a first controller for adding auxiliary data to the output of the multiplexer;

a second controller for adding location data for the encoded video programs and for the auxiliary data to the output of the first controller, thereby forming a modified data stream;

a distribution channel for distributing the modified data stream to at least one receiver;

a processor for determining location data from the distributed modified data stream;

a first demultiplexer for selecting an encoded video program from the modified data stream in accordance with a first predetermined characteristic of the processor and the location data;

a second demultiplexer for selecting local auxiliary data from the modified data stream in accordance with a second predetermined characteristic of the processor and the location data;

a storage device for storing the local auxiliary data from the second demultiplexer; and

an augmentation unit for associating the encoded video program and the stored local auxiliary data to form a receiver-specific augmented video program for decoding and display.

23. A method of forming a modified data stream for distribution to a plurality of receivers, comprising the steps of:

statistically multiplexing a plurality of encoded video programs to form a primary data stream wherein, to occupy a constant bit rate data channel, additional data must be added to said primary data stream at one or more locations, said one or more locations comprising a fill portion;

inserting an auxiliary data stream to form an intermediate data stream, said auxiliary data stream inserted in said fill portion; and

adding location data for the encoded video programs and for the auxiliary data;

to form a modified data stream for distribution to a plurality of receivers capable of individually extracting selected portions of the modified data stream in accordance with the location data.

24. A method of forming a modified data stream for distribution to a plurality of receivers, comprising the steps of:

statistically multiplexing a plurality of encoded video programs;

monitoring the statistically multiplexed encoded video programs for the occurrence of a fill packet;

maintaining a buffer of auxiliary data segments;

replacing the fill packet with at least one segment of the auxiliary data stream from the buffer if the segment is smaller than the size of the fill packet; and

adding location data for the encoded video programs and for the auxiliary data;

to form a modified data stream for distribution to a plurality of receivers configured for individually extracting selected portions of the modified data stream in accordance with the location data.

25. A system for forming a modified data stream for distribution to a plurality of receivers, comprising:

a program multiplexer for statistically multiplexing a plurality of encoded video programs to the modified data stream;

a data insertion controller coupled to receive a multiplexed program stream from the program multiplexer and for inserting auxiliary data therein to yield the modified data stream; and

a program map insertion controller coupled to receive the modified data stream for adding location data for the encoded video programs and for the auxiliary data to the modified data stream.

26. The system of claim 25 wherein the data insertion controller comprises:

a first detector for providing an insertion signal upon detecting fill packet intervals of a minimum duration within a primary video data stream incorporating the statistically multiplexed encoded video programs;

a first buffer for holding portions of the auxiliary data; and

first multiplexing logic, connected to the first detector and the first buffer, for inserting at least one segment of the auxiliary data into the primary video data stream.