Video and audio data multiplexing into ATM cells with no dummy cell used and ATM cell demultiplexing

• US 5,561,466 A
• Filed: 06/23/1994
• Issued: 10/01/1996
• Est. Priority Date: 06/23/1993
• Status: Expired due to Fees

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Kiriyama, Takashi
• Primary Examiner(s): Peng, John K.
• Assistant Examiner(s): GRANT, CHRISTOPHER C
• Application Number:
  US08/264,349
• Time in Patent Office: 831 Days
• Field of Search: 348/461, 348/419, 348/423, 348/500, 370/94.2, 370/94.1, 370/112, 370/60, 370/60.1
• US Class Current: 375/240.25
• CPC Class Codes: H04J 3/0632 Synchronisation of packets and cells, e.g. transmission of voice via a packet network, circuit emulation service [CES] queuing arrangements in packet switching elements H04L49/90; synchronising systems for the synchronous transmission of a pulse code modulated video signal with one or more other pulse code modulated signals H04N7/56
• CPC Class Codes: H04J 3/0685 Clock or time synchronisation in a node; Intranode synchronisation
• CPC Class Codes: H04L 2012/5664 Support of Video, e.g. MPEG
• CPC Class Codes: H04L 2012/5671 Support of voice
• CPC Class Codes: H04L 2012/5674 Synchronisation, timing recovery or alignment
• CPC Class Codes: H04L 2012/5675 Timeslot assignment, e.g. TDMA
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2381 Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network transmission of MPEG streams over ATM H04L12/5601
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/4381 Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells transmission of MPEG streams over ATM H04L12/5601
• CPC Class Codes: H04N 21/64307 ATM

Abstract

For cell multiplexing an original video signal and an original audio signal which are encoded into an encoded video signal and an encoded audio signal, a buffer unit buffers the encoded video signal for read out by a control unit as video data of a common data length. The video data and the encoded audio signal are supplied to processors for inserting additional information, such as a header, therein for production of video and audio cells, which are multiplexed by a cell multiplexer into a cell multiplexed video and audio signal. Preferably, the buffer unit comprises a video buffer for buffering the encoded video signal for read out as read video data, a delay detector for detecting a delay needed to produce the read out data, and a delay information multiplexer for multiplexing, on each read out datum for production of the read out data, delay information indicative of the delay. The cell multiplexer uses with a higher priority degree each audio cell concurrently supplied thereto with one of the video cells and uses at least one empty cell while none of the video and the audio cells are supplied thereto. For reproduction of the original video and audio signals, a data demultiplexer device is adapted to the cell multiplexed video and audio signal in which the delay information is multiplexed on each video cell.

Claims

1. A data multiplexing method of multiplexing an original video signal and an original audio signal into a cell multiplexed video and audio signal, comprising the steps of:

encoding said original video signal into an encoded video signal;

buffering said encoded video signal as a buffered video datum;

controlling read out of said buffered video datum as video data of a predetermined common data length;

processing said video data into video cells with addition of additional video information to each of said video data;

encoding said original audio signal into an encoded audio signal;

processing said encoded audio signal into audio cells with addition of additional audio information to each of audio data derived from said encoded audio signal to have said common data length; and

multiplexing said video cells and said audio cells into said cell multiplexed video and audio signal;

wherein said buffering step comprises the steps of;

buffering said encoded video signal as said buffered video datum with said video buffering step controlled by said controlling step to produce read out data of said common data length with each of said read out data produced with a delay after said encoded video signal is stored as said buffered video datum;

delay detecting said delay as delay information by comparing said encoded video signal with each of said read out data; and

delay information multiplexing said read out data and said delay information into said video data.

2. A data multiplexing method as claimed in claim 1, wherein:

said original video signal encoding step produces, as said encoded video signal, a succession of video frame data of said common data length with a frame structure comprising a unique word common to said video frame data, a predetermined time slot, and encoded video data specific to said video frame data;

said video buffering step producing said read out data with said frame structure in one-to-one correspondence to said video frame data;

said delay detecting step detecting said delay by comparing the unique word of each of said video frame data with the unique word of one of said read out data that corresponds to said each of video frame data;

said delay information multiplexing step multiplexing said delay information on said predetermined time slot to produce said video data.

3. A data multiplexing method as claimed in claim 2, wherein said multiplexing step comprises the steps of:

cell multiplexing said video cells and said audio cells into said cell multiplexed video and audio signal;

video cell detecting whether or not each of said video cells is currently handed from said video data processing step over to said cell multiplexing step, said video cell detecting step producing video cell presence and absent signals when said video cells are and are not handed to said cell multiplexing step;

audio cell detecting whether or not each of said audio cells is currently handed from said audio signal processing step over to said cell multiplexing step, said audio cell detecting step producing audio cell presence and absence signals when said

audio cells are and are not handed to said cell multiplexing step;

signal production detecting whether or not said video cell presence signal and said audio cell presence signal are produced; and

selecting one of said audio cells with a higher priority degree than at least one of said video cells when said video cell presence signal and said audio cell presence signal are concurrently produced, so that said audio cell is placed before said video cell in said cell multiplexed video and audio signal during said cell multiplexing step.

4. A data multiplexing method as claimed in claim 3, wherein:

said signal production detecting step produces a multiplexer control signal only when said video cell presence signal and said audio cell presence signal are concurrently produced;

said video buffering step comprising the steps of;

video buffering said encoded video signal as said buffered video datum of a buffer occupancy, said video buffering step being controlled by said controlling step to produce said buffered video datum as said video data with said buffer occupancy reduced; and

buffer occupancy detecting whether or not said buffer occupancy is equal to zero, said buffer occupancy detecting step producing a zero occupancy signal when said buffer occupancy is reduced to zero;

said video data processing step comprising the steps of;

processing said video data into said video cells with at least one prescribed video time slot included in each of said video cells and with a cell control signal produced throughout said at least one prescribed video time slot; and

additional video information multiplexing said additional video information on said at least one prescribed video time slot;

said control step suspending production of said video data while at least one of said multiplexer control signal, said zero occupancy signal, and said cell control signal is produced.

5. A data multiplexer device for multiplexing an original video signal and an original audio signal into a cell multiplexed video and audio signal, comprising:

video encoder means for encoding said original video signal into an encoded video signal;

buffer means for buffering said encoded video signal as a buffered video datum;

control means for controlling read out of said buffered video datum to produce video data of a predetermined common data length;

video processor means for processing said video data into video cells with addition of additional video information to each of said video data;

audio encoding means for encoding said original audio signal into an encoded audio signal;

audio processor means for processing said encoded audio signal into audio cells by adding additional audio information to each of audio data derived from said encoded audio signal to have said common data length; and

multiplexer means for multiplexing said video cells and said audio cells into said cell multiplexed video and audio signal;

wherein said buffer means comprises;

video buffer means for buffering said encoded video signal as said buffered video datum, said video buffer means being controlled by said control means to produce read out data of said common data length with each of said read out data produced with a delay after said encoded video signal is stored in said video buffer means as said buffered video datum;

delay detector means responsive to said encoded video signal and said read out data for detecting said delay as delay information; and

delay information multiplexer means for multiplexing said read out data and said delay information into said video data.

6. A data multiplexer device as claimed in claim 5, wherein said multiplexer means comprise:

video and audio cell detector means for detecting whether or not one of said video cells and one of said audio cells are concurrently delivered from said video and said audio processor means, said video and audio cell detector means producing a concurrence signal when said one of video cells and said one of audio cells are concurrently delivered to said multiplexer means; and

selector means responsive to said concurrence signal for selecting said one of audio cells with a higher priority degree than said one of video cells for delivery to a device output of said multiplexer means.

7. A data multiplexer device as claimed in claim 6, wherein said video and audio cell detector means comprises:

video cell detector means for detecting whether or not each of said video cells is currently supplied from said video processor means to said multiplexer means, said video cell detector means producing video cell presence and absence signals when said video cells are and are not supplied to said multiplexer means;

audio cell detector means for detecting whether or not each of said audio cells is currently supplied from said audio processor means to said multiplexer means, said audio cell detector means producing audio cell presence and absence signals when said audio cells are and are not supplied to said multiplexer means; and

signal production detector means for detecting whether or not said video cell presence signal and said audio cell presence signal are produced, said signal production detector means producing said concurrence signal when said video and said audio cell presence signals are concurrently produced.

8. A data multiplexer device as claimed in claim 6, wherein:

said video buffer means buffers said encoded video signal as the buffered video datum of a buffer occupancy with said buffer occupancy decreased when each of said read out data is produced;

said buffer means comprising in addition to said video buffer means occupancy detector means for detecting whether or not said buffer occupancy is equal to zero, said buffer occupancy detector means producing a zero occupancy signal when said buffer occupancy is decreased to zero;

said control means suspending production of said buffered video datum as said read out data when at least one of said concurrence signal and said zero occupancy signal is produced.

9. A data multiplexer device as claimed in claim 5, wherein said multiplexer means comprises:

cell multiplexer means for multiplexing said video cells and said audio cells into said cell multiplexed video and audio signal;

video and audio cell detector means for detecting whether or not none of said video cells and of said audio cells are concurrently delivered from said video and said audio processor means to said cell multiplexer means; and

means for inserting an empty cell in said cell multiplexed video and audio signal each time when none of said video cells and of said audio cells are delivered to said cell multiplexer means.

10. A data multiplexer device as claimed in claim 5, wherein:

said video encoder means produces, as said encoded video signal, a succession of video frame data of said common data length with a frame structure comprising a unique word, a predetermined time slot, and an encoded video datum;

said video buffer means producing said read out data with said frame structure in one-to-one correspondence to said video frame data;

said delay detector means detecting said delay as delay information by comparing the unique word of each of said video frame data with the unique word of one of said read out data that corresponds to said each of video frame data;

said delay information multiplexer means multiplexing said delay information on said predetermined time slot to produce said video data.

11. A data multiplexer device as claimed in claim 5, wherein said delay detector means comprises:

first unique word detector means responsive to a succession video frame data for detecting the unique word in each of said video frame data to produce a first unique word detection signal;

timer means reset by said first unique word detection signal for counting a delay count;

second unique word detector means responsive to said read out data for detecting the unique word of said one of read out data to produce a second unique word detection signal; and

latch means responsive to said second unique word detection signal for latching said delay count as said delay information.

12. A data multiplexing device as claimed in claim 5, wherein:

said video encoder means produces, as said encoded signal, a succession of video frame data of said common data length;

said video buffer means comprising;

a memory comprising a plurality of memory addresses supplied with said frame data;

write address counter means responsive to said frame data for counting said frame data to produce a write address signal indicative of said memory addresses as write addresses to store said frame data in said write addresses as said buffered video datum;

read address counter means responsive to video read control signals for counting said read control signals to produce a read address signal indicative of said memory addresses as read addresses and to produce said buffered video datum from said read addresses as said video data; and

a buffer occupancy detector responsive to said write and said read address signals for producing a buffer occupancy signal indicative of a buffer occupancy with which said buffered video datum is stored in said memory addresses;

said multiplexer means producing a concurrence signal when one of said video cells and one of said audio cells are concurrently supplied thereto;

said control means comprising;

signal producing means for producing a timing signal at a period of said common data length; and

means responsive to said buffer occupancy signal, said concurrence signal, and said timing signal for producing each of said video read control signals when said buffer occupancy signal does not indicate a zero buffer occupancy, while said concurrence signal is not produced, or while said timing signal is not produced.

13. A data demultiplexer device for demultiplexing a cell multiplexed video and audio signal into reproductions of an original video signal and of an original audio signal, said cell multiplexed video and audio signal being produced by time division multiplexing video cell data of a predetermined common data length, propagation delay information representative of a delay used in producing said video cell data and in demultiplexing said video cell data into the reproduction of said original video signal, and audio cell data of said common data length, comprising:

demultiplexer means for demultiplexing said cell multiplexed video and audio signal into said audio cell data and multiplexed data of said video cell data and said propagation delay information;

separator means for separating said multiplexed data into separated video data and separated information;

video buffer means for buffering said separated video data as a buffered video datum;

video control means for controlling read out of said buffered video datum as read video data in response to said separated information;

audio buffer means for buffering said audio cell data as a buffered audio datum of an audio buffer occupancy;

audio control means for controlling read out of said buffered audio datum as read audio data in response to said audio buffer occupancy; and

decoder means for decoding said read video data and said read audio data into said reproductions.

14. A data demultiplexer device as claimed in claim 13, each of said video cell data and of said audio cell data including a unique word and bit rate information, the bit rate information of said video cell data indicating a variable bit rate, the bit rate information of said audio cell data indicating a constant bit rate, wherein said demultiplexer means comprises:

bit rate information discriminator means responsive to said cell multiplexed video and audio signal for discriminating between said variable and said constant bit rates to produce with a first delay a selector control signal indicative of each of said video cell data and each of said audio cell data one at a time and to produce with an additional second delay each of video write control signals timing the bit rate information in said video cell data and each of audio write control signals timing the bit rate information in said audio cell data;

delay means for delaying said cell multiplexed video and audio signal by said first delay to produce a delayed video and audio signal; and

selecting means responsive to said selector control signal for selecting selected video data and selected audio data from said delayed video and audio signal to produce said selected video data as said separated video data following said video write control signals, respectively, and said selected audio data as separated audio data following said audio write control signals, respectively.

15. A data demultiplexer device as claimed in claim 14, each of said video cell data being a multiplexed datum in which said propagation delay information is multiplexed on each of said video cell data immediately following said unique word, wherein said separator means comprises:

a unique word detector responsive to each of said video write control signals and to said unique word for producing a unique word detection signal while said unique word is included in said multiplexed datum; and

latching means for latching said propagation delay information as said separated information in response to said unique word detection signal.

16. A data demultiplexer device as claimed in claim 15, wherein:

said video buffer means comprises;

a memory comprising a plurality of memory addresses supplied with said separated video data;

write address counter means responsive to said video write control signals for counting said video write control signals to produce a write address signal indicative of said memory addresses as write addresses and to store said separated video data as said buffered video datum;

read address counter means responsive to video read request signals for counting said video read request signals to produce a read address signal indicative of said memory addresses as read addresses and to produce said buffered video datum as said read video data; and

a video buffer occupancy detector responsive to said write and said read address signals for producing a video buffer occupancy signal indicative of a video buffer occupancy with which said buffered video datum is stored in said memory addresses;

said video buffer means being accompanied by means responsive to said read video data for producing said video read request signals;

said video control means comprising;

adder means for calculating a sum of said video buffer occupancy and said separated information to produce a sum signal representative of said sum; and

a comparator for comparing said sum with a predetermined video delay threshold value to produce a video read start signal for supply to said read address counter means to start count of said video read request signals when said sum becomes equal at least to said predetermined video delay threshold value.

17. A data demultiplexer device as claimed in claim 15, wherein:

said audio buffer means comprises;

a memory comprising a plurality of memory addresses supplied with said separated audio data;

write address counter means responsive to said audio write control signals for counting said audio write control signals to produce a write address signal indicative of said memory addresses as write addresses and to store said separated audio data as a buffered audio datum;

read address counter means responsive to audio read request signals for counting said audio read request signals to produce a read address signal indicative of said memory addresses as read addresses and to produce said buffered audio datum as said read audio data; and

an audio buffer occupancy detector responsive to said write and said read address signals for producing an audio buffer occupancy signal indicative of said audio buffer occupancy;

said audio buffer means being accompanied by means responsive to said read audio data for producing said audio read request signals;

said audio control means comparing said audio buffer occupancy with a predetermined minimum audio occupancy to produce an audio read start signal for supply to said read address counter means to start count of said audio read request signals when said audio buffer occupancy becomes equal at least to said minimum audio occupancy.