Fast packet transmission system of video data

• US 5,140,417 A
• Filed: 06/20/1990
• Issued: 08/18/1992
• Est. Priority Date: 06/20/1989
• Status: Expired due to Fees

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Tanaka, Tsutomu, Yokota, Hiroshi, Fuse, Masaru
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): LEE, MICHAEL
• Application Number:
  US07/541,268
• Time in Patent Office: 790 Days
• Field of Search: 358/141, 358/136, 358/135, 358/133, 358/12, 358/105, 382/56, 382/36, 375/122, 364/725
• US Class Current: 375/240.01
• CPC Class Codes: H04L 2012/5646 Cell characteristics, e.g. loss, delay, jitter, sequence integrity
• CPC Class Codes: H04L 2012/5678 Traffic aspects, e.g. arbitration, load balancing, smoothing, buffer management
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/37 with arrangements for assigning different transmission priorities to video input data or to video coded data
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/65 using error resilience
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 19/94 Vector quantisation
• CPC Class Codes: H04N 19/98 Adaptive-dynamic-range coding [ADRC]
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04Q 11/0478 Provisions for broadband connections

Abstract

A transmission system for packaging and transmission digital video data divides the data into a first group of components which would cause image quality to be drastically damaged if discarded, and a second group of components which would cause little damage if discarded. Data cells are composed for each group of components, and a priorty level is assigned giving a high priority to the first group of components and a low priority to the second group of components. The data is sent and received, and the received data is classified in accordance with the priority levels. If it is necessary to discard low priority components, a compensating device compensates for the discarded cells to ensure a constant image transmission across a congested channel.

Claims

1. A video cell sending terminal for sending video cells to a transmission channel for use in a transmission system which is for packaging digital video data into a cell and transmitting the same, the terminal comprising:

classifying means for classifying digital video data into at least two groups of coefficients, a first of which would cause image quality a drastic damage if discarded and a second of which would cause little damage even if discarded;

cell composing means for composing a cell with each group of coefficients;

priority level assigning means for assigning a higher priority regarding cell discard prohibition to the cell composed of the first group of coefficients and a lower priority to the cell composed of the second group of coefficients; and

sending means for sending out the cell which has been assigned a priority level.

2. A terminal of claim 1, further comprising:

dividing means for dividing the digital video data into blocks each consisting of a plurality of pixels; and

coding means for discrete-cosine-transforming the digital video data to convert the same into transform coefficients block by block;

wherein the coefficients are divided into DC and low-frequency coefficients and high-frequency coefficients, and the cell composed with the DC and low-frequency coefficients is assigned higher priority and the cell composed with the high-frequency coefficients is assigned lower priority.

3. A terminal of claim 1, further comprising:

dividing means for dividing the digital video data into pixel blocks each consisting of a plurality of pixels; and

coding means for discrete-cosine-transforming the digital video data to convert the same into transform coefficients block by block;

wherein the coefficients are divided into more significant bits and less significant bits, and the cell composed with the more significant bits is assigned higher priority and the cell composed with the less significant bits is assigned lower priority.

4. A terminal of claim 1, further comprising:

dividing means for dividing the digital video data into pixel blocks each consisting of a plurality of pixels; and

vector quantizing means for vector-quantizing the digital video data block by block using a retrieval tree;

wherein the vector-quantized digital video data are divided into a first group of data which is obtained at a hierarchy level closer to a root of the retrieval tree and a second group of data which is obtained at another hierarchy level farther from the above root, and the cell composed with the first group of data is assigned higher priority and the cell composed with the second group of data is assigned lower priority.

6. A terminal of claim 1, wherein:

said classifying means classifies the digital video data into sub-sampled pixel data and remaining pixel data;

said priority level assigning means assigns higher priority to a first cell composed the sub-sampled pixel data and lower priority to a second cell composed of the remaining pixel data; and

said cell sending means sends the second cell later than the first cell to assure the first cell arrives at a receiving terminal earlier than the second cell.

9. A terminal of claim 1, further comprising sequential number providing means for providing a plurality of cells obtained by segmenting a video packet with sequential numbers from the leading cell.

5. A video cell sending terminal for sending video cells to a transmission channel for use in a transmission system which is for packaging digital video data into a cell and transmitting the same, the terminal comprising:

classifying means for classifying digital video data into at least two groups of coefficients, a first of which would cause image quality a drastic damage if discarded and a second of which would cause little damage even if discarded;

cell composing means for composing a cell with each group of coefficients;

priority level assigning means for assigning a higher priority regarding cell discard prohibition to the cell composed of the first group of coefficients and a lower priority to the cell composed of the second group of coefficients;

sending means for sending out the cell which has been assigned a priority level;

dividing means for dividing the digital video data into pixel blocks, each consisting of a plurality of pixels; and

vector quantizing means for obtaining an average value data of each pixel block and further vector-quantizing a data obtained by subtracting the average value data from each pixel of the pixel block to obtain indexes;

wherein the cell composed with the average value data is assigned higher priority and the cell composed with the indexes is assigned lower priority.

7. A video cell sending terminal for sending video cells to a transmission channel for use in a transmission system which is for packaging digital video data into a cell and transmitting the same, the terminal comprising:

classifying means for classifying digital video data into at least two groups of coefficients, a first of which would cause image quality a drastic damage if discarded and a second of which would cause little damage even if discarded;

cell composing means for composing a cell with each group of coefficients;

priority level assigning means for assigning a higher priority regarding cell discard prohibition to the cell composed of the first group of coefficients and a lower priority to the cell composed of the second group of coefficients;

sending means for sending out the cell which has been assigned a priority level;

dividing means for dividing the digital video data into pixel blocks, each consisting of a plurality of pixels; and

vector quantizing means for gain/shape vector-quantizing the digital video data block by block to obtain shape vector quantizing indexes and gain vector quantizing indexes;

wherein the cells composed with the shape vector quantization indexes is assigned a higher priority and the cell composed with the gain VQ indexes is assigned a lower priority.

8. A video cell sending terminal for sending video cells to a transmission channel for use in a transmission system which is for packaging digital video data into a cell and transmitting the same, the terminal comprising:

classifying means for classifying digital video data into at least two groups of coefficients, a first of which would cause image quality a drastic damage if discarded and a second of which would cause little damage even if discarded;

cell composing means for composing a cell with each group of coefficients;

priority level assigning means for assigning a higher priority regarding cell discard prohibition to the cell composed of the first group of coefficients and a lower priority to the cell composed of the second group of coefficients;

sending means for sending out the cell which has been assigned a priority level;

dividing means for dividing the digital video data into pixel blocks, each consisting of a plurality of pixels; and

BTC (block truncation coding) means for obtaining an average value, bit data, each bit of which indicates whether each pixel data is larger or smaller than the average value, and a standard deflection of the digital video data;

wherein data indicating the average value are classified as a first group of data and the bit data and the standard deflection are classified as a second group of data, and the cell composed with the first group of data is assigned higher priority, and the cell composed with the second group of data is assigned lower priority.

10. A video cell sending terminal for sending video cells to a transmission channel for use in a transmission system which is for packaging digital video data into a cell and transmitting the same, the terminal comprising:

dividing means for dividing the digital video data into pixel blocks each consisting of a plurality of pixels; and

judging means for comparing each block of a current frame with the corresponding block of a frame immediately prior to the current frame and for judging whether the block is a moving picture block or a still picture block and further whether the still picture block is a transfer picture block or not, the transfer picture block meaning a very first still picture block altered from a moving picture block;

coding means for discrete-cosine-transforming the digital video data of at least the moving picture block and the transfer picture block to convert the same into transform coefficients;

classifying means for classifying the transform coefficients obtained from the moving picture block into low-frequency coefficients and high-frequency coefficients;

a first cell sending means for composing a cell with still picture block judgment data obtained by said judging means and sending the same;

a second cell sending means for composing a cell with the transform coefficients obtained form the transfer picture block and sending the same;

a third cell sending means for composing a cell with either of the low-frequency coefficients and the high-frequency coefficients and sending the same;

moving/still picture judgment data mark providing means for providing the cell sent by said first cell sending means with a mark indicating the cell is of moving/still picture judgment data; and

priority level assigning means for assigning lower priority regarding cell discard prohibition to the cell composed with the high-frequency coefficients and assigning higher priority to the other cell.

11. A terminal of claim 10, further comprising a sequential number providing means for providing each cell with a sequential number when at least said third cell sending means composes the lower-priority cell.

12. A video cell receiving terminal for receiving video cells and for restoring a video, said terminal being for use in a transmission system for packaging digital video data into a cell and transmitting the same, the terminal comprising:

priority level judging means for judging priority levels of video cells;

cell classifying means for classifying the video cells in accordance with the priority levels;

discarded data compensating means for judging whether a cell having lower priority has been discarded and in the case of cell discard, compensating data of the discarded cell with data of existent cells; and

synthesizing means for synthesizing data from cells classified by said cell classifying means and data compensated by said discarded data compensating means into digital video data.

13. A terminal of claim 12, wherein said discarded data compensating means discriminates a sequential number written in a certain area of each cell and detects cell discard if any number is omitted.

14. A video cell receiving terminal for receiving video cells and for restoring a video, said terminal being for use in a transmission system for packaging digital video data into a cell and transmitting the same, the terminal comprising:

cell analyzing means for analyzing a header of a received cell and judging whether the cell is of moving/still picture judgment data or not and whether the cell is assigned higher priority or lower priority regarding cell discard prohibition;

transfer picture block data extracting means for detecting a transfer picture block based on the moving/still picture judgment data obtained by said cell analyzing means and extracting data from a cell of the transfer picture block among the cells with the higher priority;

moving picture block data extracting means for extracting data from a cell of a moving picture block among the cells with the higher priority and the lower priority;

discarded data compensating means for judging whether a cell having lower priority has been discarded and in the case of cell discard, compensating data of the discarded cell with data of existent cells;

IDCT means for inverse-discrete-cosine-transforming data from cells of the transfer picture block and the moving picture block and the data compensated by said discarded data compensating means; and

video restoring means for restoring a video of each frame based on the video data which is inverse-discrete-cosine-transformed by said IDCT means and on the moving/still picture judgment data.

15. A transmission system comprising a sending terminal for packaging digital video data into a cell and sending the same and a receiving terminal for receiving the cells and restoring a video, wherein:

a sending terminal comprises dividing means for dividing digital video data into a first group of components which would cause image quality a drastic damage if discarded and a second group of components which would cause little damage even if discarded;

cell composing means for composing cells with each group of components; and

priority level assigning means for assigning higher priority to the cell composed with the first group of components than to the cell composed with the second group of components; and

a receiving terminal comprises cell classifying means for classifying received cells in accordance with priority levels;

cell discard judging means for judging cell discard; and

compensating means for compensating at least data of the discarded cell with a specified data in the case of cell discard.

16. A transmission system for packaging digital video data into a cell and transmitting the same, said system comprising:

a plurality of cell sending terminals having a function of dividing video data into a first cell group which would cause image quality a drastic damage if discarded and a second cell group which would cause little damage even if discarded;

a central unit for restoring a video from data sent from said cell sending terminals; and

a plurality of node devices for connecting said cell sending terminals and said central unit serially, each of said node devices having a priority cell multiplexing circuit for multiplexing the first group of cells, with priority, among cells sent from a terminal which is connected thereto and cells sent from another terminal which is connected to another node farther from the central unit than its own node device.

17. A system of claim 16, wherein each fo said cell multiplexing circuit comprises:

at least an input terminal port for a cell sent from a circuit farther from the central unit than its own node device;

a buffer memory for adjusting timing of inputting the cell through said input port;

a discrimination circuit for discriminating a priority level written in the header of the cell inputted from the terminal farther from the central unit than its own node device;

a cell determination circuit for determining which cell is to be transmitted next based on the number of cells transmittable from the terminal connected to its own node device, the cells being classified by priority level, and on the priority level discriminated by said discrimination circuit; and

a cell sending circuit for sending the cell selected by said cell determination circuit.

18. A system for transmitting and receiving digital video data comprising:

block forming means for forming said digital video data into blocks of digital video data;

dividing means for dividing said blocks into at least two discard priority groups, a first group containing digital video data that will not substantially reduce video quality if discarded, and a second group containing digital video data that will substantially reduce video quality if discarded;

means for assigning a discard priority classification to a block or gorup of blocks in accordance with said dividing means;

means for transmitting said blocks over a transmission channel, said first group of blocks being subject to discard by said transmission channel, and

means for receiving blocks transmitted over said transmission channel and for compensating for any blocks that were discarded during transmission.