System and method for transmission of video signals using multiple channels

• US 7,551,671 B2
• Filed: 12/01/2003
• Issued: 06/23/2009
• Est. Priority Date: 04/16/2003
• Status: Active Grant

• Current Assignee: General Dynamics C4 Systems Incorporated (General Dynamics Corporation)
• Original Assignee: General Dynamics Decision Systems, Inc. (General Dynamics Corporation)
• Inventors: Abousleman, Glen P., Karam, Lina J., Tyldesley, Katherine S.
• Primary Examiner(s): Liu; Shuwang
• Assistant Examiner(s): Timory; Kabir A
• Application Number:
  US10/725,126
• Publication Number:
  US 20040218626A1
• Time in Patent Office: 2,031 Days
• Field of Search: 375/240, 375/240.03, 375/240.2, 375/252, 375/240.19, 375/240.27, 348/699
• US Class Current: 375/240
• CPC Class Codes: H04N 21/238 Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/2385 Channel allocation H04N21/266 takes precedence; Bandwidth allocation H04N21/24 takes precedence ; allocation of channels according to the instantaneous demands of the users in time-division multiplex systems H04J3/1682; admission control, resource allocation in open networks H04L12/5692; arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896; negotiating bandwidth in wireless networks H04W28/16
• CPC Class Codes: H04N 21/6131 involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6143 involving transmission via a satellite
• CPC Class Codes: H04N 21/631 Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments

Abstract

In a communication network (20), a video encoder/decoder system (114) and an encoding method (150) facilitate transmission of video frames (116) over multiple low-data-rate channels (46). Frame data (204) is generated for each video frame (116). The frame data (204) is transformed (172) to obtain transform coefficients (212), which are assembled (174) into quadtrees (216) and separately coded (178). In addition, motion vectors (166) are split into coding blocks (188) and separately coded (190). The quadtrees (126) and the motion vectors (166) are independently distributed among the multiple channels (46) for transmission. A decoding method (360) facilitates error resilient reception of transform coefficient packets (222) and motion vector packets (244) so that lost transform coefficients (374) and/or lost motion vectors (384) can be estimated at a receiving video encoder/decoder system (114) to reconstruct a received video frames 144.

Claims

1. A method of facilitating transmission of video frames over multiple channels in a communication system, said method comprising:

for each of said video frames, generating frame data representative of said each video frame;

transforming said frame data to obtain transform coefficients of said frame data;

assembling quadtrees of said transform coefficients, each of said quadtrees including a group of said transform coefficients associated with an equivalent spatial location in said each video frame;

separately coding said quadtrees to form coded quadtree coefficient groups, one each of said coded quadtree coefficient groups being associated with one each of a plurality of distinct spatial locations in said each video frame; and

distributing said coded quadtree coefficient groups among said multiple channels for transmission, said distributing operation including assigning said coded quadtree coefficient groups to said multiple channels such that said coded quadtree coefficient groups representing adjacent ones of said distinct spatial locations in said each video frame will be transmitted over different ones of said multiple channels.

2. A method as claimed in claim 1 wherein:

said generating operation generates said frame data and motion vectors; and

said method further comprises;

forming blocks of said motion vectors;

separately coding said blocks to form coded motion vector blocks; and

distributing said coded motion vector blocks among said multiple channels for transmission.

3. A method as claimed in claim 2 utilizing a Huffman coding algorithm to obtain said coded motion vector blocks.

4. A method as claimed in claim 1 further comprising forming said quadtrees into 16×

16 coding blocks prior to said coding operation.

5. A method as claimed in claim 1 wherein:

said transforming operation comprises performing a wavelet transform such that said transform coefficients are wavelet coefficients; and

said coding operation comprises utilizing a zerotree wavelet coding algorithm.

6. A method as claimed in claim 1 wherein said coding operation comprises:

assembling said coded quadtree coefficient groups into packets;

for each of said packets, assigning one of said multiple channels for transmission of said each packet; and

forwarding said each packet toward said assigned one of said multiple channels.

7. A method as claimed in claim 1 further comprising:

assembling said coded quadtree coefficient groups into packets;

attaching a packet identifier to each of said packets prior to said distributing operation;

receiving said packets at a decoder via said multiple channels; and

reconstructing said each video frame at said decoder from said received packets in response to said packet identifier.

8. A method as claimed in claim 7 wherein said reconstructing operation comprises:

determining an unsuccessful transmission of one of said packets; and

forming an estimate of said transform coefficients of said one of said packets in response to adjacent ones of said transform coefficients of others of said packets received via others of said multiple channels.

9. A method as claimed in claim 7 wherein said packet is a first packet, said packet identifier is a first packet identifier, and said method further comprises:

generating motion vectors representative of said each video frame;

forming blocks of said motion vectors;

separately coding said blocks to form coded motion vector blocks;

assembling said coded motion vector blocks into second packets;

attaching a second packet identifier to each of said second packets;

distributing said first packets and said second packets among said multiple channels for transmission;

receiving said second packets at said decoder via said multiple channels, and said reconstructing operation reconstructs said each video frame from said first and second packets in response to said first and second packet identifiers.

10. A method as claimed in claim 9 further comprising:

determining an unsuccessful transmission of one of said second packets; and

estimating said motion vectors of said one of said second packets from an average of surrounding ones of said motion vectors of others of said second packets received via others of said multiple channels.

11. A method as claimed in claim 7 wherein said reconstructing operation comprises adaptively buffering said received packets.

12. A method as claimed in claim 1 wherein said communication system is a satellite-based communication network and said multiple channels are wireless voice channels managed by said satellite-based communication network.

13. A method of facilitating transmission of video frames over multiple channels in a communication system, said method comprising:

for each of said video frames, generating frame data and motion vectors representative of said each video frame;

transforming said frame data to obtain transform coefficients of said frame data;

assembling quadtrees of said transform coefficients, each of said quadtrees including a group of said transform coefficients associated with an equivalent spatial location in said each video frame;

separately coding said quadtrees to form coded quadtree coefficient groups, one each of said coded quadtree coefficient groups being associated with one each of a plurality of distinct spatial locations in said each video frame;

forming blocks of said motion vectors;

separately coding said blocks to form coded motion vector blocks; and

distributing said coded quadtree coefficient groups and said coded motion vector blocks among said multiple channels for transmission, said distributing operation including;

assigning said coded quadtree coefficient groups to said multiple channels such that said coded quadtree coefficient groups representing adjacent ones of said distinct spatial locations in said each video frame will be transmitted over different ones of said multiple channels; and

assigning said coded motion vector blocks to said multiple channels such that adjacent portions of said motion vectors will be transmitted over different ones of said multiple channels.

14. A method of facilitating transmission of video frames over multiple channels in a communication system, said method comprising:

for each of said video frames, generating frame data and motion vectors representative of said each video frame;

transforming said frame data to obtain transform coefficients of said frame data;

assembling quadtrees of said transform coefficients, each of said quadtrees including a group of said transform coefficients associated with an equivalent spatial location in said each video frame;

separately coding said quadtrees to form coded quadtree coefficient groups, one each of said coded quadtree coefficient groups being associated with one each of a plurality of distinct spatial locations in said each video frame;

forming blocks of said motion vectors;

separately coding said blocks to form coded motion vector blocks; and

distributing said coded quadtree coefficient groups and said coded motion vector blocks among said multiple channels for transmission, wherein said coded quadtree coefficient groups are distributed among said multiple channels independent from said coded motion vector blocks, and said coded quadtree coefficient groups are distributed such that said coded quadtree coefficient groups representing adjacent ones of said distinct spatial locations in said each video frame will be transmitted over different ones of said multiple channels.

15. A system for facilitating transmission of video frames over multiple channels in a communication network, said system comprising:

an input for receiving each of said video frames;

a processor in communication with said input for generating frame data representative of said each video frame;

a wavelet transformer in communication with said processor for transforming said frame data to obtain wavelet coefficients of said frame data;

a quadtree-based compressor for receiving said wavelet coefficients and assembling quadtrees of said wavelet coefficients, each of said quadtrees including a group of wavelet coefficients associated with an equivalent spatial location in said each video frame;

a coder for separately coding said quadtrees to form coded quadtree coefficient groups, one each of said coded quadtree coefficient groups being associated with one each of a plurality of distinct spatial locations in said each video frame;

an output interface in communication with said coder for receiving said coded quadtree coefficient groups, said output interface assigning said coded quadtree coefficient groups to said multiple channels such that said coded quadtree coefficient groups representing adjacent ones of said distinct spatial locations in said each video frame will be transmitted over different ones of said multiple channels;

an input interface for receiving transmitted packets of coded quadtree coefficient groups from a second system via said multiple channels;

buffer elements in communication with said input interface, one each of said buffer elements being associated with one each of said multiple channels, said input interface forwarding said transmitted coded quadtree coefficient groups received at ones of said multiple channels toward said buffer elements associated with said ones of said multiple channels;

a decoder in communication with said buffer elements for receiving said transmitted coded quadtree coefficient groups and reconstructing second video frames represented by said transmitted coded quadtree coefficient groups; and

an estimator in communication with said decoder, wherein upon determination of an unsuccessful transmission of one of said packets, said estimator forms an estimate of said transmitted coded quadtree coefficient groups of said one of said packets in response to adjacent ones of said transmitted quadtree coefficient groups of others of said packets received via said multiple channels.

16. A system for facilitating transmission of video frames over multiple channels in a communication network, said system comprising:

an input for receiving each of said video frames;

a processor in communication with said input for generating frame data representative of said each video frame;

a wavelet transformer in communication with said processor for transforming said frame data to obtain wavelet coefficients of said frame data;

a quadtree-based compressor for receiving said wavelet coefficients and assembling quadtrees of said wavelet coefficients, each of said quadtrees including a group of wavelet coefficients associated with an equivalent spatial location in said each video frame;

a coder for separately coding said quadtrees to form coded quadtree coefficient groups, one each of said coded quadtree coefficient groups being associated with one each of a plurality of distinct spatial locations in said each video frame; and

an output interface in communication with said coder for receiving said coded quadtree coefficient groups, said output interface assigning said coded quadtree coefficient groups to said multiple channels such that said coded quadtree coefficient groups representing adjacent ones of said distinct spatial locations in said each video frame will be transmitted over different ones of said multiple channels;

an input interface for receiving transmitted first packets of coded quadtree coefficient groups and second packets of motion vector blocks from a second system via said multiple channels;

buffer elements in communication with said input interface, one each of said buffer elements being associated with one each of said multiple channels, said input interface forwarding said transmitted coded quadtree coefficient groups received at ones of said multiple channels toward said buffer elements associated with said ones of said multiple channels; and

a decoder in communication with said buffer elements for receiving said first and second packets and reconstructing said second video frames from said first and second packets.

17. A system as claimed in claim 16 further comprising an estimator in communication with said decoder, wherein upon determination of an unsuccessful transmission of one of said second packets, said estimator forms an estimate of said motion vector blocks of said one of said second packets from an average of surrounding ones of said motion vectors of others of said second packets received via said multiple channels.