Video coding using segmented frames and retransmission to overcome channel errors

• US 5,768,533 A
• Filed: 09/01/1995
• Issued: 06/16/1998
• Est. Priority Date: 09/01/1995
• Status: Expired due to Fees

• Current Assignee: National Semiconductor Corporation (Texas Instruments, Inc.)
• Original Assignee: National Semiconductor Corporation (Texas Instruments, Inc.)
• Inventors: Ran, Xiaonong
• Primary Examiner(s): Trammell, James P.
• Assistant Examiner(s): PEESO, THOMAS R
• Application Number:
  US08/522,688
• Time in Patent Office: 1,019 Days
• Field of Search: 364/514 R, 364/715.02, 371/32, 371/34, 371/37.1, 371/37.7, 371/38.1, 371/39.1, 371/40.2, 371/41, 371/48, 371/55, 395/181, 395/182.04, 395/182.16, 395/182.19, 395/185.01, 395/185.05, 395/200.77, 382/309, 341/94
• US Class Current: 709/247
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/166 concerning the amount of transmission errors, e.g. bit error rate [BER]
• CPC Class Codes: H04N 19/174 the region being a slice, e.g. a line of blocks or a group of blocks
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/148 Interfacing a video terminal to a particular transmission medium, e.g. ISDN

Abstract

A communication system and protocol uses retransmission techniques for video transmission on mobile/wireless channels. The system partitions frames of a moving image into frame segments, and combines a sequence of frame segments to form a sub-sequence of the moving image. The sub-sequences are treated as separate images which are separately encoded and transmitted to a receiver and then are combined to reassemble the moving image. A sender transmits to the receiver data packets, each data packet representing all or part of a digital code for a frame segment. The receiver requests retransmission of data packets containing detectable errors, indicates in a status buffer which digital codes have been received and whether the digital codes are intra or inter codes, and displays a frame only after all required data packets have been received without detectable errors. The segmented frames limit occasional failures to accurately retransmit data to individual sub-sequences, so that the failure to accurately transmit data is compensated for by subsequent transmission an intra coded digital code for a frame segment.

Claims

1. A method for communicating, the method comprising:

generating a first sequence of frames of a moving image;

spatially partitioning the moving image into a set of sub-sequences, wherein each sub-sequence contains a series of frame segments which are portions of the frames;

encoding each frame segment as a digital code, wherein each digital code is independent of the content of sub-sequences which do not include the frame segment encoded by the digital code; and

transmitting a signal representing the digital codes.

2. The method of claim 1, further comprising:

checking each digital code received by a receiver to determine whether any of the digital codes received contains an error;

transmitting from the receiver a request for retransmission of at least a portion of a digital code that when received contained an error;

retransmitting the packet to the receiver;

setting entries in a status buffer to indicate which digital codes the receiver received without an error;

checking the entries to identify a frame for which all digital codes required for decoding the identified frame have been received by the receiver without an error; and

decoding the identified frame.

3. The method of claim 2, wherein setting the entries in the status buffer further comprises setting each entry to indicate a coding process for a digital code corresponding to that entry, wherein possible coding processes include inter coding and intra coding.

4. The method of claim 3, wherein checking the entries comprises:

determining that the entries corresponding to the identified frame indicate that all digital codes for the frame have been received without errors; and

for each entry which corresponds to the identified frame and indicates the inter coding process for the digital code corresponding to the entry, determining that the receiver has received all digital codes required for decoding a frame segment which is in a preceding frame and in the same sub-sequence as the frame segment corresponding to that entry.

5. The method of claim 2, wherein transmitting a signal representing the digital codes comprises:

dividing each digital code into parts;

forming data packets which represent the parts, wherein the data packets have lengths less than a threshold length and the signal represents the data packets.

6. The method of claim 5, wherein transmitting the signal representing the digital codes further comprises:

generating a cyclic redundancy code for each of the parts of the digital codes; and

inserting the cyclic redundancy code for each part in the data packet representing that part.

7. The method of claim 6, wherein checking each digital code comprises checking cyclic redundancy code in each data packet received by the receiver.

8. The method of claim 7, wherein checking each digital code further comprises parsing the digital code to detect syntax errors.

9. The method of claim 2, wherein checking each digital code comprises parsing the digital code to detect syntax errors.

10. The method of claim 1, wherein transmitting a signal representing the digital codes comprises:

dividing each digital code into parts;

forming data packets which represent the parts, wherein the data packets have lengths less than a threshold length and the signal represents the data packets.

11. The method of claim 10, wherein transmitting the signal representing the digital codes further comprises:

generating a cyclic redundancy code for each of the parts of the digital codes; and

inserting the cyclic redundancy code for each part in the data packet representing that part.

12. The method of claim 1, wherein the encoding includes encoding the frame segment to propagate information from a previous frame segment of the same sub-sequence and encoding the frame segment independent of other frame segments.

13. A method for communicating, the method comprising:

determining a threshold length for packets transmitted on a channel which connects a sender to a receiver, wherein the threshold length depends on a pattern of errors on the channel;

generating a first sequence of frames of a moving image;

encoding each frame as a series of digital values;

transmitting a signal from the sender to the receiver via the channel, wherein;

the signal represents sets of packets;

each set of packets corresponds to a frame;

each packet contains digital values from the series for the corresponding frame; and

each packet has a length that is less than the threshold length;

determining whether any of the transmitted packets contain an error when received by the receiver;

sending from the receiver to the sender a request for retransmission of a packet containing an error;

retransmitting the packet from the sender to the receiver; and

converting packets received by the receiver without an error to digital values representing a second sequence of frames.

14. The method of claim 13, wherein determining the threshold length comprises decreasing the threshold length in response to the receiver sending frequent requests for retransmission.

15. The method of claim 13, wherein converting packets comprises skipping data packets corresponding to a frame which is in the first sequence and is partly represented by a data packet which contained an error when received by the receiver.

16. A video encoder comprising:

counters which correspond to regions of a moving image, wherein each counter also corresponds to frame segments which indicate the content of the region which corresponds to that counter; and

an encoding circuit adapted to partition a frame of the moving image into frame segments which correspond to the regions, to select inter coding or intra coding as a coding process for each frame segment, and to use the selected coding process for a frame segment to generate a digital code for that frame, wherein the encoding circuit selects the coding process for each frame segment according to a count in the one of the counters which corresponds to that frame segment.

17. The encoder of claim 16, wherein the encoding circuit further comprises means for incrementing a count each time a corresponding frame segment is inter coded and resetting the count each time the corresponding frame segment is intra coded.

18. The encoder of claim 16, further comprising:

a buffer coupled to the encoding circuit to store data packets representing digital codes; and

a retransmission controller coupled to the buffer to select from the buffer either a current data packet for transmission or a previously transmitted data packet for retransmission.

19. The encoder of claim 18, wherein the buffer comprises a transmission buffer and a retransmission buffer.

20. A video decoder, comprising:

a receiving buffer for data packets which represent portions of frame segments;

a status buffer containing an array of entries, each entry corresponding to a frame segment and indicating whether one or more data packets for that frame segment have been received without an error, wherein a frame segment for which all data packets have been received without an error has a corresponding entry which indicates whether the data packets for the frame segment represent an inter code or an intra code; and

a decoding circuit coupled to the receiving buffer and the status buffer, wherein the decoding circuit decodes a frame after checking the entries in the status buffer and determining the frame is the most recent frame for which all digital packets required for decoding have been received without an error.

21. A method for communicating, comprising the steps of:

generating a first sequence of frames of a moving image;

spatially partitioning the moving image into a set of sub-sequences, wherein each sub-sequence contains a series of frame segments which are portions of the frames;

encoding each frame segment as a digital code, wherein each digital code is independent of the content of sub-sequences which do not include the frame segment encoded by the digital code;

transmitting a signal representing the digital code;

indicating if the digital code is received without an error; and

indicating a coding process for the digital code, wherein possible coding processes include inter coding and intra coding.