Rate adaptive video coding

• US 20060088094A1
• Filed: 09/15/2005
• Published: 04/27/2006
• Est. Priority Date: 09/17/2004
• Status: Abandoned Application

• Current Assignee: Mitsubishi Electric Information Technology Centre Europe BV (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Inventors: Bober, Miroslaw, Cieplinski, Leszek, Ghanbari, Soroush
• Application Number:
  US11/226,210
• Publication Number:
  US 20060088094A1
• Time in Patent Office: Days
• US Class Current: 375/240.10
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/174 the region being a slice, e.g. a line of blocks or a group of blocks
• CPC Class Codes: H04N 19/31 in the temporal domain
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip

Abstract

A method of encoding a sequence of frames for transmission comprises encoding a sequence of frames under different conditions to produce a plurality of encoded bit streams each representing the sequence of frames, for transmission at different bit rates, and storing each of the encoded bit streams in a respective buffer, and outputting a bit stream from a buffer for transmission, and the method further comprises switching between buffers to change the bit rate of the data for transmission, wherein at least one frame to be stored in one buffer is encoded with reference to a frame stored in another buffer.

Claims

1. A method of encoding a sequence of video frames for transmission comprising encoding a sequence of frames under different conditions to produce a plurality of encoded bit streams each representing the sequence of frames, for transmission at different bit rates, and storing each of the encoded bit streams in a respective buffer, and outputting a bit stream from a buffer for transmission, the method further comprising switching between buffers to change the bit rate of the data for transmission, characterised in that at least one frame to be stored in one buffer is encoded with reference to a frame stored in another buffer.

2. The method of claim 1 wherein each frame to be stored in said one buffer is encoded with reference to a frame stored in another buffer.

3. The method of claim 1 wherein a frame is encoded with reference to a frame stored in another buffer while said another buffer is used for transmission.

4. The method of claim 1 wherein frames for said one buffer are encoded with reference to a frame for the buffer that stores video data compressed at the closest bit rate to the bit rate of the compressed video data stored in said one buffer chosen from the buffers with video data compressed at bit rate closer to the bit rate of the compressed video data stored in the buffer being used for transmission than to the bitrate of the compressed video data stored in the said one buffer.

5. The method of claim 1 wherein when data is transmitted from a first buffer then frames to be stored in the first buffer are encoded with reference to a frame previously encoded and stored in said buffer, and frames to be stored in another buffer are also encoded with reference to a frame previously encoded and stored in said first buffer, and when transmission is switched to a second buffer, then frames to be stored in said second buffer are encoded with reference to a frame previously encoded and stored in said second buffer, and frames to be stored in another buffer are also encoded with reference to a frame previously encoded and stored in said second buffer.

6. The method of claim 1 wherein more than one frame for a buffer is encoded with reference to the same frame for another buffer.

7. The method of claim 1 wherein different frames for a buffer are encoded with reference to different frames for another buffer.

8. The method of claim 1 comprising encoding frames to be stored in different buffers with reference to different frames in different buffers.

9. The method of claim 1 wherein frames are encoded with reference to frames for the buffer which is the transmitting buffer.

10. The method of claim 1 wherein the sequence of frames is encoded to produce different bit streams at different bit rates by using different spatial resolution and/or different temporal resolution and/or different picture quality.

11. The method of claim 10 wherein the sequence of frames is encoded at a plurality of different frame rates.

12. The method of claim 1 further comprising changing the bit rate within an encoded bit stream and for a respective buffer.

13. The method of claim 12 comprising changing the frame rate to achieve the different bit rate.

14. The method of claim 10 wherein the bit rate change is after a switching point.

15. An encoded bit stream representing a sequence of images derived using the method of claim 1.

16. A method of decoding an image or sequence of images encoded using the method of claim 1.

17. The method of claim 16 comprising reconstructing data received at a first bit rate with reference to data received at a second bit rate.

18. Use including, for example, transmission or reception of data encoded using the method of claim 1.

19. A method of transmitting data representing a sequence of frames encoded using the method of claim 1 comprising switching transmission from a first buffer to a second buffer depending on a change of conditions such as appropriate bit rate, wherein frame data transmitted from a second buffer is already encoded with reference to frame data sent from the first buffer.

20. A coding and/or decoding apparatus for executing a method of claim 1.

21. A computer program, system or computer-readable storage medium for executing the method of claim 1.

22. The method of claim 1 wherein, when a buffer is used for transmission, frames for other buffers are encoded with reference to frames in the transmitting buffer.