Scalable video encoding and decoding method using switching pictures and apparatus thereof

• US 8,619,854 B2
• Filed: 03/27/2007
• Issued: 12/31/2013
• Est. Priority Date: 03/27/2006
• Status: Expired due to Fees

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Choi, Hae-Chul, Kim, Jae-Gon, Hong, Jin-Woo, Kim, Hae-Kwang, Jia, Jie
• Primary Examiner(s): Vo, Tung
• Assistant Examiner(s): SMITH, STEPHEN R
• Application Number:
  US12/294,633
• Publication Number:
  US 20110150084A1
• Time in Patent Office: 2,471 Days
• Field of Search: 37524001-24029, 714/746, 714/776
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/4345 Extraction or processing of SI, e.g. extracting service information from an MPEG stream

Abstract

A conventional new video coding technology can provide a bitstream switching picture by encoding the bitstream switching picture into an I picture. However, an encoding efficiency is greatly reduced. As such, the new video coding technology does not provide an efficient bitstream switching function. Also, other advantages provided by a switching picture technology such as a random access, error durability, and a bitstream splicing are not provided. Provided is an apparatus for encoding a video bitstream including a base layer bitstream and an enhancement layer bitstream by encoding an enhancement layer picture of the enhancement layer bitstream, which is reproduced immediately after a base layer picture of the base layer bitstream is reproduced, into a non-switching pictures by interlayer prediction using a reference image generated by decoding a pre-encoded base layer picture or by motion prediction using another reference image generated by decoding a pre-encoded enhancement layer picture, and into a switching picture, which is decoded into the same image as the non-switching picture, by an interlayer prediction using the non-switching picture and a reference image generated by decoding a pre-encoded base layer picture, while the base layer picture is being reproduced.

Claims

1. A method for encoding a video bitstream, the method comprises:

receiving an original image;

compressing the original image;

outputting the received and compressed original image as at least one of a high quality bitstream and a low quality bitstream,

wherein the high quality bitstream comprises an enhancement layer bitstream, and

wherein the low quality bitstream comprises a base layer bitstream;

using scalable video coding technology to generate the base layer bitstream and the enhancement layer bitstream from the received and compressed original image,

wherein an enhancement layer picture of the enhancement layer bitstream is encoded into switching picture and non-switching picture,

wherein a switching picture, which represents the same decoded image as the non-switching picture, is encoded by interlayer prediction,

wherein, during reproduction of the base layer picture of the base layer bitstream, the enhancement layer picture is configured to be able to be reproduced consecutively after anyone of the reproduced base layer pictures,

wherein each of the base layer bitstream and the enhancement layer bitstream only comprises at least one of I frames, which is an intra-coded picture, and P frames,

wherein the I frame is the first frame of each of the base layer bitstream and the enhancement layer bitstream,

wherein the P frame follows the I frame, and

wherein the P frame holds only changes from the previous frame,

wherein each of the base layer bitstream and the enhancement layer bitstream have at least two or more P frames,

wherein after reproduction of each and everyone one of the P frames of the base layer bitstream, a user is able to watch what would be a next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream without having to reproduce any previous P frames of the enhancement layer bitstream,

wherein the user selects what would be the next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream, and

wherein a next P frame of the enhancement layer bitstream is decoded with reference to the switching picture.

2. The method of claim 1, wherein the non-switching picture is encoded by prediction using an original image and a reference image generated by decoding a pre-encoded base layer picture and a pre-encoded enhancement layer picture, and the switching picture is encoded by interlayer prediction using a reference image generated by decoding a pre-encoded base layer picture.

3. The method of claim 2, wherein the reference image used for the prediction when the switching picture is encoded is different from the reference image used for the prediction when the non-switching picture is encoded.

4. A method of encoding, the method comprising:

a non-switching picture in which a base layer bitstream and an enhancement layer bitstream are encoded for interlayer reproduction conversion of an original image to be encoded, wherein the non-switching picture is encoded by prediction using an original image and a reference image generated by decoding a pre-encoded base layer picture and a pre-encoded enhancement layer picture,

wherein each of the base layer bitstream and the enhancement layer bitstream only comprises at least one of I frames, which is an intra-coded picture, and P frames, which is a forward predicted picture,

wherein at least two or more of the P frames follow the I frame,

wherein each of the two or more P frames in the enhancement layer bitstream represent a unique picture based on a high quality video bitstream,

wherein when each of the two or more P frames in the enhancement layer bitstream representing the unique picture based on the high quality bitstream the same unique picture is represented by the respective P frames in the base layer bitstream as a low quality video bitstream,

wherein each of the at least two or more P frame of the base layer bitstream and the enhancement layer bitstream represents a unique picture,

wherein each of the two more P frames of the enhancement layer bitstream represents the respective unique picture in a high quality bitstream,

wherein each of the two more P frames of the base layer bitstream represents the respective unique picture in a low quality bitstream,

wherein after reproduction of the unique picture from each and every one of the P frames of the base layer bitstream, a user is able to watch what would be a next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream without having to reproduce any previous P frames of the enhancement layer bitstream,

wherein the user selects what would be the next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream, and

wherein a next P frame of the enhancement layer bitstream is decoded with reference to the switching picture.

5. The method of claim 4, comprising (a) encoding the non-switching picture by prediction using a reference image generated by decoding a pre-encoded base layer picture or a pre-encoded enhancement layer picture.

6. The method of claim 5, wherein operation (a) comprises:

generating prediction information and a prediction image by using the original image, and the reference image generated by decoding a pre-encoded base layer picture or a pre-encoded enhancement layer picture;

generating a bitstream by compressing a residual image which corresponds to the difference between the original image and the prediction image; and

combining and outputting a bitstream generated by the image conversion unit and the prediction information.

7. A method of encoding, the method comprising:

a switching picture, in which a base layer bitstream and an enhancement layer bitstream are generated for interlayer reproduction conversion of an original image to be encoded by using the base layer bitstream and the enhancement layer bitstream which comprises a non-switching picture, wherein a switching picture, which represents the same decoded image as the non-switching picture, is encoded by interlayer prediction using the non-switching picture and a reference image generated by decoding a pre-encoded base layer picture,

wherein each of the base layer bitstream and the enhancement layer bitstream only comprises at least one of I frames, which is an intra-coded picture, and a plurality of P frames,

wherein the I frame is the first frame of each of the base layer bitstream and the enhancement layer bitstream,

wherein the P frame follows the I frame,

wherein the P frame holds only changes from the previous frame, and

wherein at least two or more of the P frames follow the I frame,

wherein the switching picture is separate and distinct from the base layer bitstream,

wherein after reproduction of each and every one of the P frames from the base layer bitstream, a user is able to watch what would be a next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream without having to reproduce any previous P frames of the enhancement layer bitstream, and

wherein the user selects what would be the next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream, and

wherein a next P frame of the enhancement layer bitstream is decoded with reference to the switching picture.

8. The method of claim 7, comprising (b) encoding the switching picture which represents the same decoded image as the non-switching picture in accordance with the interlayer prediction using the base layer picture.

9. The method of claim 8, wherein operation (b) comprises:

generating prediction information and a prediction image by interlayer prediction using the non-switching picture, and the reference image generated by decoding a pre-encoded base layer picture;

compressing a residual image which corresponds to the difference between the non-switching picture and the prediction information; and

combining and outputting image information generated by the image conversion unit and the prediction information.

10. A method of encoding, the method comprising:

a base layer bitstream and an enhancement layer bitstream for interlayer reproduction conversion of an original image to be encoded, the method comprising encoding the non-switching picture by prediction using an original image and a reference image generated by decoding a pre-encoded base layer picture and a pre-encoded enhancement layer picture,

wherein each of the base layer bitstream and the enhancement layer bitstream only comprises at least one of I frames, which is an intra-coded picture, and P frames,

wherein the I frame is the first frame of each of the base layer bitstream and the enhancement layer bitstream,

wherein the plurality of P frames follow the I frame, and

wherein each of the plurality of P frames hold only changes from the previous frame,

wherein after reproduction of each and every one of the P frames from the pre-encoded base layer picture of the base layer bitstream, a user is able to watch what would be a next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream without having to reproduce any previous P frames of the enhancement layer bitstream,

wherein the user selects what would be the next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream, and

wherein a next P frame of the enhancement layer bitstream is decoded with reference to the switching picture.

11. The method of claim 10, wherein the encoding of the non-switching picture comprises (a) encoding the non-switching picture by prediction using a reference image generated by decoding a pre-encoded base layer picture or a pre-encoded enhancement layer picture.

12. The method of claim 11, wherein operation (a) comprises:

generating prediction information and a prediction image by using the original image, and the reference image generated by decoding a pre-encoded base layer picture or a pre-encoded enhancement layer picture;

generating a bitstream by compressing a residual image which corresponds to the difference between the original image and the prediction image; and

combining and outputting a bitstream generated by the image conversion unit and the prediction information.

13. The method of claim 10, further comprising encoding a switching picture, which represents the same decoded image as the non-switching picture, by interlayer prediction using the non-switching picture and a reference image generated by decoding a pre-encoded base layer picture.

14. The method of claim 13, wherein the encoding of the switching picture comprises (b) encoding the switching picture which represents the same decoded image as the non-switching picture in accordance with the interlayer prediction using the base layer picture.

15. The method of claim 14, wherein operation (b) comprises:

generating prediction information and a prediction image by an interlayer prediction using the non-switching picture, and the reference image generated by decoding a pre-encoded base layer picture;

compressing a residual image which corresponds to the difference between the non-switching picture and the prediction information; and

combining and outputting image information generated by the image conversion unit and the prediction information.

16. A method of decoding, the method comprising:

a non-switching picture by decoding a bitstream comprising switching pictures for interlayer reproduction conversion between a base layer bitstream and an enhancement layer bitstream, wherein, if an enhancement layer picture is to be reproduced while a base layer picture of a base layer bitstream is being reproduced, a non-switching picture comprised in an enhancement layer bitstream is decoded by using prediction information used when the non-switching picture was encoded,

wherein each of the base layer bitstream and the enhancement layer bitstream only comprises at least one of I frames, which is an intra-coded picture, and a plurality of P frames,

wherein the I frame is the first frame of each of the base layer bitstream and the enhancement layer bitstream,

wherein the plurality of P frames follow the I frame, and

wherein each of the plurality of P frames hold only changes from the previous frame,

wherein after reproduction of each and every one of the P frames from the base layer bitstream, a user is able to watch what would be a next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream without having to reproduce any previous P frames of the enhancement layer bitstream,

wherein the user selects what would be the next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream, and

wherein a next P frame of the enhancement layer bitstream is decoded with reference to the switching picture.

17. A method of decoding, the method comprising:

a switching picture by decoding a bitstream comprising switching pictures for interlayer reproduction conversion between a base layer bitstream and an enhancement layer bitstream, wherein, if an enhancement layer picture is to be reproduced while any one of plurality of base layer pictures of a base layer bitstream is being reproduced, a switching picture comprised in an enhancement layer bitstream is decoded by using prediction information used when the switching picture was encoded,

wherein each of the base layer bitstream and the enhancement layer bitstream only comprises at least one of I frames, which is an intra-coded picture, and a plurality of P frames,

wherein the I frame is the first frame of each of the base layer bitstream and the enhancement layer bitstream,

wherein the plurality of P frames follow the I frame, and

wherein each of the plurality of P frames hold only changes from the previous frame,

wherein after reproduction of each and every one of the P frames from the base layer bitstream, a user is able to watch what would be a next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream without having to reproduce any previous P frames of the enhancement layer bitstream,

wherein the user selects what would be the next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream, and

wherein a next P frame of the enhancement layer bitstream is decoded with reference to the switching picture.

18. A method of decoding, the method comprising:

a non-switching picture by decoding a bitstream comprising switching pictures for interlayer reproduction conversion between a base layer bitstream and an enhancement layer bitstream, the method comprising decoding an enhancement layer picture by using a non-switching picture included in the enhancement layer bitstream, if an enhancement layer picture is to be reproduced while a base layer picture of the base layer bitstream is being reproduced,

wherein each of the base layer bitstream and the enhancement layer bitstream only comprises at least one of I frames, which is an intra-coded picture, and a plurality of P frames,

wherein the I frame is the first frame of each of the base layer bitstream and the enhancement layer bitstream,

wherein the plurality of P frames follow the I frame,

wherein each of the plurality of P frames hold only changes from the previous frame,

wherein after reproduction of each and every one of the P frames from the base layer bitstream, a user is able to watch what would be a next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream without having to reproduce any previous P frames of the enhancement layer bitstream,

wherein the user selects what would be the next P frame of the base layer bitstream as the P frame of the enhancement layer bitstream, and

wherein a next P frame of the enhancement layer bitstream is decoded with reference to the switching picture.

19. The method of claim 18, further comprising decoding an enhancement layer picture by using a switching picture comprised in the bitstream, if the enhancement layer picture is to be reproduced while a base layer picture of the base layer bitstream is being reproduced.