Coding device and coding method

• US 6,226,326 B1
• Filed: 08/05/1999
• Issued: 05/01/2001
• Est. Priority Date: 12/08/1997
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Mihara, Kanji
• Primary Examiner(s): BRITTON, HOWARD W
• Application Number:
  US09/368,550
• Time in Patent Office: 635 Days
• Field of Search: 375/240.03, 375/240.04, 375/240.05, 375/240.06, 375/240.07
• US Class Current: 375/240.05
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/157 Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/23655 Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization

Abstract

A video encoder for changing the bit rate at a halfway point in a GOP by using a TM5 (Test Model 5) bit rate control algorithm is provided. Using a bit quantity Rj(+1) allocated to non-coded pictures at and after a coding target picture (j+1), a target bit quantity T(j+1) allocated to the coding target picture (j+1) is calculated. In the case where pictures up to a picture (j) at a halfway point in a GOP are coded at a first bit rate and the picture (j+1) is coded at a second bit rate, the bit quantity R(j+1) allocated to non-coded pictures for calculating the target bit quantity R(j+1) is corrected to a bit quantity R(j+1) for non-coded pictures at the time when the pictures from a leading picture of the GOP are coded at the second bit rate. Thus, seamless bit rate change can be carried out at a halfway point in the GOP by using the fixed rate algorithm such as TM5.

Claims

1. A coding device for coding video data on the basis of a designated bit rate, the device comprising:

control means for calculating a target bit quantity allocated to each picture included in a GOP on the basis of the designated bit rate; and

coding means for coding a coding target picture on the basis of the target bit quantity controlled by the control means,

the control means correcting the target bit quantity allocated to the coding target picture on the basis of the difference between a first bit rate and a second bit rate when the designated bit rate is changed from the first bit rate to the second bit rate in the case where coding processing of the coding target picture is carried out by the coding means.

2. The coding device as claimed in claim 1, wherein the control means finds the target bit quantity allocated to the coding target picture by distributing a bit quantity allocated to non-coded pictures that have not been coded in the target GOP in accordance with the picture type of the coding target picture.

3. The coding device as claimed in claim 2, wherein the control means corrects the bit quantity of non-coded pictures in accordance with the difference between the first bit rate and the second bit rate, and calculates the target bit quantity of the coding target picture on the basis of the corrected bit quantity of non-coded pictures.

4. The coding device as claimed in claim 2, wherein the control means corrects the bit quantity of non-coded pictures by using a value obtained by multiplying the difference between a bit quantity per picture at the first bit rate and a bit quantity per picture at the second bit rate by the number of non-coded pictures, and

calculates the target bit quantity of the coding target picture on the basis of the corrected bit quantity of non-coded pictures.

5. The coding device as claimed in claim 4, wherein an algorithm for calculating the target bit quantity of the coding target picture is a feedback-type arithmetic algorithm for calculating global complexity indicating complexity of a screen on the basis of the quantity of generated bits generated as a result of coding processing of each picture by the coding means, and calculating the target bit quantity of the coding target picture on the basis of the global complexity and the bit quantity of non-coded pictures.

6. The coding device as claimed in claim 4, wherein in coding pictures up to a picture immediately before the coding target picture at the first bit rate and coding pictures from the coding target picture at the second bit rate, the control means finds the bit quantity of non-coded pictures at and after the coding target picture by subtracting the quantity of generated bits generated by coding processing of the picture immediately before the coding target picture from the bit quantity allocated to the non-coded pictures at and after the picture immediately before the coding target picture.

7. The coding device as claimed in claim 6, wherein in the case where a leading picture of a GOP next to the target GOP is coded after coding pictures up to the picture immediately before the coding target picture at the first bit rate and coding pictures from the coding target picture at the second bit rate, the control means corrects the bit quantity allocated to non-coded pictures of the next GOP by using a correction value generated as a result of coding processing of the target GOP.

8. The coding device as claimed in claim 1, wherein in coding a coding target picture (j+1) as a (j+1)th picture in the GOP, a bit quantity R(j+1) allocated to non-coded pictures including the coding target picture (j+1) in the target GOP is calculated in accordance with the following equation,

9. The coding device as claimed in claim 8, wherein in the case where the coding target picture (j+1) is the first picture of the GOP, the bit quantity R(j+1) of the non-coded pictures at and after the coding target picture (j+1) in the GOP including the coding target picture (j+1) is calculated in accordance with the following equation,

10. The coding device as claimed in claim 8, wherein in the case where the coding target picture (j+1) is a picture at a halfway point in the target GOP, and

where pictures up to the picture (j) preceding the coding target picture are coded at the first bit rate and pictures from the coding target picture (j+1) are coded at the second bit rate, the bit quantity of the non-coded pictures at and after the picture (j+1) in the GOP including the coding target picture (j+1) is calculated in accordance with the following equation,

11. The coding device as claimed in claim 10, wherein the target bit quantity T(j+1) allocated to the coding target picture (j+1) is calculated in accordance with the following equations,

12. The coding device as claimed in claim 1, wherein in coding pictures up to a picture immediately before the coding target picture at the first bit rate and coding pictures from the coding target picture at the second bit rate,

the control means calculates the bit quantity allocated to a predetermined number of non-coded pictures at and after the coding target picture and detects difficulty indicating coding difficulty of the predetermined number of non-coded pictures, and

finds the target bit quantity allocated to the coding target picture by distributing the bit quantity of the predetermined number of non-coded pictures on the basis of the difficulty of the coding target picture.

13. The coding device as claimed in claim 12, wherein the control means corrects the bit quantity of the predetermined number of non-coded pictures in accordance with the difference between the first bit rate and the second bit rate, and calculates the target bit quantity of the coding target picture on the basis of the corrected bit quantity of the predetermined number of non-coded pictures.

14. The coding device as claimed in claim 12, wherein the control means corrects the bit quantity of the predetermined number of non-coded pictures by using a value obtained by multiplying the difference between a bit quantity per picture at the first bit rate and a bit quantity per picture at the second bit rate by the predetermined number of non-coded pictures, and

calculates the target bit quantity of the coding target picture on the basis of the corrected bit quantity of the predetermined number of non-coded pictures.

15. The coding device as claimed in claim 13, wherein every time a picture is coded, the control means finds the bit quantity allocated to non-coded pictures up to a picture which is ahead of the coding target picture by a predetermined number of pictures, on the basis of a bit quantity generated as a result of coding processing of a picture immediately before the coding target picture and an anticipated quantity of generated bits of the picture which is ahead of the coding target picture by the predetermined number of pictures.

16. The coding device as claimed in claim 15, wherein the anticipated quantity of generated bits of the picture which is ahead of the coding target picture by the predetermined number of pictures is found by distributing the bit quantity allocated to non-coded pictures at and after the picture which is ahead by the predetermined number of pictures in the GOP including the picture which is ahead by the predetermined number of pictures, in accordance with the picture type of the picture which is ahead by the predetermined number of pictures.

17. The coding device as claimed in claim 16, wherein the bit quantity allocated to non-coded pictures at and after the picture which is ahead by the predetermined number of pictures is corrected by using a value obtained by multiplying the difference between a bit quantity per picture at the first bit rate and a bit quantity per picture at the second bit rate by the number of non-coded pictures at and after the picture which is ahead by the predetermined number of pictures in the GOP including the picture which is ahead by the predetermined number of pictures.

18. The coding device as claimed in claim 17, wherein in the case where a leading picture of a next GOP is coded after coding pictures up to a picture immediately before the coding target picture at the first bit rate and coding pictures from the coding target picture at the second bit rate, the control means corrects the bit quantity allocated to non-coded pictures of the next GOP by using a correction value generated as a result of coding processing of the GOP including the coding target picture.

19. The coding device as claimed in claim 18, wherein the correction value is obtained by using a value obtained by subtracting the quantity of generated bits generated by actual coding processing of the last picture of the GOP including the coding target picture from the target bit quantity allocated to the last picture.

20. The coding device as claimed in claim 12, wherein an algorithm for calculating the target bit quantity of the coding target picture in the control means is a feed-forward type algorithm for detecting difficulty indicating coding difficulty of a predetermined number of non-coded pictures including the coding target picture, and calculating the target bit quantity of the coding target picture on the basis of the difficulty of the predetermined number of non-coded pictures and the difficulty of the coding target picture, before coding processing of the coding target picture.

21. The coding device as claimed in claim 1, wherein in coding a coding target picture (j+1) as a (j+1)th picture in the GOP, a bit quantity R′

(j+1) allocated to L non-coded pictures from the coding target picture (j+1) to a picture (j+L) is calculated in accordance with the following equation,

22. The coding device as claimed in claim 21, wherein the anticipated quantity of generated bits F(j+L) of the picture (j+L) is calculated in accordance with the following equations,

23. The coding device as claimed in claim 22, wherein the bit quantity G(j+L) allocated to non-coded pictures at and after the picture (j+L) in the GOP including the picture (j+L) is found in accordance with the following equation,

 

G(j+L)=G(j+L−

1)−

F(j+L−

1)

where G(j+L−

1) expresses the bit quantity allocated to non-coded pictures at and after a picture (j+L−

1) in the GOP including the picture (j+L), and

F(j+L−

1) expresses an anticipated quantity of generated bits of the picture (j+L−

1).

24. The coding device as claimed in claim 23, wherein in the case where the coding target picture (j+1) is the first picture of the GOP and the designated bit rate is changed from the first bit rate to the second bit rate in a GOP which is temporally preceding the GOP including the coding target picture (j+1),

the bit quantity R′

(j+1) of L non-coded pictures at and after the coding target picture (j+1) and the bit quantity G(j+1) of L non-coded pictures at and after the coding target picture (j+1) in the GOP including the coding target picture (j+1) are found in accordance with the following equations,

25. The coding device as claimed in claim 23, wherein in the case where the coding target picture (j+1) is a picture at a halfway point in the GOP and where pictures up to the picture (j) are coded at the first bit rate and pictures from the picture (j+1) are coded at the second bit rate,

the bit quantity R′

(j+1) of L non-coded pictures at and after the coding target picture (j+1) and the bit quantity G(j+1) of L non-coded pictures at and after the coding target picture (j+1) in the GOP including the coding target picture (j+1) are found in accordance with the following equations,

26. The coding device as claimed in claim 25, wherein a target bit quantity T(j+1) allocated to the coding target picture (j+1) is calculated in accordance with the following equation,

27. A coding device for coding video data on the basis of a designated bit rate, the device comprising:

control means for calculating a target bit quantity allocated to a coding target picture on the basis of a bit quantity allocated to non-coded pictures in a GOP and the designated bit rate; and

coding means for coding the coding target picture in accordance with the target bit quantity calculated by the control means;

the control means correcting the target bit quantity provided to the coding means from a target bit quantity corresponding to a first bit rate to a target bit quantity corresponding to a second bit rate in the case where the designated bit rate is changed from the first bit rate to the second bit rate at a halfway point in the GOP.

28. A coding device for coding video data on the basis of a designated bit rate, the device comprising:

control means for calculating a target bit quantity allocated to a coding target picture from a bit quantity allocated to non-coded pictures in a GOP; and

coding means for coding the coding target picture in accordance with the target bit quantity calculated by the control means;

the control means correcting the bit quantity of non-coded pictures so that the locus of change of the bit quantity of non-coded pictures becomes the locus at the time when each picture is coded at a second bit rate from a leading picture of the GOP, in the case where the designated bit rate is changed from a first bit rate to the second bit rate at a halfway point in the GOP, the control means calculating the target bit quantity allocated to the coding target picture on the basis of the corrected bit quantity of non-coded pictures.

29. A coding device for coding video data on the basis of a designated bit rate, the device comprising:

control means for calculating a target bit quantity allocated to a coding target picture from a bit quantity allocated to non-coded pictures in a GOP; and

coding means for coding the coding target picture in accordance with the target bit quantity calculated by the control means;

the control means correcting the bit quantity of non-coded pictures from a bit quantity of non-coded pictures based on a first bit rate to a bit quantity of non-coded pictures based on a second bit rate in the case where the designated bit rate is changed from the first bit rate to the second bit rate at a halfway point in the GOP, the control means calculating the target bit quantity allocated to the coding target picture on the basis of the corrected bit quantity of non-coded pictures.

30. A coding device for coding video data on the basis of a designated bit rate, the device comprising:

control means for calculating an anticipated bit quantity allocated to non-coded pictures up to a picture which is ahead of a coding target picture by a predetermined number of pictures and distributing the anticipated bit quantity on the basis of coding difficulty of the coding target picture so as to calculate a target bit quantity allocated to the coding target picture; and

coding means for coding the coding target picture in accordance with the target bit quantity calculated by the control means;

the control means correcting the target bit quantity provided to the coding means from a target bit quantity corresponding to a first bit rate to a target bit quantity corresponding to a second bit rate in the case where the designated bit rate is changed from the first bit rate to the second bit rate at a halfway point in a GOP.

31. A coding device for coding video data on the basis of a designated bit rate, the device comprising:

control means for calculating an anticipated bit quantity allocated to non-coded pictures up to a picture which is ahead of a coding target picture by a predetermined number of pictures and distributing the anticipated bit quantity on the basis of coding difficulty of the coding target picture so as to calculate a target bit quantity allocated to the coding target picture; and

coding means for coding the coding target picture in accordance with the target bit quantity calculated by the control means;

the control means correcting the anticipated bit quantity allocated to non-coded pictures so that the locus of change of the anticipated bit quantity allocated to non-coded pictures becomes the locus at the time when each picture is coded at a second bit rate, in the case where the designated bit rate is changed from a first bit rate to the second bit rate at a halfway point in a GOP, the control means calculating the target bit quantity allocated to the coding target picture on the basis of the corrected bit quantity.

32. A coding device for coding video data on the basis of a designated bit rate, the device comprising:

control means for calculating an anticipated bit quantity allocated to non-coded pictures up to a picture which is ahead of a coding target picture by a predetermined number of pictures and distributing the anticipated bit quantity on the basis of coding difficulty of the coding target picture so as to calculate a target bit quantity allocated to the coding target picture; and

coding means for coding the coding target picture in accordance with the target bit quantity calculated by the control means;

the control means correcting the bit quantity allocated non-coded pictures from a bit quantity of non-coded pictures based on a first bit rate to a bit quantity of non-coded pictures based on a second bit rate in the case where the designated bit rate is changed from the first bit rate to the second bit rate at a halfway point in a GOP, the control means calculating the target bit quantity allocated to the coding target picture on the basis of the corrected bit quantity of non-coded pictures.

33. A coding method for coding video data on the basis of a designated bit rate, the method comprising:

a control step of calculating a target bit quantity allocated to each picture included in a GOP on the basis of the designated bit rate; and

a coding step of coding a coding target picture on the basis of the target bit quantity controlled by the control step;

wherein at the control step, when the designated bit rate is changed from a first bit rate to a second bit rate in the case where coding processing of the coding target picture is carried out by the coding step, the target bit quantity allocated to-the coding target picture is corrected on the basis of the difference between the first bit rate and the second bit rate.

34. A coding method for coding video data on the basis of a designated bit rate, the method comprising:

a control step of calculating a target bit quantity allocated to a coding target picture on the basis of a bit quantity allocated to non-coded pictures in a GOP and the designated bit rate; and

a coding step of coding the coding target picture in accordance with the target bit quantity calculated by the control step;

wherein at the control step, in the case where the designated bit rate is changed from a first bit rate to a second bit rate at a halfway point in the GOP, the target bit quantity provided to the coding step is corrected from a target bit quantity corresponding to the first bit rate to a target bit quantity corresponding to the second bit rate.

35. A coding method for coding video data on the basis of a designated bit rate, the method comprising:

a control step of calculating a target bit quantity allocated to a coding target picture from a bit quantity allocated to non-coded pictures in a GOP; and

a coding step of coding the coding target picture in accordance with the target bit quantity calculated by the control step;

wherein at the control step, in the case where the designated bit rate is changed f rom a first bit rate to a second bit rate at a halfway point in the GOP, the bit quantity of non-coded pictures is corrected so that the locus of change of the bit quantity of non-coded pictures becomes the locus at the time when each picture is coded at the second bit rate from a leading picture of the GOP, and the target bit quantity allocated to the coding target picture is calculated on the basis of the corrected bit quantity of non-coded pictures.

36. A coding method for coding video data on the basis of a designated bit rate, the method comprising:

a control step of calculating a target bit quantity allocated to a coding target picture from a bit quantity allocated to non-coded pictures in a GOP; and

a coding step of coding the coding target picture in accordance with the target bit quantity calculated by the control step;

wherein at the control step, in the case where the designated bit rate is changed from a first bit rate to a second bit rate at a halfway point in the GOP, the bit quantity of non-coded pictures is corrected from a bit quantity of non-coded pictures based on the first bit rate to a bit quantity of non-coded pictures based on the second bit rate, and the target bit quantity allocated to the coding target picture is calculated on the basis of the corrected bit quantity of non-coded pictures.

37. A coding method for coding video data on the basis of a designated bit rate, the method comprising:

a control step of calculating an anticipated bit quantity allocated to non-coded pictures up to a picture which is ahead of a coding target picture by a predetermined number of pictures and distributing the anticipated bit quantity on the basis of coding difficulty of the coding target picture so as to calculate a target bit quantity allocated to the coding target picture; and

a coding step of coding the coding target picture in accordance with the target bit quantity calculated by the control step;

wherein at the control step, in the case where the designated bit rate is changed from a first bit rate to a second bit rate at a halfway point in a GOP, the target bit quantity provided to the coding step is corrected from a target bit quantity corresponding to the first bit rate to a target bit quantity corresponding to the second bit rate.

38. A coding method for coding video data on the basis of a designated bit rate, the method comprising:

a control step of calculating an anticipated bit quantity allocated to non-coded pictures up to a picture which is ahead of a coding target picture by a predetermined number of pictures and distributing the anticipated bit quantity on the basis of coding difficulty of the coding target picture so as to calculate a target bit quantity allocated to the coding target picture; and

a coding step of coding the coding target picture in accordance with the target bit quantity calculated by the control step;

wherein at the control step, in the case where the designated bit rate is changed from a first bit rate to a second bit rate at a halfway point in a GOP, the anticipated bit quantity allocated to non-coded pictures is corrected so that the locus of change of the anticipated bit quantity allocated to non-coded pictures becomes the locus at the time when each picture is coded at the second bit rate, and the target bit quantity allocated to the coding target picture is calculated on the basis of the corrected bit quantity.

39. A coding method for coding video data on the basis of a designated bit rate, the method comprising:

a control step of calculating an anticipated bit quantity allocated to non-coded pictures up to a picture which is ahead of a coding target picture by a predetermined number of pictures and distributing the anticipated bit quantity on the basis of coding difficulty of the coding target picture so as to calculate a target bit quantity allocated to the coding target picture; and

a coding step of coding the coding target picture in accordance with the target bit quantity calculated by the control step;

wherein at the control step, in the case where the designated bit rate is changed from a first bit rate to a second bit rate at a halfway point in a GOP, the bit quantity allocated non-coded pictures from a bit quantity of non-coded pictures based on the first bit rate to a bit quantity of non-coded pictures based on the second bit rate, and the target bit quantity allocated to the coding target picture is calculated on the basis of the corrected bit quantity of non-coded pictures.