Moving image encoding apparatus, moving image encoding method, and moving image encoding computer program

• US 9,025,664 B2
• Filed: 08/09/2011
• Issued: 05/05/2015
• Est. Priority Date: 02/27/2009
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Kubota, Tomonori
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): Anderson, Matthew J
• Application Number:
  US13/206,023
• Publication Number:
  US 20110292995A1
• Time in Patent Office: 1,365 Days
• US Class Current: 375/240.14
• CPC Class Codes: G06F 5/06 for changing the speed of data flow, i.e. speed regularising or timing, e.g. delay lines, FIFO buffers; over- or underrun control therefor G06F7/78 takes precedence
• CPC Class Codes: G06F 5/065 Partitioned buffers, e.g. allowing multiple independent queues, bidirectional FIFO's
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2401 Monitoring of the client buffer
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055

Abstract

A moving image encoding apparatus, which divides moving image data into a plurality of sub-data, encodes the sub-data in parallel by using a plurality of encoders, and thereafter splices the resulting encoded sub-bitstream data into a single bitstream, includes a convergence target deriving function for determining a target value for a first amount of buffer occupancy so that the first amount of buffer occupancy at a point in time at which data corresponding to a last picture contained in first sub-bitstream data is removed from a first hypothetical buffer does not drop below a second amount of buffer occupancy which represents the amount of space that second sub-bitstream data occupies in a second hypothetical buffer at that point in time.

Claims

1. A moving image encoding apparatus comprising:

a storage unit which stores moving image data which includes at least first sub-data and second sub-data containing a plurality of pictures;

a processing unit which, by encoding said moving image data, generates bitstream data having an amount of data smaller than an amount of data of said moving image data; and

an output unit which outputs said bitstream data,

wherein said processing unit comprises;

a convergence target deriving unit which determines, when said bitstream data is transferred at a transfer rate into a buffer of a decoder and data corresponding to said pictures contained in said bitstream data is sequentially removed from said buffer at intervals of time, a target value in association with an amount of space that remains occupied by said bitstream data in said buffer at a first time a last picture contained in first sub-bitstream data generated by encoding said first sub-data is removed from said buffer, the target value being calculated to be above an amount of space that second sub-bitstream data generated by encoding said second sub-data occupies in said buffer at said first time;

a first encoder which determines a number of encoding bits to be allocated to a picture contained in said first sub-data so that buffer occupancy corresponds with said target value, and generates said first sub-bitstream data by encoding said first sub-data in accordance with said allocated number of encoding bits;

a second encoder which generates said second sub-bitstream data by encoding said second sub-data; and

a splicing unit which generates said bitstream data by splicing said first sub-bitstream data and said second sub-bitstream data, and

wherein said amount of space that second sub-bitstream data occupies is a value obtained by multiplying said transfer rate by a remaining period which is obtained by subtracting a period from said first time until a second time when a first picture contained in said second sub-data is removed from said buffer beginning from a period of storing said second sub-bitstream data to said buffer until said second time.

2. The moving image encoding apparatus according to claim 1, wherein said splicing unit inserts, between said first sub-bitstream data and said second sub-bitstream data, a bit string having a length corresponding to a difference obtained by subtracting said amount of space that second sub-bitstream data occupies from said amount of space that remains occupied by said bitstream data in said buffer at said first time.

3. The moving image encoding apparatus according to claim 2, wherein said bit string is an invalid bit string that, when the last picture contained in said first sub-bitstream data is decoded by said decoder, is extracted from said buffer along with the data corresponding to said last picture, and that does not affect the decoding of said last picture.

4. The moving image encoding apparatus according to claim 1, wherein said first encoder is adapted to:

increase, when data corresponding to a first picture contained in said first sub-bitstream data is removed from said buffer, a lower limit value for the amount of space that said bitstream data occupies in said buffer so that said lower limit value approaches said target value as said first picture is located nearer to a back end of said first sub-bitstream data; and

determine a number of encoding bits to be allocated to said first picture so that, the amount of space that said bitstream data occupies in said buffer does not drop below said lower limit value when said first picture is removed from said buffer.

5. The moving image encoding apparatus according to claim 4, wherein said first encoder is adapted to:

determine whether an upper limit value for the amount of space that said bitstream data occupies in said buffer is lower than said target value when data corresponding to a second picture contained in said first sub-bitstream data is stored into said buffer and, correct said upper limit value so that said upper limit value becomes higher than said target value when said determined upper limit value is lower than said target value.

6. The moving image encoding apparatus according to claim 4, wherein said first encoder is adapted to:

generate a frequency signal by applying an orthogonal transform to a signal corresponding to each pixel in each of said plurality of pictures contained in said first sub-bitstream data, and quantize said frequency signal with a quantization step size that becomes smaller as said allocated number of encoding bits becomes larger; and

generate said first sub-bitstream data by applying variable-length coding to said quantized frequency signal, and

wherein when said lower limit value determined in connection with said first picture contained in said first sub-bitstream data is denoted as a first lower limit value, and the lower limit value determined in connection with a picture encoded one picture before said first picture is denoted as a second lower limit value, said determining of the number of encoding bits to be allocated to said first picture determines said number of encoding bits to be allocated to said first picture by subtracting an amount of correction, which corresponds to a difference between said first lower limit value and said second lower limit value, from a basic number of encoding bits supposed to be allocated to said first picture when said first lower limit value is equal to said second lower limit value.

9. The moving image encoding apparatus according to claim 1, wherein said processing unit comparing an amount of space said bitstream data occupies in said buffer with an amount of space a temporally succeeding sub-bitstream data occupies in said buffer at said first time.

10. The moving image encoding apparatus according to claim 9, wherein said processing unit determines that buffer occupancy of said decoder does not exceed an upper limit value or fall below a lower limit value, based on a comparison of said amount of space said bitstream data occupies with an amount of space a temporally succeeding sub-bitstream data occupies at said first time.

7. A moving image encoding method to encode moving image data, which includes at least first sub-data and second sub-data containing a plurality of pictures, and thereby generating bitstream data having an amount of data smaller than an amount of data of said moving image data, comprising:

determining, when said bitstream data is transferred at a transfer rate into a buffer in a decoder and data corresponding to said pictures contained in said bitstream data is sequentially removed from said buffer at intervals of time, a target value in association with an amount of space that remains occupied by said bitstream data in said buffer at a first time a last picture contained in first sub-bitstream data generated by encoding said first sub-data is removed from said buffer, said target value being calculated to be above an amount of space that second sub-bitstream data generated by encoding said second sub-data occupies in said buffer at said first time;

determining a number of encoding bits to be allocated to a picture contained in said first sub-data so that buffer occupancy corresponds with said target value, and generating said first sub-bitstream data by encoding said first sub-data in accordance with said allocated number of encoding bits by a first encoder;

generating said second sub-bitstream data by encoding said second sub-data by a second encoder; and

generating said bitstream data by splicing said first sub-bitstream data and said second sub-bitstream data, and

wherein said amount of space that second sub-bitstream data occupies is a value obtained by multiplying said transfer rate by a remaining period which is obtained by subtracting a period from said first time until a second time when a first picture contained in said second sub-data is removed from said buffer beginning from a period of storing said second sub-bitstream data to said buffer until said second time.

8. A non-transitory computer readable recording medium having a moving image encoding computer program causing a computer including a first encoder and a second encoder to encode moving image data, which includes at least first sub-data and second sub-data containing a plurality of pictures, and to thereby generate bitstream data having an amount of data smaller than an amount of data of said moving image data, said computer program comprising instructions causing the computer to execute a process comprising:

determining, when said bitstream data is transferred at a transfer rate into a buffer of a decoder and data corresponding to said pictures contained in said bitstream data is sequentially removed from said buffer at intervals of time, a target value in association with an amount of space that remains occupied by said bitstream data in said buffer at a first time a last picture contained in first sub-bitstream data generated by encoding said first sub-data is removed from said buffer, said target value being calculated to be above an amount of space that second sub-bitstream data generated by encoding said second sub-data occupies in said buffer at said first time;

determining a number of encoding bits to be allocated to a picture contained in said first sub-data so that buffer occupancy corresponds with said target value, and generating said first sub-bitstream data by encoding said first sub-data in accordance with said allocated number of encoding bits by the first encoder;

generating said second sub-bitstream data by encoding said second sub-data by the second encoder; and

generating said bitstream data by splicing said first sub-bitstream data and said second sub-bitstream data, and

wherein said amount of space that second sub-bitstream data occupies is a value obtained by multiplying said transfer rate by a remaining period which is obtained by subtracting a period from said first time until a second time when a first picture contained in said second sub-data is removed from said buffer beginning from a period of storing said second sub-bitstream data to said buffer until said second time.