MOVING PICTURE ENCODING SYSTEM, MOVING PICTURE ENCODING METHOD, MOVING PICTURE ENCODING PROGRAM, MOVING PICTURE DECODING SYSTEM, MOVING PICTURE DECODING METHOD, MOVING PICTURE DECODING PROGRAM, MOVING PICTURE REENCODING SYTEM, MOVING PICTURE REENCODING METHOD, AND MOVING PICTURE REENCODING PROGRAM

• US 20110075734A1
• Filed: 05/28/2009
• Published: 03/31/2011
• Est. Priority Date: 05/30/2008
• Status: Active Grant

• Current Assignee: Advanced Coding Technologies LLC
• Original Assignee: Victor Company of Japan Limited (JVC Kenwood Corporation)
• Inventors: Sakazume, Satoru
• Granted Patent: US 9,042,448 B2
• Time in Patent Office: Days
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

A first super-resolution enlarger 103 works on moving pictures input with a standard resolution, implementing a process for a super-resolution enlargement including information on frequency components in the spatial direction and the temporal direction that has been potentially contained in the input moving pictures but unable to express to a sufficient degree by the standard resolution, and provides super-resolution enlarged signals, which are returned to the standard resolution at a first resolution converter 104, and the super-resolution enlarged signals as returned to the standard resolution are encoded at a second encoder 107. There is a first encoder 102 for encoding moving pictures input with the standard resolution, and a multiplexer 109 working to multiplex a sequence of encoded bits from the first encoder 102, a sequence of encoded bits from the second encoder 107, and the like. The second encoder 107 is adaptive to employ local decoded signals in the first encoder 102 or processed signals thereof, as reference signals.

Claims

1. (canceled)

2. A moving picture encoding system comprising:

a first encoder configured to work on a subsequence of a sequence of moving pictures with a standard resolution to implement a first combination of processes for an encoding and a decoding to create a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to work on the subsequence of the sequence of moving pictures with the standard resolution to implement a process for a first super-resolution enlargement to create a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a first resolution converter configured to work on the set of super-resolution enlarged pictures to implement a process for a first resolution conversion to create a set of super-resolution enlarged and converted pictures with the standard resolution; and

a second encoder configured to have the set of super-resolution enlarged and converted pictures from the first resolution converter as a set of encoding target pictures to implement a second combination of processes for a prediction and an encoding to create a second sequence of encoded bits,

wherein the second encoder is configured to have the set of decoded pictures from the first encoder as a set of reference pictures to implement the second combination of processes for the prediction and the encoding to create the second sequence of encoded bits.

4. The moving picture encoding system according to claim 2, wherein the first super-resolution enlarger comprises:

a positioner configured to work in a processing for super-resolution enlargement, on a combination of a base picture constituting a base therein and one or more observation pictures to be based on, to make a positioning to pixel positions of a desirable high resolution, for an interval-unequal sampling to create nonhomogeneous high resolution pictures;

an interpolator configured to work on nonhomogeneous high resolution pictures created at the positioner, to implement a process for a prescribed nonhomogeneous interpolation to create interpolated pictures with a desirable high resolution;

an estimated picture creator configured to acquire interpolated pictures created at the interpolator, to implement thereon a process for a prescribed reconstruction to create estimated pictures with a desirable resolution; and

a repetition determiner configured to acquire a nonhomogeneous high resolution picture from the positioner and a nonhomogeneous estimated picture from the estimated picture creator, for employment of the acquired pictures to follow a prescribed determination method to determine whether or not a repetition of the processing for super-resolution enlargement is necessary, and work depending on a result thereof, to operate as the repetition is necessary, to provide the interpolator with information for a control to continue the processing, and operate as the repetition is unnecessary, to provide the estimated picture creator with information for a control to output a set of estimated pictures with a high resolution after super-resolution enlargement.

5. The moving picture encoding system according to claim 2, comprising a multiplexer configured to operate complying with a prescribed syntax structure to multiplex the first sequence of encoded bits from the first encoder, the second sequence of encoded bits from the second encoder, and information on encoding parameters of respective types used in the encoding at the first encoder and the encoding at the second encoder.

6. The moving picture encoding system according to claim 2, comprising:

a first accumulation buffer configured to work in a course before the first encoder and the first super-resolution enlarger, to accumulate subsequences of the sequence of moving pictures with the standard resolution;

a second accumulation buffer configured to work in a course between the first encoder and the second encoder, to accumulate sets of decoded pictures from the first encoder;

an accumulation controller configured to work for detections of buffer accumulation amounts at the first accumulation buffer, the second accumulation buffer, the first encoder, and the second encoder, to control the buffer accumulation amounts; and

a code rate controller configured to work on bases of the detections of buffer accumulation amounts at the accumulation controller, to control code rates at the first encoder and the second encoder.

3. A moving picture encoding system comprising:

a first encoder configured to work on a subsequence of a sequence of moving pictures with a standard resolution to implement a first combination of processes for an encoding and a decoding to create a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to work on the subsequence of the sequence of moving pictures with the standard resolution to implement a process for a first super-resolution enlargement to create a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a first resolution converter configured to work on the set of super-resolution enlarged pictures to implement a process for a first resolution conversion to create a set of super-resolution enlarged and converted pictures with the standard resolution;

a second encoder configured to have the set of super-resolution enlarged and converted pictures from the first resolution converter as a set of encoding target pictures to implement a second combination of processes for a prediction and an encoding to create a second sequence of encoded bits;

a second super-resolution enlarger configured to acquire the set of decoded pictures with the standard resolution from the first encoder to implement thereon a process for a second super-resolution enlargement to create a set of super-resolution enlarged decoded pictures with a resolution higher than the standard resolution; and

a second resolution converter configured to work on the set of super-resolution enlarged decoded pictures to implement a process for a second resolution conversion to create a set of super-resolution enlarged and converted decoded pictures with the standard resolution,

wherein the second encoder is configured to have the set of super-resolution enlarged and converted decoded pictures from the second resolution converter as a set of reference pictures to implement the second combination of processes for the prediction and the encoding to create the second sequence of encoded bits.

22. The moving picture encoding system according to claim 3, wherein the first super-resolution enlarger comprises:

a positioner configured to work in a processing for super-resolution enlargement, on a combination of a base picture constituting a base therein and one or more observation pictures to be based on, to make a positioning to pixel positions of a desirable high resolution, for an interval-unequal sampling to create nonhomogeneous high resolution pictures;

an interpolator configured to work on nonhomogeneous high resolution pictures created at the positioner, to implement a process for a prescribed nonhomogeneous interpolation to create interpolated pictures with a desirable high resolution;

an estimated picture creator configured to acquire interpolated pictures created at the interpolator, to implement thereon a process for a prescribed reconstruction to create estimated pictures with a desirable resolution; and

a repetition determiner configured to acquire a nonhomogeneous high resolution picture from the positioner and a nonhomogeneous estimated picture from the estimated picture creator, for employment of the acquired pictures to follow a prescribed determination method to determine whether or not a repetition of the processing for super-resolution enlargement is necessary, and work depending on a result thereof, to operate as the repetition is necessary, to provide the interpolator with information for a control to continue the processing, and operate as the repetition is unnecessary, to provide the estimated picture creator with information for a control to output a set of estimated pictures with a high resolution after super-resolution enlargement.

23. The moving picture encoding system according to claim 3, further comprising a multiplexer configured to operate complying with a prescribed syntax structure to multiplex the first sequence of encoded bits from the first encoder, the second sequence of encoded bits from the second encoder, and information on encoding parameters of respective types used in the encoding at the first encoder and the encoding at the second encoder.

24. The moving picture encoding system according to claim 3, further comprising:

a first accumulation buffer configured to work in a course before the first encoder and the first super-resolution enlarger, to accumulate subsequences of the sequence of moving pictures with the standard resolution;

a second accumulation buffer configured to work in a course between the first encoder and the second encoder, to accumulate sets of decoded pictures from the first encoder;

an accumulation controller configured to work for detections of buffer accumulation amounts at the first accumulation buffer, the second accumulation buffer, the first encoder, and the second encoder, to control the buffer accumulation amounts; and

a code rate controller configured to work on bases of the detections of buffer accumulation amounts at the accumulation controller, to control code rates at the first encoder and the second encoder.

7. A moving picture encoding system comprising:

a first encoder configured to work on a sequence of moving pictures with a standard resolution to implement a first combination of processes for an encoding and a decoding to create a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to work on the sequence of moving pictures with the standard resolution to implement a process for a first super-resolution enlargement to create a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a second super-resolution enlarger configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a second super-resolution enlargement to create a set of super-resolution enlarged decoded pictures with a resolution higher than the standard resolution;

a third resolution converter configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a third resolution conversion to create a set of resolution converted enlarged decoded pictures with a resolution higher than the standard resolution; and

a third encoder configured to have the set of super-resolution enlarged pictures from the first super-resolution enlarger as a set of encoding target pictures, employing the set of super-resolution enlarged decoded pictures from the second super-resolution enlarger and the set of resolution converted enlarged decoded pictures from the third resolution converter as sets of reference pictures, to implement thereon a third combination of processes for a prediction and an encoding to create a third sequence of encoded bits.

8. A moving picture encoding system comprising:

a first encoder configured to work on a sequence of moving pictures with a standard resolution to implement a first combination of processes for an encoding and a decoding to create a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to work on the sequence of moving pictures with the standard resolution to implement a process for a first super-resolution enlargement to create a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a third resolution converter configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a third resolution conversion to create a set of resolution converted enlarged decoded pictures with a resolution higher than the standard resolution; and

a third encoder configured to have the set of super-resolution enlarged pictures from the first super-resolution enlarger as a set of encoding target pictures, employing the set of resolution converted enlarged decoded pictures from the third resolution converter as a set of reference pictures, to implement thereon a third combination of processes for a prediction and an encoding to create a third sequence of encoded bits.

9. A moving picture encoding system comprising:

a first encoder configured to work on a sequence of moving pictures with a standard resolution to implement a first combination of processes for an encoding and a decoding to create a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to work on the sequence of moving pictures with the standard resolution to implement a process for a first super-resolution enlargement to create a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a second super-resolution enlarger configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a second super-resolution enlargement to create a set of super-resolution enlarged decoded pictures with a resolution higher than the standard resolution; and

a third encoder configured to have the set of super-resolution enlarged pictures from the first super-resolution enlarger as a set of encoding target pictures, employing the set of super-resolution enlarged decoded pictures from the second super-resolution enlarger as a set of reference pictures, to implement thereon a third combination of processes for a prediction and an encoding to create a third sequence of encoded bits.

10. A moving picture encoding system comprising:

a first encoder configured to work on a sequence of moving pictures with a standard resolution to implement a first combination of processes for an encoding and a decoding to create a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to work on the sequence of moving pictures with the standard resolution to implement a process for a first super-resolution enlargement to create a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a first resolution converter configured to work on the set of super-resolution enlarged pictures to implement a process for a first resolution conversion to create a set of super-resolution enlarged and converted pictures with the standard resolution;

a second super-resolution enlarger configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a second super-resolution enlargement to create a set of super-resolution enlarged decoded pictures with a resolution higher than the standard resolution;

a second resolution converter configured to work on the set of super-resolution enlarged decoded pictures from the second super-resolution enlarger to implement a process for a second resolution conversion to create a set of super-resolution enlarged and converted decoded pictures with the standard resolution;

a second encoder configured to have the set of super-resolution enlarged and converted pictures from the first resolution converter as a set of encoding target pictures, employing the set of decoded pictures from the first encoder and the set of super-resolution enlarged and converted decoded pictures with the standard resolution from the second resolution converter as sets of reference pictures, to implement thereon a second combination of processes for a prediction and an encoding to create a second sequence of encoded bits;

a third resolution converter configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a third resolution conversion to create a set of resolution converted enlarged decoded pictures with a resolution higher than the standard resolution; and

a third encoder configured to have the set of super-resolution enlarged pictures from the first super-resolution enlarger as a set of encoding target pictures, employing the set of super-resolution enlarged decoded pictures from the second super-resolution enlarger and the set of resolution converted enlarged decoded pictures from the third resolution converter as sets of reference pictures, to implement thereon a third combination of processes for a prediction and an encoding to create a third sequence of encoded bits.

11. A moving picture encoding method comprising:

a step of implementing a first combination of processes for an encoding and a decoding on a sequence of moving pictures with a standard resolution, creating a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a step of implementing a process for a first super-resolution enlargement on the sequence of moving pictures with the standard resolution, creating a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a step of implementing a process for a first resolution conversion on the set of super-resolution enlarged pictures, creating a set of super-resolution enlarged and converted pictures with the standard resolution; and

a step of having the set of super-resolution enlarged and converted pictures as a set of encoding target pictures, implementing thereon a second combination of processes for a prediction and an encoding, creating a second sequence of encoded bits,

wherein the step of creating the second sequence of encoding bits further comprises a step of having the set of decoded pictures from the first encoder as a set of reference pictures to implement the second combination of processes for the prediction and the encoding to create the second sequence of encoded bits.

12. A recording medium storing a moving picture encoding program configured to have a computer execute:

a step of implementing a first combination of processes for an encoding and a decoding on a sequence of moving pictures with a standard resolution, creating a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a step of implementing a process for a first super-resolution enlargement on the sequence of moving pictures with the standard resolution, creating a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a step of implementing a process for a first resolution conversion on the set of super-resolution enlarged pictures, creating a set of super-resolution enlarged and converted pictures with the standard resolution; and

a step of having the set of super-resolution enlarged and converted pictures as a set of encoding target pictures, implementing thereon a second combination of processes for a prediction and an encoding, creating a second sequence of encoded bits,

wherein the step of creating the second sequence of encoding bits further comprises a step of having the set of decoded pictures from the first encoder as a set of reference pictures to implement the second combination of processes for the prediction and the encoding to create the second sequence of encoded bits.

13. A moving picture decoding system comprising:

a demultiplexer configured to work on a sequence of input encoded bits to implement a process for a prescribed demultiplexing to output at least a first and a second sequence of encoded bits;

a first decoder configured to acquire the first sequence of encoded bits obtained with a standard resolution at the demultiplexer to implement thereon a process for a prescribed first decoding to create a sequence of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to acquire the sequence of decoded pictures created with the standard resolution at the first decoder to implement thereon a process for a prescribed super-resolution enlargement to create a sequence of super-resolution enlarged decoded pictures;

a first resolution converter configured to acquire the sequence of super-resolution enlarged decoded pictures created at the first super-resolution enlarger to implement thereon a process for a prescribed resolution conversion to create a sequence of super-resolution decoded pictures with the standard resolution; and

a second decoder configured to acquire the second sequence of encoded bits obtained with the standard resolution at the demultiplexer, the sequence of decoded pictures created with the standard resolution at the first decoder, and the sequence of super-resolution decoded pictures created with the standard resolution at the first resolution converter, to implement thereon a combination of processes for a prescribed prediction and a prescribed second decoding being a decoding with an extension of the standard resolution, to create a sequence of super-resolution pictures decoded with the standard resolution.

14. The moving picture decoding system according to claim 13, comprising:

the demultiplexer being configured to work on the sequence of input encoded bits to implement the process for the prescribed demultiplexing to further output a third sequence of encoded bits;

a second resolution converter configured to acquire the sequence of decoded pictures with the standard resolution from the first decoder to implement thereon a process for a prescribed resolution conversion to create a sequence of enlarged decoded pictures with a high resolution as a resolution higher than the standard resolution; and

a third decoder configured to acquire the third sequence of encoded bits obtained with the high resolution at the demultiplexer, the sequence of super-resolution enlarged decoded pictures created at the first super-resolution enlarger, and the sequence of enlarged decoded pictures with the high resolution from the second resolution converter, to implement thereon a combination of processes for a prescribed prediction and a prescribed third decoding being a decoding with an extension of the high resolution, to create a sequence of super-resolution enlarged pictures as decoded.

15. A moving picture reencoding system comprising:

a demultiplexer configured to work on a sequence of input encoded bits to implement a process for a prescribed demultiplexing to output at least a first and a second sequence of encoded bits;

a first decoder configured to acquire the first sequence of encoded bits obtained with a standard resolution at the demultiplexer to implement thereon a process for a prescribed first decoding to create a sequence of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to acquire the sequence of decoded pictures created with the standard resolution at the first decoder to implement thereon a process for a prescribed super-resolution enlargement to create a sequence of super-resolution enlarged decoded pictures;

a first resolution converter configured to acquire the sequence of super-resolution enlarged decoded pictures created at the first super-resolution enlarger to implement thereon a process for a prescribed resolution conversion to create a sequence of super-resolution decoded pictures with the standard resolution;

a second decoder configured to acquire the second sequence of encoded bits obtained with the standard resolution at the demultiplexer, the sequence of decoded pictures created with the standard resolution at the first decoder, and the sequence of super-resolution decoded pictures created with the standard resolution at the first resolution converter, to implement thereon a process for a prescribed second decoding being a decoding with an extension of the standard resolution, to create a sequence of super-resolution pictures decoded with the standard resolution;

a reencoder configured to acquire from the first decoder information on coefficients of orthogonal transform in a course of decoding thereof, and from the second decoder information on coefficients of orthogonal transform in an extension layer of the standard resolution in a course of decoding thereof, to make a synthesis of respective information on coefficients of orthogonal transform and implement thereon a process for a prescribed entropy encoding to create a sequence of encoded bits as reencoded; and

a multiplexer configured to acquire the sequence of encoded bits reencoded at the reencoder, to implement thereon a process for a multiplexing complying with a prescribed syntax structure, inserting encoding information inclusive of identification information for identification of information on encoding modes and parameters of respective types used, to create a sequence of encoded bits as multiplexed.

16. The moving picture reencoding system according to claim 15, wherein the reencoder is configured to acquire the sequence of decoded pictures with the standard resolution from the first decoder, the sequence of super-resolution decoded pictures with the standard resolution from the first resolution converter, and the sequence of super-resolution pictures with the standard resolution from the second decoder, to implement thereon a process for a prescribed encoding to create a sequence of encoded bits as reencoded.

17. A moving picture decoding method comprising:

a step of implementing a process for a prescribed demultiplexing on a sequence of input encoded bits, outputting at least a first and a second sequence of encoded bits;

a step of acquiring the first sequence of encoded bits obtained with a standard resolution through the process for the prescribed demultiplexing, implementing thereon a process for a prescribed first decoding, creating a sequence of decoded pictures with the standard resolution;

a step of acquiring the sequence of decoded pictures created with the standard resolution through the process for the prescribed first decoding, implementing thereon a process for a prescribed super-resolution enlargement, creating a sequence of super-resolution enlarged decoded pictures;

a step of acquiring the sequence of super-resolution enlarged decoded pictures created through the process for the prescribed super-resolution enlargement, implementing thereon a process for a prescribed resolution conversion, creating a sequence of super-resolution decoded pictures with the standard resolution; and

a step of acquiring the second sequence of encoded bits obtained with the standard resolution through the process for the prescribed demultiplexing, the sequence of decoded pictures created with the standard resolution through the process for the prescribed first decoding, and the sequence of super-resolution decoded pictures created with the standard resolution through the process for the prescribed resolution conversion, implementing thereon a combination of processes for a prescribed prediction and a prescribed second decoding being a decoding with an extension of the standard resolution, creating a sequence of super-resolution pictures decoded with the standard resolution.

18. The moving picture decoding method according to claim 17, comprising:

a step of implementing the process for the prescribed demultiplexing on the sequence of input encoded bits, outputting a third sequence of encoded bits;

a step of acquiring the sequence of decoded pictures created with the standard resolution through the process for the prescribed first decoding, implementing thereon a process for a prescribed resolution conversion, creating a sequence of enlarged decoded pictures with a high resolution as a resolution higher than the standard resolution; and

a step of acquiring the third sequence of encoded bits obtained with the high resolution through the process for the prescribed demultiplexing, the sequence of super-resolution enlarged decoded pictures created through the process for the prescribed super-resolution enlargement, and the sequence of enlarged decoded pictures created with the high resolution through the process for the prescribed resolution conversion, implementing thereon a combination of processes for a prescribed prediction and a prescribed third decoding being a decoding with an extension of the high resolution, creating a sequence of super-resolution enlarged pictures as decoded.

19. A moving picture reencoding method comprising:

a step of implementing a process for a prescribed demultiplexing on a sequence of input encoded bits;

a step of acquiring a first sequence of encoded bits obtained with a standard resolution through the process for the prescribed demultiplexing, implementing thereon a process for a prescribed first decoding, creating a sequence of decoded pictures with the standard resolution;

a step of acquiring the sequence of decoded pictures created with the standard resolution through the process for the prescribed first decoding, implementing thereon a process for a prescribed super-resolution enlargement, creating a sequence of super-resolution enlarged decoded pictures;

a step of acquiring the sequence of super-resolution enlarged decoded pictures created through the process for the prescribed super-resolution enlargement, implementing thereon a process for a prescribed resolution conversion, creating a sequence of super-resolution decoded pictures with the standard resolution;

a step of acquiring a second sequence of encoded bits obtained with the standard resolution through the process for the prescribed demultiplexing, the sequence of decoded pictures created with the standard resolution through the process for the prescribed first decoding, and the sequence of super-resolution decoded pictures created with the standard resolution through the process for the prescribed resolution conversion, implementing thereon a process for a prescribed second decoding being a decoding with an extension of the standard resolution, creating a sequence of super-resolution pictures decoded with the standard resolution;

a step of acquiring information on coefficients of orthogonal transform in a course of decoding in the process for the prescribed first decoding, and information on coefficients of orthogonal transform in an extension layer of the standard resolution in a course of decoding in the process for the prescribed second decoding being a decoding with an extension of the standard resolution, making a synthesis of respective information on coefficients of orthogonal transform, implementing thereon a process for a prescribed entropy encoding, creating a sequence of encoded bits as reencoded; and

a step of acquiring the sequence of encoded bits as reencoded, implementing thereon a process for a multiplexing complying with a prescribed syntax structure, inserting encoding information inclusive of identification information for identification of information on encoding modes and parameters of respective types used, creating a sequence of encoded bits as multiplexed.

20. A recording medium storing a moving picture decoding program configured to have a computer execute:

a step of implementing a process for a prescribed demultiplexing on a sequence of input encoded bits, outputting at least a first and a second sequence of encoded bits;

a step of acquiring the first sequence of encoded bits obtained with a standard resolution through the process for the prescribed demultiplexing, implementing thereon a process for a prescribed first decoding, creating a sequence of decoded pictures with the standard resolution;

a step of acquiring the sequence of decoded pictures created with the standard resolution through the process for the prescribed first decoding, implementing thereon a process for a prescribed super-resolution enlargement, creating a sequence of super-resolution enlarged decoded pictures;

a step of acquiring the sequence of super-resolution enlarged decoded pictures created through the process for the prescribed super-resolution enlargement, implementing thereon a process for a prescribed resolution conversion, creating a sequence of super-resolution decoded pictures with the standard resolution; and

a step of acquiring the second sequence of encoded bits obtained with the standard resolution through the process for the prescribed demultiplexing, the sequence of decoded pictures created with the standard resolution through the process for the prescribed first decoding, and the sequence of super-resolution decoded pictures created with the standard resolution through the process for the prescribed resolution conversion, implementing thereon a combination of processes for a prescribed prediction and a prescribed second decoding being a decoding with an extension of the standard resolution, creating a sequence of super-resolution pictures decoded with the standard resolution.

21. A recording medium storing a moving picture reencoding program configured to have a computer execute:

a step of implementing a process for a prescribed demultiplexing on a sequence of input encoded bits;

a step of acquiring a first sequence of encoded bits obtained with a standard resolution through the process for the prescribed demultiplexing, implementing thereon a process for a prescribed first decoding, creating a sequence of decoded pictures with the standard resolution;

a step of acquiring the sequence of decoded pictures created with the standard resolution through the process for the prescribed first decoding, implementing thereon a process for a prescribed super-resolution enlargement, creating a sequence of super-resolution enlarged decoded pictures;

a step of acquiring the sequence of super-resolution enlarged decoded pictures created through the process for the prescribed super-resolution enlargement, implementing thereon a process for a prescribed resolution conversion, creating a sequence of super-resolution decoded pictures with the standard resolution;

a step of acquiring a second sequence of encoded bits obtained with the standard resolution through the process for the prescribed demultiplexing, the sequence of decoded pictures created with the standard resolution through the process for the prescribed first decoding, and the sequence of super-resolution decoded pictures created with the standard resolution through the process for the prescribed resolution conversion, implementing thereon a process for a prescribed second decoding being a decoding with an extension of the standard resolution, creating a sequence of super-resolution pictures decoded with the standard resolution;

a step of acquiring information on coefficients of orthogonal transform in a course of decoding in the process for the prescribed first decoding, and information on coefficients of orthogonal transform in an extension layer of the standard resolution in a course of decoding in the process for the prescribed second decoding being a decoding with an extension of the standard resolution, making a synthesis of respective information on coefficients of orthogonal transform, implementing thereon a process for a prescribed entropy encoding, creating a sequence of encoded bits as reencoded; and

a step of acquiring the sequence of encoded bits as reencoded, implementing thereon a process for a multiplexing complying with a prescribed syntax structure, inserting encoding information inclusive of identification information for identification of information on encoding modes and parameters of respective types used, creating a sequence of encoded bits as multiplexed.

25. A moving picture encoding method comprising:

a step of implementing a first combination of processes for an encoding and a decoding on a sequence of moving pictures with a standard resolution, creating a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a step of implementing a process for a first super-resolution enlargement on the sequence of moving pictures with the standard resolution, creating a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a step of implementing a process for a first resolution conversion on the set of super-resolution enlarged pictures, creating a set of super-resolution enlarged and converted pictures with the standard resolution;

a step of having the set of super-resolution enlarged and converted pictures as a set of encoding target pictures, implementing thereon a second combination of processes for a prediction and an encoding, creating a second sequence of encoded bits;

a step of acquiring the set of decoded pictures with the standard resolution from the first encoder to implement thereon a process for a second super-resolution enlargement to create a set of super-resolution enlarged decoded pictures with a resolution higher than the standard resolution; and

a step of working on the set of super-resolution enlarged decoded pictures to implement a process for a second resolution conversion to create a set of super-resolution enlarged and converted decoded pictures with the standard resolution,

wherein the step of creating the second sequence of encoding bits further comprises a step of having the set of super-resolution enlarged and converted decoded pictures from the second resolution converter as a set of reference pictures to implement the second combination of processes for the prediction and the encoding to create the second sequence of encoded bits.

26. A recording medium storing a moving picture encoding program configured to have a computer execute:

a step of implementing a first combination of processes for an encoding and a decoding on a sequence of moving pictures with a standard resolution, creating a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a step of implementing a process for a first super-resolution enlargement on the sequence of moving pictures with the standard resolution, creating a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a step of implementing a process for a first resolution conversion on the set of super-resolution enlarged pictures, creating a set of super-resolution enlarged and converted pictures with the standard resolution;

a step of having the set of super-resolution enlarged and converted pictures as a set of encoding target pictures, implementing thereon a second combination of processes for a prediction and an encoding, creating a second sequence of encoded bits;

a step of acquiring the set of decoded pictures with the standard resolution from the first encoder to implement thereon a process for a second super-resolution enlargement to create a set of super-resolution enlarged decoded pictures with a resolution higher than the standard resolution; and

a step of working on the set of super-resolution enlarged decoded pictures to implement a process for a second resolution conversion to create a set of super-resolution enlarged and converted decoded pictures with the standard resolution, wherein the step of creating the second sequence of encoding bits further comprises a step of having the set of super-resolution enlarged and converted decoded pictures from the second resolution converter as a set of reference pictures to implement the second combination of processes for the prediction and the encoding to create the second sequence of encoded bits.