Moving picture encoding system, moving picture encoding method, moving picture encoding program, moving picture decoding system, moving picture decoding method, moving picture decoding program, moving picture reencoding sytem, moving picture reencoding method, and moving picture reencoding program

• US 9,042,448 B2
• Filed: 05/28/2009
• Issued: 05/26/2015
• Est. Priority Date: 05/30/2008
• Status: Active Grant

• Current Assignee: Advanced Coding Technologies LLC
• Original Assignee: JVC Kenwood Corporation
• Inventors: Sakazume, Satoru
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): PICON-FELICIANO, ANA J
• Application Number:
  US12/995,039
• Publication Number:
  US 20110075734A1
• Time in Patent Office: 2,189 Days
• Field of Search: 375/240.12, 375/240.18, 375/E7.243, 375/E7.226
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

A first super-resolution enlarger 103 works on moving pictures input with a standard resolution, implementing a process for a super-resolution enlargement including information on frequency components in the spatial direction and the temporal direction that has been potentially contained in the input moving pictures but unable to express to a sufficient degree by the standard resolution, and provides super-resolution enlarged signals, which are returned to the standard resolution at a first resolution converter 104, and the super-resolution enlarged signals as returned to the standard resolution are encoded at a second encoder 107. There is a first encoder 102 for encoding moving pictures input with the standard resolution, and a multiplexer 109 working to multiplex a sequence of encoded bits from the first encoder 102, a sequence of encoded bits from the second encoder 107, and the like. The second encoder 107 is adaptive to employ local decoded signals in the first encoder 102 or processed signals thereof, as reference signals.

Claims

1. A moving picture encoding system that makes an encoding of a sequence of moving pictures with a resolution higher than a standard resolution using moving pictures contents which include a sequence of moving pictures with the standard resolution and do not include a sequence of moving pictures with a resolution higher than the standard resolution, the moving picture encoding system comprising:

a first encoder configured to work on a sequence of moving pictures with a standard resolution to implement a first combination of processes for an encoding and a decoding to create a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to work on the sequence of moving pictures with the standard resolution to implement a process for a first super-resolution enlargement to create a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a second super-resolution enlarger configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a second super-resolution enlargement to create a set of super-resolution enlarged decoded pictures with a resolution higher than the standard resolution;

a third resolution converter configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a third resolution conversion to create a set of resolution converted enlarged decoded pictures with a resolution higher than the standard resolution; and

a third encoder configured to have the set of super-resolution enlarged pictures from the first super-resolution enlarger as a set of encoding target pictures, employing the set of super-resolution enlarged decoded pictures from the second super-resolution enlarger and the set of resolution converted enlarged decoded pictures from the third resolution converter as sets of reference pictures, to implement thereon a third combination of processes for a prediction and an encoding to create a third sequence of encoded bits,

wherein a spatial resolution of the set of super-resolution enlarged pictures, that of the set of super-resolution enlarged decoded pictures, and that of the set of resolution converted enlarged decoded pictures are made equal; and

wherein the third encoder controls a selection of a set of reference pictures and creates a set of data on the selection of the set of reference pictures to identify a selected set of reference pictures during the process for prediction of the third combination.

2. A moving picture encoding system that makes an encoding of a sequence of moving pictures with a resolution higher than a standard resolution using moving pictures contents which include a sequence of moving pictures with the standard resolution and do not include a sequence of moving pictures with a resolution higher than the standard resolution, the moving picture encoding system comprising:

a first encoder configured to work on a sequence of moving pictures with a standard resolution to implement a first combination of processes for an encoding and a decoding to create a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to work on the sequence of moving pictures with the standard resolution to implement a process for a first super-resolution enlargement to create a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a third resolution converter configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a third resolution conversion to create a set of resolution converted enlarged decoded pictures with a resolution higher than the standard resolution; and

a third encoder configured to have the set of super-resolution enlarged pictures from the first super-resolution enlarger as a set of encoding target pictures, employing the set of resolution converted enlarged decoded pictures from the third resolution converter as a set of reference pictures, to implement thereon a third combination of processes for a prediction and an encoding to create a third sequence of encoded bits,

wherein a spatial resolution of the set of super-resolution enlarged pictures, and that of the set of resolution converted enlarged decoded pictures are made equal; and

wherein the third encoder controls a selection of a set of reference pictures and creates a set of data on the selection of the set of reference pictures to identify a selected set of reference pictures during the process for prediction of the third combination.

3. A moving picture encoding system that makes an encoding of a sequence of moving pictures with a resolution higher than a standard resolution using moving pictures contents which include a sequence of moving pictures with the standard resolution and do not include a sequence of moving pictures with a resolution higher than the standard resolution, the moving picture encoding system comprising:

a first encoder configured to work on a sequence of moving pictures with a standard resolution to implement a first combination of processes for an encoding and a decoding to create a first sequence of encoded bits and a set of decoded pictures with the standard resolution;

a first super-resolution enlarger configured to work on the sequence of moving pictures with the standard resolution to implement a process for a first super-resolution enlargement to create a set of super-resolution enlarged pictures with a resolution higher than the standard resolution;

a second super-resolution enlarger configured to acquire the set of decoded pictures from the first encoder to implement thereon a process for a second super-resolution enlargement to create a set of super-resolution enlarged decoded pictures with a resolution higher than the standard resolution; and

a third encoder configured to have the set of super-resolution enlarged pictures from the first super-resolution enlarger as a set of encoding target pictures, employing the set of super-resolution enlarged decoded pictures from the second super-resolution enlarger as a set of reference pictures, to implement thereon a third combination of processes for a prediction and an encoding to create a third sequence of encoded bits,

wherein a spatial resolution of the set of super-resolution enlarged pictures, and that of the set of super-resolution enlarged decoded pictures are made equal; and

wherein the third encoder controls a selection of a set of reference pictures and creates a set of data on the selection of the set of reference pictures to identify a selected set of reference pictures during the process for prediction of the third combination.