Image processing apparatus, image processing method, and program for combining still images

• US 8,184,179 B2
• Filed: 07/22/2008
• Issued: 05/22/2012
• Est. Priority Date: 07/23/2007
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Hirota, Yoichi, Kobayashi, Hiroshi
• Primary Examiner(s): Cutler, Albert
• Application Number:
  US12/177,478
• Publication Number:
  US 20090027512A1
• Time in Patent Office: 1,400 Days
• Field of Search: 348/239, 382/304
• US Class Current: 348/239
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/109 among a plurality of temporal predictive coding modes
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures

Abstract

An image processing apparatus includes the following elements. An obtaining unit obtains a first still image, a first difficulty level indicating a complexity of the first still image, a second still image, and a second difficulty level indicating a complexity of the second still image. A combining unit combines the first and second still images at a combination ratio which is changed along a time axis to generate a moving image. An encoding unit encodes the moving image. A moving-image difficulty-level calculating unit calculates a moving-image difficulty level indicating a complexity of the moving image according to the first and second difficulty levels and the combination ratio changed along the time axis. A control unit controls a characteristic of a process of encoding the moving image according to the combination ratio changed along the time axis and the moving-image difficulty level.

Claims

1. An image processing apparatus comprising:

obtaining means for obtaining a first still image, a first difficulty level indicating a complexity of the first still image, a second still image, and a second difficulty level indicating a complexity of the second still image;

combining means for combining the first still image and second still image obtained by the obtaining means at a combination ratio which is changed along a time axis to generate a moving image;

encoding means for performing an encoding operation to encode the moving image generated by the combining means;

moving-image difficulty-level calculating means for calculating a moving-image difficulty level indicating a complexity of the moving image according to the first difficulty level and second difficulty level obtained by the obtaining means and the combination ratio changed along the time axis; and

control means for controlling a characteristic including an allocated bit rate of the encoding operation performed by the encoding means according to the combination ratio changed along the time axis and the moving-image difficulty level calculated by the moving-image difficulty level calculating means,

wherein the control means determines whether the moving image is an I type according to the combination ratio.

2. The image processing apparatus according to claim 1, further comprising:

first image-quality correcting means for performing image-quality correction processing on the first still image obtained by the obtaining means; and

difficulty level correcting means for correcting the first difficulty level according to the image-quality correction processing performed on the first still image by the first image-quality correcting means,

wherein the combining means combines the first still image obtained by the obtaining means and subjected to the image-quality correction processing by the first image-quality correcting means and the second still image obtained by the obtaining means at a combination ratio which is changed along the time axis to generate a moving image, and

wherein the moving-image difficulty level calculating means calculates the moving-image difficulty level according to the first difficulty level obtained by the obtaining means and corrected by the difficulty level correcting means, the second difficulty level obtained by the obtaining means, and the combination ratio changed along the time axis.

3. The image processing apparatus according to claim 2, further comprising second image-quality correction processing means for performing image-quality correction processing on the second still image obtained by the obtaining means,

wherein the combining means combines the first still image obtained by the obtaining means and subjected to the image-quality correction processing by the first image-quality correction means and the second still image obtained by the obtaining means and subjected to the image-quality correction processing by the second image-quality correction means at a combination ratio which is changed along the time axis to generate a moving image,

wherein the difficulty level correcting means corrects the first difficulty level according to the image-quality correction processing performed on the first still image by the first image-quality correcting means, and corrects the second difficulty level according to the image-quality correction processing performed on the second still image by the second image-quality correcting means, and

wherein the moving-image difficulty level calculating means calculates the moving-image difficulty level according to the first difficulty level obtained by the obtaining means and corrected by the difficulty level correcting means, the second difficulty level obtained by the obtaining means and corrected by the difficulty level correcting means, and the combination ratio changed along the time axis.

4. The image processing apparatus according to claim 1, wherein the encoding means encodes the moving image generated by the combining means according to an encoding method that is based on a picture type determined in advance to encode each of pictures arranged along a time axis, and

wherein the control means controls the characteristic of the encoding operation performed by the encoding means according to the combination ratio changed along the time axis, the moving-image difficulty level calculated by the moving-image difficulty level calculating means, and a picture type of each of pictures included in the moving image to be encoded by the encoding means.

5. An image processing method comprising the steps of:

obtaining, using predetermined obtaining means, a first still image, a first difficulty level indicating a complexity level of the first still image, a second still image, and a second difficulty level indicating a complexity level of the second still image;

combining the first still image and the second still image at a combination ratio which is changed along a time axis to generate a moving image;

calculating a moving-image difficulty level indicating a complexity level of the moving image according to the first difficulty level, the second difficulty level, and the combination ratio changed along the time axis;

setting an encoding control parameter including an allocated bit rate according to the combination ratio changed along the time axis and the moving-image difficulty level;

determining whether the moving image is an I type according to the combination ratio; and

encoding the moving image according to the encoding control parameter.

6. A non-transitory computer-readable storage medium storing a program for causing a computer to execute image processing, the program comprising the steps of:

obtaining, using predetermined obtaining means, a first still image, a first difficulty level indicating a complexity level of the first still image, a second still image, and a second difficulty level indicating a complexity level of the second still image;

combining the first still image and the second still image at a combination ratio which is changed along a time axis to generate a moving image;

calculating a moving-image difficulty level indicating a complexity level of the moving image according to the first difficulty level, the second difficulty level, and the combination ratio changed along the time axis;

setting an encoding control parameter including an allocated bit rate according to the combination ratio changed along the time axis and the moving-image difficulty level;

determining whether the moving image is an I type according to the combination ratio; and

encoding the moving image according to the encoding control parameter.

7. An image processing apparatus comprising:

an obtaining unit configured to obtain a first still image, a first difficulty level indicating a complexity of the first still image, a second still image, and a second difficulty level indicating a complexity of the second still image;

a combining unit configured to combine the first still image and second still image obtained by the obtaining unit at a combination ratio which is changed along a time axis to generate a moving image;

an encoding unit configured to perform an encoding operation to encode the moving image generated by the combining unit;

a moving-image difficulty-level calculating unit configured to calculate a moving-image difficulty level indicating a complexity of the moving image according to the first difficulty level and second difficulty level obtained by the obtaining unit and the combination ratio changed along the time axis; and

a control unit configured to control a characteristic including an allocated bit rate of the encoding operation performed by the encoding unit according to the combination ratio changed along the time axis and the moving-image difficulty level calculated by the moving-image difficulty level calculating unit,

wherein the control unit determines whether the image is an I type according to the combination ratio.