IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND COMPUTER READABLE MEDIUM

• US 20090022403A1
• Filed: 07/18/2008
• Published: 01/22/2009
• Est. Priority Date: 07/20/2007
• Status: Abandoned Application

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Noguchi, Yukinori, TAKAMORI, Tetsuya, Kameyama, Hirokazu
• Application Number:
  US12/175,876
• Publication Number:
  US 20090022403A1
• Time in Patent Office: Days
• US Class Current: 382/195
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

There is provided an image processing apparatus for processing a moving image including a plurality of moving-image-component images. The image processing apparatus includes a characteristic region detecting section that detects a characteristic region in one or more of the plurality of moving-image-component images, and a characteristic region identifying section that identifies a position of the characteristic region in a non-selected image with reference to a position of the characteristic region in a selected image. Here, the selected image is selected from the plurality of moving-image-component images of the moving image, and the non-selected image is a different one of the plurality of moving-image-component images than the selected image. The characteristic region identifying section identifies the position of the characteristic region in the non-selected image with reference to a position of the characteristic region in a selected image preceding the non-selected image and a position of the characteristic region in a selected image following the non-selected image.

Claims

1. An image processing apparatus for processing a moving image including a plurality of moving-image-component images, comprising:

a characteristic region detecting section that detects a characteristic region in one or more of the plurality of moving-image-component images; and

a characteristic region identifying section that identifies a position of the characteristic region in a non-selected image with reference to a position of the characteristic region in a selected image, the selected image being selected from the plurality of moving-image-component images of the moving image, the non-selected image being a different one of the plurality of moving-image-component images than the selected image.

2. The image processing apparatus as set forth in claim 1, wherein

the characteristic region detecting section detects the characteristic region in the selected image that is selected from the plurality of moving-image-component images of the moving image, and

the characteristic region identifying section identifies the position of the characteristic region in the non-selected image which is a not-selected one of the plurality of moving-image-component images in the moving-image, with reference to the position of the characteristic region in the selected image.

3. The image processing apparatus as set forth in claim 2, wherein

the characteristic region identifying section identifies the position of the characteristic region in the non-selected image with reference to a position of the characteristic region in a selected image preceding the non-selected image and a position of the characteristic region in a selected image following the non-selected image.

4. The image processing apparatus as set forth in claim 2, further comprising

a motion vector obtaining section that obtains a motion vector of a subject in the moving image, wherein

the characteristic region identifying section identifies the position of the characteristic region in the non-selected image with reference to the obtained motion vector and the position of the characteristic region in the selected image.

5. The image processing apparatus as set forth in claim 4, further comprising:

a compressed moving image obtaining section that obtains the moving image including the motion vector, the moving image being in a state of compressed; and

a compressed moving image expanding section that expands the moving image obtained by the compressed moving image obtaining section, wherein

the characteristic region detecting section detects the characteristic region in the selected image which is selected from the moving image which has been expanded by the compressed moving image expanding section,

the motion vector obtaining section obtains the motion vector included in the moving image obtained by the compressed moving image obtaining section, and

the characteristic region identifying section identifies the position of the characteristic region in the non-selected image which is a not-selected one of the plurality of moving-image-component images in the moving image that has been expanded by the compressed moving image expanding section, with reference to the obtained motion vector and the position of the characteristic region in the selected image.

6. The image processing apparatus as set forth in claim 5, wherein

the compressed moving image obtaining section obtains an MPEG moving image including the motion vector,

the compressed moving image expanding section expands the MPEG moving image obtained by the compressed moving image obtaining section,

the characteristic region detecting section detects the characteristic region in the selected image included in the expanded MPEG moving image, and

the motion vector obtaining section obtains the motion vector included in the MPEG moving image obtained by the compressed moving image obtaining section.

7. The image processing apparatus as set forth in claim 1, further comprising

a motion vector obtaining section that obtains a motion vector of a subject in the moving image, wherein

the characteristic region identifying section identifies the position of the characteristic region in the non-selected image, with reference to the position of the characteristic region in the selected image and motion vectors associated with more than one of the plurality of moving-image-component images.

8. The image processing apparatus as set forth in claim 7, wherein

the characteristic region identifying section identifies the position of the characteristic region in the non-selected image which is indirectly correlated by way of motion vectors with the characteristic region in the selected image, with reference to the position of the characteristic region in the selected image, a motion vector of the non-selected image, and one or more motion vectors of one or more moving-image-component images which are directly or indirectly correlated with the characteristic region in the selected image and the non-selected image by way of the motion vectors.

9. The image processing apparatus as set forth in claim 8, wherein

the characteristic region identifying section identifies a correlated region in the non-selected image which is indirectly correlated by way of motion vectors with the characteristic region in the selected image, with reference to the position of the characteristic region in the selected image, a motion vector of the non-selected image, and one or more motion vectors of one or more moving-image-component images which are directly or indirectly correlated with the characteristic region in the selected image and the non-selected image by way of the motion vectors, and identifies a region including at least part of the identified correlated region, as the characteristic region in the non-selected image.

10. The image processing apparatus as set forth in claim 9, wherein

the characteristic region identifying section identifies, as the characteristic region, a region including at least one of a characteristic region detected in the non-selected image by the characteristic region detecting section and the correlated region in the non-selected image.

11. The image processing apparatus as set forth in claim 9, wherein

the characteristic region identifying section identifies, as the characteristic region, a region included in both a characteristic region detected in the non-selected image by the characteristic region detecting section and the correlated region in the non-selected image.

12. The image processing apparatus as set forth in claim 9, further comprising

a compressing section that compresses an image of a region other than the characteristic region identified by the characteristic region identifying section at a higher strength than the characteristic region identified by the characteristic region identifying section.

13. The image processing apparatus as set forth in claim 12, wherein

the compressing section compresses an image of a region included in one of a characteristic region detected in the non-selected image by the characteristic region detecting section and the correlated region in the non-selected image, at a higher strength than a region included in both the characteristic region detected in the non-selected image by the characteristic region detecting section and the correlated region in the non-selected image.

14. The image processing apparatus as set forth in claim 9, wherein

when a distance between a position of a characteristic region detected by the characteristic region detecting section in the non-selected image and a position of the correlated region in the non-selected image is longer than a predetermined value, the characteristic region identifying section identifies the correlated region in the non-selected image as a characteristic region containing an object different from an object in the characteristic region detected by the characteristic region detecting section in the non-selected image.

15. The image processing apparatus as set forth in claim 2, further comprising:

an image dividing section that divides each of the selected image and the non-selected image into the characteristic region and a background region other than the characteristic region; and

a coding section that codes an image of the characteristic region and an image of the background region at different strengths from each other.

16. The image processing apparatus as set forth in claim 15, further comprising:

an inclusion region identifying section that identifies an inclusion region including the characteristic region detected in the selected image and the characteristic region identified in the non-selected image; and

a value fixing section that sets, at a fixed value, a pixel value of a region other than the inclusion region in each of the selected image and the non-selected image, wherein

the coding section codes an image of the inclusion region and an image of the region other than the inclusion region at different strengths from each other.

17. An image processing method for processing a moving image including a plurality of moving-image-component images, comprising:

detecting a characteristic region in one or more of the plurality of moving-image-component images; and

identifying a position of the characteristic region in a non-selected image with reference to a position of the characteristic region in a selected image, the selected image being selected from the plurality of moving-image-component images of the moving image, the non-selected image being a different one of the plurality of moving-image-component images than the selected image.

18. A computer readable medium storing thereon a program for use with an image processing apparatus for processing a moving image including a plurality of moving-image-component images, the program causing the image processing apparatus to function as:

a characteristic region detecting section that detects a characteristic region in one or more of the plurality of moving-image-component images; and

a characteristic region identifying section that identifies a position of the characteristic region in a non-selected image with reference to a position of the characteristic region in a selected image, the selected image being selected from the plurality of moving-image-component images of the moving image, the non-selected image being a different one of the plurality of moving-image-component images than the selected image.