Image processing device

• US 8,311,367 B2
• Filed: 03/12/2009
• Issued: 11/13/2012
• Est. Priority Date: 09/14/2006
• Status: Expired due to Fees

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Murashita, Kimitaka, Shimizu, Masayoshi, Chujo, Kaoru, Wakamatsu, Takashi
• Primary Examiner(s): Patel, Jayesh A
• Application Number:
  US12/403,027
• Publication Number:
  US 20090232416A1
• Time in Patent Office: 1,342 Days
• Field of Search: 382/154, 382/294, 382/107, 382/260, 382/282, 348/154
• US Class Current: 382/294
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio

Abstract

Adaptive image processing device performs image processing with a simple configuration on a composite image including areas having different characteristics by changing a process depending on the number of combined images in each area of the composite image configured by combining a plurality of images. The image processing device acquires a plurality of images and generates a composite image. When the composite image is generated, the image processing device realizes a process of determining the number of combined images for detecting the number of images to be combined for each area of the composite image and holding the number as information about the number of combined images, and an image processing parameter switching process for switching a parameter of image processing to be performed on each area of the composite image according to the information about the number of combined images.

Claims

1. An image processing device comprising:

a determining unit for detecting a number of combined images for each area of a composite image generated from a plurality of the combined images and storing the number as information about the number of combined images for each area of the composite image when the composite image is generated;

one of or both of an image processing parameter switch unit of switching a parameter of image processing performed on each area of the composite image according to the information about the number of combined images, the parameter being different for different numbers of combined images and an image processing switch unit for switching image processing performed on each area of the composite image according to the information about the number of combined images, the image processing being different for different numbers of combined images;

a unit for generating a processed composite image according to one of or both of a result made by the image processing parameter switch unit and a result made by the image processing switch unit.

2. The device according to claim 1, wherein

the determining unit comprises:

a displacement amount calculation unit calculating an amount of displacement between the images; and

a motion area detection unit detecting a motion area and a no-motion area of a subject between the images on a basis of the amount of displacement, generating motion area information, and changing the information about the number of combined images in the area according to the motion area information.

3. The device according to claim 1, wherein

the determining unit comprises:

a displacement amount calculation unit calculating an amount of displacement between the images; and

a common area detection unit detecting a common area between the images shared among a plurality of images on the basis of the amount of displacement, generating common area information, and changing the information about the number of combined images in the area according to the common area information.

4. The device according to claim 1, wherein

the determining unit calculates an amount of displacement of a color and an intensity level between the images, compares the amount with a predetermined amount of displacement, detects the image with an amount of displacement larger than the predetermined amount of displacement, deletes the detected image from the number of combined images, and performs the process of determining the number of combined images.

5. The device according to claim 1, wherein

the image processing performed on each area of the composite image is a sharpening process.

6. The device according to claim 1, wherein

the image processing performed on each area of the composite image is a noise removing process.

7. The device according to claim 1, wherein

the image processing performed on each area of the composite image is a tone curve correcting process.

8. The device according to claim 1, wherein

the image processing switch unit performs a noise removing process when the information about the number of combined images of the area is N, and performs a sharpening process when the number of combined images is M (N<

M).

9. A non-transitory computer-readable recording medium on which is recorded a program for causing a computer to execute an image process which acquires a plurality of images and generates a composite image, the process comprising:

a determining process for detecting a number of combined images for each area of the composite image generated from a plurality of the combined images and storing the number as information about the number of combined images for each area of the composite image when the composite image is generated;

one of or both of an image processing parameter switching process of switching a parameter of image processing performed on each area of the composite image according to the information about the number of combined images, the parameter being different for different numbers of combined images and an image processing switching process for switching image processing performed on each area of the composite image according to the information about the number of combined images, the image processing being different for different numbers of combined images; and

a generating process generating a processed composite image according to one of or both of a result made by the image processing parameter switching process and a result made by the image processing switching process.

10. The non-transitory computer-readable recording medium according to claim 9, wherein

the determining process calculates an amount of displacement between the images, detects a motion area and a no-motion area of a subject between the images on a basis of the amount of displacement and generates motion area information, and changes the information about the number of combined images in the area according to the motion area information.

11. The non-transitory computer-readable recording medium according to claim 9, wherein

the determining process detects an amount of displacement between the images, detects a common area between the images shared among a plurality of images on the basis of the amount of displacement and generates common area information, and changes the information about the number of combined images in the area according to the common area information.

12. The non-transitory computer-readable recording medium according to claim 9, wherein

the determining process calculates an amount of displacement of a color and an intensity level between the images, compares the amount with a predetermined amount of displacement, detects the image with an amount of displacement larger than the predetermined amount of displacement, deletes the detected image from the number of combined images, and performs the process of determining the number of combined images.

13. The non-transitory computer-readable recording medium according to claim 9, wherein

the image processing performed on each area of the composite image is a sharpening process, a noise removing process, or a tone curve correcting process.

14. The non-transitory computer-readable recording medium according to claim 9, wherein

the image processing switching process performs a noise removing process when the information about the number of combined images of the area is 1, and performs a sharpening process when the number of combined images refers to a plurality of images.