Image processing device, electronic camera and image processing program

• US 8,194,148 B2
• Filed: 09/07/2007
• Issued: 06/05/2012
• Est. Priority Date: 09/14/2006
• Status: Active Grant

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Doida, Shigeru
• Primary Examiner(s): Ho, Tuan
• Assistant Examiner(s): WANG, KENT F
• Application Number:
  US12/309,684
• Publication Number:
  US 20100007754A1
• Time in Patent Office: 1,733 Days
• Field of Search: 348/222.1, 348/229.1, 348/207.99, 348571-721, 348/231.2, 382/216, 382/294, 382/236, 358/3.27, 358/448, 358/450, 358/540
• US Class Current: 348/222.1
• CPC Class Codes: H04N 1/3871 the composed originals being of different kinds, e.g. low- and high-resolution originals
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 25/587 acquired sequentially, e.g. using the combination of odd and even image fields

Abstract

The image processing device of the present invention is provided with an image input section, a position discrepancy detecting section, and an image composition section. The image input section reads a plurality of low resolution images imaging a same object, and at least one high resolution image imaging a same object. The position discrepancy detecting section detects position discrepancy of patterns between respective low resolution images and the high resolution image. The image composition section positions and composes patterns of the plurality of low resolution images based on the position discrepancy.

Claims

1. An image processing device comprising:

an image input section which reads a plurality of first resolution images of imaging a same object and at least one second resolution image of imaging the same object, the second resolution image having a higher resolution image than the first resolution images;

a position discrepancy detecting section which detects position discrepancy of patterns between the respective first resolution images and the second resolution image; and

an image composition section which positions and composes patterns for the plurality of first resolution images based on the position discrepancy.

2. The image processing device according to claim 1, wherein

the position discrepancy detecting section comprises:

a phase dividing section which performs sub-sampling of one of the second resolution image and its feature with its phase shifted and generates a plurality of pieces of mutually phase-shifted sampling information; and

a detail detecting section which detects the position discrepancy in units smaller than pixel distances of the first resolution images by detecting the position discrepancy where a feature of patterns best coincides between the first resolution images and the plurality of pieces of sampling information.

3. The image processing device according to claim 1, wherein

the position discrepancy detecting section comprises:

a rough detecting section which detects position discrepancy of patterns between the plurality of first resolution images; and

a detail detecting section which detects position discrepancy between the second resolution image and the first resolution images starting from the position discrepancy detected by the rough detecting section.

4. The image processing device according to claim 1, wherein

the image composition section relocates and composes signal components of the plurality of first resolution images based on the position discrepancy, and generates a relocated images having higher resolution.

5. The image processing device according to claim 4, wherein

the image composition section generates a composite image based on the second resolution image and the relocated images.

6. The image processing device according to claim 5, wherein

the composite image is generated with a composite rate of the relocated images locally reduced at portions where a larger signal difference exists between the second resolution image and the relocated images.

7. The image processing device according to claim 5, wherein

the composite image is generated with the composite rate of the relocated images locally reduced at portions where a larger local signal variation of the second resolution image exists.

8. The image processing device according to claim 5, wherein

the composite image is generated with the composite rate of the relocated images generally raised progressively when one of a time interval and the position discrepancy between the second resolution image and the first resolution images is smaller.

9. The image processing device according to claim 5, wherein

the image composition section generates the composite image for high visual-sensitivity signal components constituting a color image, and generates the relocated images for remaining first visual-sensitivity signal components.

10. An electronic camera comprising:

the image processing device according to claim 1; and

an imaging section which images an object with at least two types of resolution, wherein

the second resolution image processed by the image processing device is a second resolution still image imaged with the imaging section, and

the first resolution image processed by the image processing device is a first resolution image imaged with the imaging section one of before and after imaging the still image.

11. A non-transitory computer readable medium storing an image processing program capable of instructing a computer to function as the image processing device according to claim 1.

12. The image processing device according to claim 1, wherein

the image composition section judges a high frequency components of spatial frequency for the plurality of first resolution images, and reduces the composite rate of a positioning composition in the edge part of the pattern having the less high frequency components.

13. The image processing device according to claim 12, wherein

the image composition section raises the composite rate if the positioning composition in a flat part of the pattern to be higher than the composite rate of the edge part for the images which are judged of having the less high frequency components.

14. The image processing device according to claim 12, wherein

the image composition section selects the images for use in the composition in accordance with the amount of the high frequency component.

15. An electronic camera comprising;

the image processing device according to claim 12, and

an imaging section which consecutively images objects and generates a plurality of first resolution images and second resolution images, the second resolution image having a higher resolution image than the first resolution images, wherein

the electronic camera has a function of positioning and composing the plurality of first resolution images with the image processing device.

16. An image processing device comprising:

an image input section which reads a plurality of images of imaging a same object;

a position discrepancy detecting section which detects position discrepancy of patterns between the plurality of images; and

an image composition section which positions and composes the patterns of the plurality of images based on the position discrepancy, wherein

the image composition section judges magnitude of a local signal variation for a positioning reference image, and locally lowers the composite rate of other images at portions where the signal variation is judged to be large.

17. An electronic camera comprising:

the image processing device according to claim 16; and

an imaging section which consecutively images object and generates a plurality of images, wherein

the electronic camera has a function of positioning and composing the plurality of images with the image processing device.

18. A non-transitory computer readable medium storing an image processing program capable of instructing a computer to function as the image processing device according to claim 16.

19. An image processing device comprising:

an image input section which reads a plurality of images of imaging a same object;

a position discrepancy detecting section which detects position discrepancy of patterns between the plurality of images; and

an image composition section which positions and composes the patterns of the plurality of images based on the position discrepancy, wherein

the image composition section finds a difference of gradation value of target pixels at respective corresponding positions in a positioning reference image and other images, and locally lowers the composite rate of the other images at portions where the difference of gradation value is judged to be large.

20. An electronic camera comprising:

the image processing device according to claim 19; and

an imaging section which consecutively images objects and generates a plurality of images, wherein

the electronic camera has a function of positioning and composing the plurality of images with the image processing device.

21. A non-transitory computer readable medium storing an image processing program capable of instructing a computer to function as the image processing device according to claim 19.