Providing improved high resolution image

• US 8,179,445 B2
• Filed: 03/03/2010
• Issued: 05/15/2012
• Est. Priority Date: 03/03/2010
• Status: Expired due to Fees

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Eastman Kodak Company
• Inventors: Hao, Wei
• Primary Examiner(s): VILLECCO, JOHN M
• Application Number:
  US12/716,484
• Publication Number:
  US 20110216210A1
• Time in Patent Office: 804 Days
• Field of Search: 348/220.1, 348/208.13, 382/299, 382/300
• US Class Current: 348/208.13
• CPC Class Codes: G06T 3/4053 based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations

Abstract

A method for producing an improved high resolution image is disclosed including capturing low resolution images and a high resolution image; combining the low resolution images to provide an aggregate low resolution image; reducing the resolution of the high resolution image and then interpolated to produce a blurred high resolution image; calculating an image difference map using the aggregate high resolution image and blurred high resolution image; and using the image difference map along with the aggregate high resolution image and the high resolution image to produce an improved high resolution image.

Claims

1. A method for using low resolution images and at least one high resolution image of a scene captured by the same image capture device to provide an improved high resolution image, comprising:

a) using the image capture device to capture a plurality of low resolution images of the scene and at least one high resolution image of the scene having a resolution greater than that of the low resolution images;

b) combining the low resolution images to provide an aggregate low resolution image; and

c) combining the high resolution image with the aggregate low resolution image to provide the improved high resolution image by;

i) interpolating the aggregate low resolution image to provide an aggregate high resolution image;

ii) reducing the resolution of the high resolution image to provide a representative low resolution image that could have been captured by the image capture device;

iii) interpolating the representative low resolution image to producing a blurred high resolution image;

iv) calculating an image difference map from the aggregate high resolution image and the blurred high resolution image; and

v) using the image difference map along with the aggregate high resolution image and the high resolution image to produce an improved high resolution image.

2. The method of claim 1 wherein step b) further includes using an infinite impulse response filter to combine the low resolution images to provide an aggregate low resolution image.

3. The method of claim 1 wherein step b) further includes correcting for motion present between at least some of the low resolution images.

4. The method of claim 1 wherein step c)ii) further includes reducing the resolution of the high resolution image using substantially the same binning and decimation procedure used in the capture of the low resolution images.

5. The method of claim 1 wherein step c)v) includes:

a) producing a blurred high resolution image by reducing the high resolution image to produce a reduced image and then interpolating the reduced image to produce the blurred high resolution;

b) combining chrominance information from the aggregate high resolution image and chrominance information from the blurred high resolution image using the image difference map to form combined chrominance information;

c) computing luminance information corresponding to the high resolution image; and

d) using the combined chrominance information and the luminance information from the high resolution image to produce the improved high resolution image.

6. The method of claim 1 wherein step c)v) also includes:

a) producing a blurred high resolution image;

b) computing the difference between the aggregate high resolution image and the blurred high resolution image to form a residual image;

c) reducing the noise in the high resolution image to produce a noise-reduced high resolution image; and

d) using the residual image, the reduced-noise high resolution image and the image difference map to form an improved high resolution image.