Image processing based on direction of gravity

• US 20060078215A1
• Filed: 10/12/2004
• Published: 04/13/2006
• Est. Priority Date: 10/12/2004
• Status: Abandoned Application

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Gallagher, Andrew C.
• Application Number:
  US10/963,344
• Publication Number:
  US 20060078215A1
• Time in Patent Office: Days
• US Class Current: 382/254
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: G06T 5/006 Geometric correction correction of chromatic aberrations adapted to be used in an image pickup device containing an electronic image sensor H04N23/10; detecting, correcting, reducing or removing artefacts resulting only from the lens unit, e.g. flare, shading, vignetting or "cos4" H04N25/61
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 1/00127 Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00323 with a measuring, monitoring or signaling apparatus, e.g. for transmitting measured information to a central location
• CPC Class Codes: H04N 1/3878 Skew detection or correction
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/684 performed by controlling the image sensor readout, e.g. by controlling the integration time
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

A method of processing a digital image to produce an improved digital image, includes receiving the digital image captured with a camera; providing a gravity detection device integral with the camera; using the gravity detection device to determine the direction of gravity relative to the coordinate system of the camera at substantially the time the digital image was captured; determining a transform for modifying the digital image from the direction of gravity; and applying the transform to the digital image to produce an improved digital image.

Claims

1. A method of processing a digital image to produce an improved digital image, comprising:

(a) receiving the digital image captured with a camera;

(b) providing a gravity detection device integral with the camera;

(c) using the gravity detection device to determine the direction of gravity relative to the coordinate system of the camera at substantially the time the digital image was captured;

(d) determining a transform for modifying the digital image from the direction of gravity; and

(e) applying the transform to the digital image to produce an improved digital image.

2. The method of claim 1 further including using the transform to rotate the image to remove unintentional camera rotation.

3. The method of claim 1 further including using the transform to modify the perspective of the image to reduce perspective distortion.

12. A computer program product that practices the method of claim 1.

4. A method of setting exposure time for capturing a digital image with a digital camera having a gravity detection device integral with the camera, comprising:

(a) using the gravity detection device to determine the direction of gravity relative to the coordinate system of the camera for a series of times prior to the capture of the digital image;

(b) determining a jitter amount for the camera by analyzing the series of directions or gravity; and

(c) determining the exposure time based on the determined jitter amount.

5. The method of claim 4, further including determining if the camera has unacceptable movement based on the determined jitter amount and determining the exposure time if the camera has unacceptable movement.

6. A method of processing an image to produce an improved digital image, comprising:

(a) receiving a digital image captured with a camera having a camera lens system;

(b) providing a gravity detection device integral with the camera;

(c) using the gravity detection device to determine the direction of gravity relative to the coordinate system of the camera at substantially the time the digital image was captured; and

(d) using the direction of gravity relative to the orientation of the camera to determine a horizon in the image.

7. The method of claim 6, wherein step d) further includes using the focal length of the camera lens system and the direction of gravity relative to the coordinate system of the camera to determine the horizon.

8. The method of claim 6, further including using the horizon to determine a transform for modifying the digital image.

9. The method of claim 8, wherein the transform is used to modify the rotation of the image.

10. The method of claim 6, further including using the horizon to classify regions of an image according to scene type or material.

11. The method of claim 10, wherein the specific region includes sky, grass, water, clouds, pavement, road surface, snow, automobiles, or people.