Image processing based on direction of gravity

• US 20060078214A1
• Filed: 10/12/2004
• Published: 04/13/2006
• Est. Priority Date: 10/12/2004
• Status: Active Grant

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Eastman Kodak Company
• Inventors: Gallagher, Andrew C.
• Granted Patent: US 7,583,858 B2
• Time in Patent Office: Days
• US Class Current: 382/254
• CPC Class Codes: G06T 5/006 Geometric correction correction of chromatic aberrations adapted to be used in an image pickup device containing an electronic image sensor H04N23/10; detecting, correcting, reducing or removing artefacts resulting only from the lens unit, e.g. flare, shading, vignetting or "cos4" H04N25/61
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/684 performed by controlling the image sensor readout, e.g. by controlling the integration time
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

A method of processing a digital image to produce an improved digital image, includes receiving the digital image captured with a camera; determining a first vanishing point associated with the digital image; determining a second vanishing point associated with the digital image corresponding to a direction orthogonal the first vanishing point; determining a transform for modifying the digital image based on the first vanishing point and the second vanishing point; and applying the transform to the digital image to produce an improved digital image.

Claims

1. A method of processing a digital image to produce an improved digital image, comprising:

(a) receiving the digital image captured with a camera;

(b) determining a first vanishing point associated with the digital image;

(c) determining a second vanishing point associated with the digital image corresponding to a direction orthogonal the first vanishing point;

(d) determining a transform for modifying the digital image based on the first vanishing point and the second vanishing point; and

(e) applying the transform to the digital image to produce an improved digital image.

2. The method of claim 1, wherein the first vanishing point relates to the direction of gravity relative to the coordinate system of the camera.

3. The method of claim 2 wherein the first vanishing point corresponds to the direction of gravity and is determined by a gravity sensor integrally formed with the camera or by analyzing the digital image to provide a vanishing point associated with vertical scene lines.

4. The method of claim 2, wherein the second vanishing point is associated with a set of horizontal lines in the scene.

5. The method of claim 4 further including using the transform to correct for unintentional camera rotations, perspective distortions, or combinations thereof.

11. A computer program product that practices the method of claim 1.

6. A method of processing an image to produce an improved digital image, comprising:

(a) receiving a digital image captured with a camera;

(b) determining a vanishing point associated with the digital image, wherein the vanishing point relates to the direction of gravity relative to the orientation of the camera; and

(c) using the vanishing point to determine a horizon in the image.

7. The method of claim 6, further including using the horizon to determine a transform for modifying the digital image.

8. The method of claim 7, wherein the transform is used to modify the rotation of the image.

9. The method of claim 6, further including using the horizon to classify regions of an image according to scene type or material.

10. The method of claim 9, wherein the specific region includes sky, grass, water, clouds, pavement, road surface, snow, automobiles, or people.