System and process for color-balancing a series of oblique images

• US 9,503,615 B2
• Filed: 02/26/2015
• Issued: 11/22/2016
• Est. Priority Date: 10/12/2007
• Status: Active Grant

• Current Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Original Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Inventors: Giuffrida, Frank D. R., Schultz, Stephen L., Gray, Robert
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US14/632,732
• Publication Number:
  US 20160248944A1
• Time in Patent Office: 635 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H04N 1/6077 Colour balance, e.g. colour cast correction
• CPC Class Codes: H04N 1/6083 controlled by factors external to the apparatus

Abstract

Image processing systems and methods are disclosed, including an image processing system comprising a computer running image processing software causing the computer to receive an oblique aerial image having at least a first section and a second section, wherein the first section has a first color distribution and the second section has a second color distribution; receive at least two reference images having consistent color distributions; receive geographic information about the at least two reference images and the oblique aerial image; choose at least a one reference image for each of the first and second sections based on the geographic information; and create at least one color-balancing transformation for the first and second sections.

Claims

1. An image processing system, comprising:

a computer running image processing software causing the computer to;

receive an oblique aerial image, the oblique aerial image having at least a first section and a second section, wherein the first section has a first color distribution and the second section has a second color distribution, the first color distribution differing from the second color distribution;

receive at least two reference images, each reference image having a consistent color distribution;

receive geographic information about the at least two reference images and the oblique aerial image;

choose at least a first chosen reference image from the at least two reference images for the first section of the oblique aerial image, based on automatically matching at least a portion of the geographic information of the oblique aerial image with at least a portion of the geographic information of the first chosen reference image;

choose at least a second chosen reference image from the at least two reference images for the second section of the oblique aerial image, based on automatically matching at least a portion of the geographic information of the oblique aerial image with at least a portion of the geographic information of the second chosen reference image;

create at least one color-balancing transformation for the first section of the aerial oblique image such that the first color distribution of the first section matches the consistent color distribution of the first chosen reference image; and

create at least one color-balancing transformation for the second section of the aerial oblique image such that the second color distribution of the second section matches the consistent color distribution of the second chosen reference image.

2. The image processing system of claim 1, wherein the first color distribution of the first section of the aerial oblique image is caused by first specular reflections and the second color distribution of the second section of the aerial oblique image is caused by second specular reflections.

3. The image processing system of claim 1, wherein the image processing software further causes the computer to store the color-balancing transformations for the sections.

4. The image processing system of claim 1, wherein the at least two reference images are aerial nadir images.

5. The image processing system of claim 1, wherein the color distributions comprise color-bands, and the color-balancing transformations comprise creating histograms for each color-band in the color distribution and color-balancing and blending pixel values for each color-band.

6. A method for processing oblique images comprising:

receiving, with a computer running image processing software, an oblique aerial image, the oblique aerial image having at least a first section and a second section, wherein the first section has a first color distribution and the second section has a second color distribution, the first color distribution differing from the second color distribution;

receiving, with the computer, at least two reference images, each reference image having a consistent color distribution;

receiving, with the computer, geographic information about the at least two reference images and the oblique aerial image;

choosing, automatically with the computer, a first chosen reference image from the at least two reference images for the first section of the oblique aerial image, based on automatically matching at least a portion of the geographic information of the oblique aerial image with at least a portion of the geographic information of the first chosen reference image;

choosing, automatically with the computer, a second chosen reference image from the at least two reference images for the second section of the oblique aerial image, based on automatically matching at least a portion of the geographic information of the oblique aerial image with at least a portion of the geographic information of the second chosen reference image;

creating, automatically with the computer, at least one color-balancing transformation for the first section of the aerial oblique image such that the first color distribution of the first section matches the consistent color distribution of the first chosen reference image; and

creating, automatically with the computer, at least one color-balancing transformation for the second section of the aerial oblique image such that the second color distribution of the second section matches the consistent color distribution of the second chosen reference image.

7. The method of claim 6, wherein the first color distribution of the first section of the aerial oblique image is caused by first specular reflections and the second color distribution of the second section of the aerial oblique image is caused by second specular reflections.

8. The method of claim 6, further comprising storing, automatically with the computer, the color-balancing transformations for the sections.

9. The method of claim 6, wherein the at least two reference images are aerial nadir images.

10. The method of claim 6, wherein the color distributions comprise color-bands, and the color-balancing transformations comprise creating histograms for each color-band in the color distribution and color-balancing and blending pixel values for each color-band.