System and method for camera color calibration and image stitching

• US 7,259,784 B2
• Filed: 06/21/2002
• Issued: 08/21/2007
• Est. Priority Date: 06/21/2002
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Cutler, Ross
• Primary Examiner(s): Vu; Ngoc-Yen
• Assistant Examiner(s): MADDEN, GREGORY VINCENT
• Application Number:
  US10/177,315
• Publication Number:
  US 20030234866A1
• Time in Patent Office: 1,887 Days
• Field of Search: 348/223.1, 348 47- 48, 348 36- 38, 348/229.1, 382/154, 382/167, 382/274, 358515-517
• US Class Current: 348/223.1
• CPC Class Codes: G06T 2200/32 involving image mosaicing
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: H04N 1/3876 Recombination of partial images to recreate the original image
• CPC Class Codes: H04N 1/6027 Correction or control of colour gradation or colour contrast H04N1/6058 takes precedence
• CPC Class Codes: H04N 17/002 for television cameras
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/88 for colour balance, e.g. white-balance circuits or colour temperature control
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 9/73 Colour balance circuits, e.g. white balance circuits or colour temperature control camera processing pipelines for colour balance H04N23/88

Abstract

A practical, real-time calibration of digital omnidirectional cameras in the areas of de-vignetting, brightness, contrast, and white balance control. Novel solutions for the color calibration of an omnidirectional camera rig, and an efficient method for devignetting images are presented. Additionally, a context-specific method of stitching images together into a panorama or a mosaic is provided.

Claims

1. A process for color calibrating a series of cameras capturing different portions of the same scene, comprising the following process actions:

selecting a reference camera from a series of cameras configured to capture different portions of a scene;

calibrating said reference camera to optimum color settings for capturing portions of said scene by setting the reference camera for optimum brightness by adjusting a mean intensity of the scene until it reaches a value corresponding to a black reference value,

wherein the black reference value is determined by a black reference pixel region in the camera, and wherein the optimum brightness is adjusted so that the mean black reference pixel region eauals the black reference value, and

wherein the black reference value is equal to two times the standard deviation of the pixels of the black reference pixel region; and

propagating the optimum color settings from the reference camera to all other cameras in the series for regions of camera overlap.

2. The process of claim 1 further comprising the process actions of:

continually recalibrating the reference camera; and

propagating any changes in the reference camera settings to the other cameras in the series.

3. The process of claim 1 wherein a different reference camera from the initial reference camera is calibrated.

4. The process of claim 1 wherein setting the reference camera for optimum brightness comprises the process actions of:

setting an exposure setting on the reference camera to zero; and

adjusting the mean intensity of the scene until it reaches a prescribed value corresponding to black.

5. The process of claim 1 wherein the process action of calibrating the reference camera to optimum color settings comprises setting the reference camera for optimum contrast.

6. The process of claim 1 wherein the process action of calibrating the reference camera to optimum color settings comprises setting the reference camera for optimum white balance.

7. The process of claim 5 wherein setting the reference camera for optimum contrast comprises the process actions of:

adjusting the contrast so as to make the mean contrast equal to a prescribed value.

8. The process of claim 5 wherein setting the reference camera for optimum contrast comprises the process action of:

adjusting the contrast so as to make the resulting image as bright as possible without saturation.

9. The process of claim 6 wherein setting the reference camera for optimum white balance comprises making red components, blue components and green components in the scene equal.