Omni-directional camera with calibration and up look angle improvements

• US 7,495,694 B2
• Filed: 07/28/2004
• Issued: 02/24/2009
• Est. Priority Date: 07/28/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Cutler, Ross
• Primary Examiner(s): Vu; Ngoc-Yen T
• Assistant Examiner(s): SEGURA, CYNTHIA
• Application Number:
  US10/902,675
• Publication Number:
  US 20060023074A1
• Time in Patent Office: 1,672 Days
• Field of Search: 348/218.1, 348/219.1, 348/195, 348/202, 348/335, 348/350, 348/343, 348/344, 348/360, 348/361, 348/373, 348/375, 348/264, 348/262, 359/381, 359/201, 359/202, 359/200, 359/210
• US Class Current: 348/218.1
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

Improved camera calibration techniques, including an improved up look angle and an improved method for calibrating a virtual center of projection. By using a view camera technique for the up look angle, the image sensors can be mounted flat to a Printed Circuit Board (PCB). By using a sub-region of the image sensor for the active area of the camera it is possible to calibrate the virtual center of projection (C′).

Claims

1. A camera system comprising:

an N-sided mirror located above N cameras, where N is a number of two or more, the N cameras arranged to be equally spaced around at least a portion of a circle, each camera capturing an image reflected in a different side of said N-sided mirror, wherein each camera has an up look angle from the horizontal plane achieved by horizontally mounting each camera sensor and electronically offsetting the center of each camera lens from the center of its associated sensor which in turn offsets the optical axis;

so that the image in each mirror is completely captured by the sensor and wherein a virtual center of projection C′

between adjacent cameras of the N cameras is simultaneously electronically calibrated by using a sub-region of the associated sensor.

2. The camera system of claim 1 wherein by adjusting the x and y offset of the lens relative to the sensor, the virtual center of projection C′

is shifted to a desired position.

3. The camera system of claim 1 wherein the desired position of the virtual center of projection is electronically achieved using sensor sub-images.

4. The camera system of claim 1 wherein the focus of the camera is mechanically adjusted.

5. The camera system of claim 1 wherein said N cameras in total cover 360 degrees in the horizontal plane.

6. The camera system of claim 1 wherein the up look angle is achieved by offsetting the optical axis by the camera'"'"'s focal length f multiplied by the tangent of the angle X of the optical axis with respect to the vertical.