Nonfeedback-based machine vision method for determining a calibration relationship between a camera and a moveable object

• US 5,960,125 A
• Filed: 11/21/1996
• Issued: 09/28/1999
• Est. Priority Date: 11/21/1996
• Status: Expired due to Term

• Current Assignee: Cognex Corporation
• Original Assignee: Cognex Corporation
• Inventors: Michael, David J., Wallack, Aaron
• Primary Examiner(s): Chang, Jon
• Assistant Examiner(s): Wu, Jingge
• Application Number:
  US08/755,766
• Time in Patent Office: 1,041 Days
• Field of Search: 382/151, 382/294, 382/295, 348/87, 348/94, 395/89, 395/94
• US Class Current: 382/294
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06T 7/85 Stereo camera calibration

Abstract

A method is provided for determining a calibration relationship between a reference frame of motion of an object and a reference frame of a camera that generates images of the object. The method includes the steps of coupling a target to an object and placing the object at each of plural locations and orientations that are known with respect to the motion reference frame of the object. The location of the target(s) with respect to the object need not be known. An image of the object and target is generated while the object is at each of those locations/orientations. From each those images, the method determines the location/orientation of the target with respect to the reference frame of the camera. The method then calls for determining the calibration relationship between the reference frame of motion of the object and the camera reference frame as a function of the locations/orientations of the object with respect to the motion reference frame of the object and the locations/orientations of the target in the corresponding images with respect to the reference frame of the camera.

Claims

1. A method of determining a calibration relationship between a reference frame of a motion stage and a reference frame of each of plural image acquisition devices that generate images of that stage, the method comprising the steps of:

A. placing a calibration plate on the motion stage, the calibration plate including plural targets, where each target (i) as a known location (w_xi,w_yi,) on the calibration plate, where at least one target is in the field of view of each image acquisition device, and where the motion stage is at a first known location/orientation (m_x,m_y, θ

)_j, where (j)=1, and generating with each of the image acquisition devices a first image of the motion stage;

B. determining a location (i_x,i_y where (j)=1, of the target in each of those first images;

C. moving the motion stage to one or more other known locations/orientations (m_x,m_y,θ

)_j, where (j)>

1. such that at least one target is in the field of view of each image acquisition device, and generating with each image acquisition device additional images of the motion stage;

D. determining locations (i_x,i_y)_ij, where (j)>

1, of the target in each of those additional images; and

E. determining a calibration relationship between the reference frame of the motion stage and the reference frames of the image acquisition devices as a function of (i) the known locations/orientations of the motion stage (m_x,m_y,θ

)_j, where (j)≧

1, (ii) the locations (i_x,i_y)_ij, where (j)≧

1, of the targets in the corresponding images, and (iii) the known locations (w_xi,w_yi) of the targets on the calibration plate,

wherein step (E) comprises the step of determining the calibration relationship by minimizing an error E_ij between known locations/orientations of the motion stage and estimates thereof in accord with the mathematical relationship ##EQU10## where (m_x,m_y,θ

)_j represents the known motion stage locations/orientations,

(i_x,i_y)_ij represents locations of the targets in the images,

(w_xi,w_yi) represents the known locations of each target on the calibration plate,

G_i (u,v), H(_i (u,v) represent a lens distortion correction functions mapping coordinates

(u,v) in an image to an orthonormal image coordinate system (ix,iy),

P_xi,P_yi represent a position of target (i) in motion stage coordinates when the motion stage is at (x=0,y=0,θ

=0),

α

_i, β

_i represent pixel width and height for camera field of view i,

U and V represent the cosine and sine, respectively, of each image acquisition device'"'"'s coordinate frame,

(O_xi,O_yi) represents a physical position corresponding to specified location for camera field of view i.

2. A method of determining a calibration relationship between a reference frame of a motion stage and a reference frame of each of plural image acquisition devices that generate images of that stage, the method comprising the steps of:

A. placing a calibration plate on the motion stage, the calibration plate including plural targets, where each target (i) as a known location (w_xi,w_yi) on the calibration plate, where at least one target is in the field of view of each image acquisition device, and where the motion stage is at a first known location/orientation (m_x,m_y,θ

)_j, where (j)=1, and generating with each of the image acquisition devices a first image of the motion stage;

B. determining a location (i_x,i_y)_ij, where (j)=1, of the target in each of those first images;

C. moving the motion stage to one or more other known locations/orientations (m_x,m_y,θ

)_j, where (j)>

1, such that at least one target is in the field of view of each image acquisition device, and generating with each image acquisition device additional images of the motion stage;

D. determining locations (i_x,i_y)_ij, where (j)>

1, of the target in each of those additional images; and

E. determining a calibration relationship between the reference frame of the motion stage and the reference frames of the image acquisition devices as a function of (i) the known locations/orientations of the motion stage (m_x,m_y,θ

)_j, where (j)≦

1, (ii) the locations (i_x, i_y)_ij, where (j)≧

1, of the targets in the corresponding images and (iii) the known locations (w_xi,w_yi) of the targets on the calibration plate,

wherein step (E) comprises the step of determining the calibration relationship by minimizing an error E_ij between known locations/orientations of the motion stage and estimates thereof in accord with the following mathematical relationship ##EQU11## where (m_x,m_y,θ

)_j represents the known motion stage locations/orientations,

(i_x,i_y)_ij represents locations of the targets in the images,

(w_xi,w_yi) represents the known locations of each target on the calibration plate,

(x_c, y_c, θ

_c) represent unknown locations/orientations of the calibration plate with respect to the motion stage,

α

_i, β

_i represent pixel width and height for camera field of view i,

U and V represent the cosine and sine, respectively, of each image acquisition device'"'"'s coordinate frame,

(O_xi,O_yi) represents a physical position corresponding to specified location for camera field of view i.

3. A method according to claim 2, wherein step (E) comprises the steps of iteratively (i) using gradient descent to vary θ

_c, and (ii) determining the calibration relationship by solving for the error E_ij at each of those values of θ

_c.