Choice of reference markings for enabling fast estimating of the position of an imaging device

• US 7,477,774 B2
• Filed: 07/04/2002
• Issued: 01/13/2009
• Est. Priority Date: 07/04/2001
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Villain, Nicolas
• Primary Examiner(s): Ahmed; Samir A
• Assistant Examiner(s): Allison; Andrae S
• Application Number:
  US10/482,141
• Publication Number:
  US 20040151363A1
• Time in Patent Office: 2,385 Days
• Field of Search: 382/151, 382/147, 382/141, 382/145, 382/209, 382/266, 382/199, 348124-126, 348 87- 89
• US Class Current: 382/151
• CPC Class Codes: H05K 13/0818 Setup of monitoring devices prior to starting mounting operations; Teaching of monitoring devices for specific products; Compensation of drifts during operation, e.g. due to temperature shifts

Abstract

A method of estimating the position of the field of view of an imaging device, such as a camera, relative to a board involves designating markings on the board as references and detecting the shift in these reference markings within the field of view of the camera compared to a known position therein. The reference markings are selected such that detection thereof involves analysis of only a subset of the image produced by the imaging device. The selection of a group of one or more markings to serve as a reference involves determination of the image region (error window) in which the reference marking(s) may appear, given the maximal positional error of the imaging device. It is also checked (step T4) that the entire error window will be within the useable field of view of the imaging device and that, within the error window, no other group of markings will appear that could be confused with the selected group of markings (step T5). Detection of the reference group of markings involves generation of an image profile along a line crossing the center of the error window and finding the best match between the markings along this profile and the markings in the reference group.

Claims

1. A method of estimating the position of the field of view of an imaging device relative to a board having markings visible thereon, the method comprising the step of:

estimating the position of the field of view of the imaging device based on changes in position of a selected set of reference groups of markings, wherein for each selected reference group of markings, the change in position is determined by acquisition and analysis of image data of a corresponding;

selecting group(s) of one or more markings on the board to serve as respective reference group, the field of view of the image device being at a first position relative to the board when the selected reference group(s) are at a nominal position in the field of view;

using the image device to generate an image of a subset of the board corresponding to the nominal position of each respective reference group, at least one dimension of the subset image being substantially equal to or greater than the maximal positioning error of the image device in each respective subset image, detecting the image of the corresponding reference group, and determining the offset between the nominal position of the reference group in the field of view of the image device and the detected position thereof; and

determining the position of the field of view of the image device based on the determined offsets and based on the known relationship between the first position of the image device and the nominal position of the reference group(s).

2. The position-estimation method of claim 1, wherein the group-selecting step comprises:

designating as a candidate group a group of one or more markings on the board;

determining, based on the maximal positional error of the imaging device, the boundaries of an image region where the image of the candidate group can appear; and

rejecting the candidate group if the determined image region is not completely included in the useable field of view of the imaging device.

3. The position-estimation method of claim 2, wherein the group-selecting step comprises:

analyzing a portion of the board, the portion corresponding to said image region, to determine whether said candidate group can be identified unambiguously; and

selecting said candidate group to serve as a reference group only if the analysis step determines that the candidate group can be identified unambiguously in said portion of the board.

4. The position-estimation method of claim 3, wherein the analyzing step comprises the step of assessing whether, in the determined portion of the board, there is any other group of one or more markings having the same spacing, or the same spacing and orientation, as marking(s) constituting the candidate group, and designating the candidate group ambiguous if any such other group is found in the portion of the board.

5. The position-estimation method of claim 3, wherein the analyzing step comprises the step of scanning said image region in a specified direction whereby to assess whether the candidate group is the first or last group scanned and, if the candidate group is the first or last group scanned, designating the candidate group unambiguous and associating therewith data identifying the specified scanning direction.

6. The position-estimation method of claim 4, and comprising the step of, in the case where the candidate group is designated ambiguous:

enlarging the candidate group by addition of one or more markings constituting a near neighbor to the candidate group;

assessing whether, in the determined subset of the generated image, there is any other group of markings having the same spacing and orientation as the markings constituting the enlarged candidate group;

designating the enlarged candidate group ambiguous if any such other group is found in the portion of the board; and

for an ambiguous enlarged group, repeating the enlarging and assessing steps.

7. The position-estimation method of claim 6, wherein the enlarging step is not performed or repeated if the number of markings in the candidate group after enlargement would exceed a threshold number.

8. The position-estimation method of claim 2, wherein the group-selecting step comprises repeatedly applying the step of designating one or more markings as a candidate group until all non-rejected markings in the field of view of the imaging devise have been considered as candidate groups.

9. The position-estimation method of claim 2 wherein the step of detecting the image of a reference group comprises the steps of:

determining, based on a maximal positional error of the imaging device, the boundaries of an error window where the image of the reference group can appear;

detecting the markings in the error window; and

finding the set of one or more markings in the error window best matching the one or more markings in the referenced group.

10. The position-estimation method of claim 9, wherein the step of detecting the markings in the error window comprises detecting the boundaries of markings in the error window;

and the step of finding the best matching set of markings in the error window comprises finding the set of boundaries best matching the boundary(ies) of the marking(s) in the referenced group.

12. The position-estimation method of claim 9, wherein the step of finding the best matching set of markings comprises evaluating at least one of the orientation and spacing of the markings.

11. A method for estimating a position of a view of an imaging device relative to a board having markings thereon based on changes in position of a selected set of reference groups of the markings, comprising the steps of:

selecting for consideration as candidate groups of markings only straight-line segments on the board;

rejecting segments that are shorter than twice the maximal positioning error of the imaging device in the direction along which the respective segment extends; and

acquiring and analyzing image data of a corresponding subset of the board to determine the changes in position of the selected set of reference groups of the markings;

wherein the step of generating an image of a subset of the board comprises acquiring a profile along a line crossing the center of the error window, said line being oriented substantially perpendicular to the normal orientation of the segments in the respective reference group and having a length at least twice the maximal positioning error of the imaging device in the direction along which the profile is taken.

13. An apparatus comprising:

a processor adapted to acquire image data of a subset of a board corresponding to a selected reference group of markings, determine the change in position of the selected reference group of markings by analyzing the image data, and estimate the position of the field of view of an imaging device producing the image data relative to the board based on said changes in position of the selected reference group of markings;

select groups of one or more markings on the board to serve as respective reference groups, the field of view of the imaging device being at a first position relative to the board when the selected reference groups are at a nominal position in the field of view;

in each respective subset image, detect the image of the corresponding reference group, and determine the offset between the nominal position of the reference group in the field of view of the imaging device and the detected position thereof; and

determine the position of the field of view of the imaging device based on the determined offsets and based on the known relationship between the first position of the imaging device and the nominal position of the reference group(s); and

an imaging device adapted to generate an image of a subset of the board corresponding to the nominal position of each respective reference group, at least one dimension of the subset image being substantially equal to or greater than the maximum positioning error of the image device.

15. An apparatus according to claim 13 associated with a digital imager producing digital image data corresponding to at least the subset of the board such that said apparatus has access to said data.

14. A computer program product for estimating the position of the field of view of an imaging device relative to a board having markings visible thereon comprising computer readable media having encoded thereon:

computer readable program code for selecting groups of one or more markings on the board to serve as respective reference groups, the field of view of the imaging device being at a first position relative to the board when the selected reference groups are at a nominal position in the field of view;

computer readable program code for selecting groups of one or more markings on the board to serve as respective reference groups, the field of view of the imaging device being at a first position relative to the board when the selected reference groups are at a nominal position in the field of view;

computer readable program code for acquiring image data of a subset of a board corresponding to the nominal position of each respective reference group, at least one dimension of the subset image being substantially equal to or greater than the maximum positioning error of the image device;

computer readable program code for detecting the image of the corresponding reference group in each respective subset image, and determining the offset between the nominal position of the reference group in the field of view of the imaging device and the detected position thereof;

computer readable program code for determining offsets and based on the known relationship between the first position of the imaging device and the nominal position of the reference group(s).