Choice of reference markings for enabling fast estimating of the position of an imaging device

• US 20040151363A1
• Filed: 12/22/2003
• Published: 08/05/2004
• Est. Priority Date: 07/04/2001
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Villain, Nicolas
• Granted Patent: US 7,477,774 B2
• Time in Patent Office: Days
• US Class Current: 382/151
• CPC Class Codes: H05K 13/0818 Setup of monitoring devices prior to starting mounting operations; Teaching of monitoring devices for specific products; Compensation of drifts during operation, e.g. due to temperature shifts

Abstract

A method of estimating the position of the field of view of an imaging device, such as a camera, relative to a board involves designating markings on the board as references and detecting the shift in these reference markings within the field of view of the camera compared to a known position therein. The reference markings are selected such that detection thereof involves analysis of only a subset of the image produced by the imaging device. The selection of a group of one or more markings to serve as a reference involves determination of the image region (error window) in which the reference marking(s) may appear, given the maximal positional error of the imaging device. It is also checked (step T4) that the entire error window will be within the useable field of view of the imaging device and that, within the error window, no other group of markings will appear that could be confused with the selected group of markings (step T5). Detection of the reference group of markings involves generation of an image profile along a line crossing the center of the error window and finding the best match between the markings along this profile and the markings in the reference group.

Claims

1. A method of estimating the position of the field of view of an imaging device relative to a board having markings visible thereon, the method comprising the step of estimating the position of the field of view of the imaging device based on changes in position of a selected set of reference groups of markings;

characterized in, for each selected reference group of markings, the change in position is determined by acquisition and analysis of image data of a corresponding subset of the board.

2. The position-estimation method of claim 1, and comprising the steps of:

selecting groups of one or more markings on the board to serve as respective reference groups, the field of view of the imaging device being at a first position relative to the board when the selected reference groups are at a nominal position in the field of view;

using the imaging device to generate an image of a subset of the board corresponding to the nominal position of each respective reference group, at least one dimension of the subset image being substantially equal to or greater than the maximal positioning error of the imaging device;

in each respective subset image, detecting the image of the corresponding reference group, and determining the offset between the nominal position of the reference group in the field of view of the imaging device and the detected position thereof; and

determining the position of the field of view of the imaging device based on the determined offsets and based on the known relationship between the first position of the imaging device and the nominal position of the reference group(s).

3. The position-estimation method of claim 2, wherein the group-selecting step comprises:

designating as a candidate group a group of one or more markings on the board;

determining, based on the maximal positional error of the imaging device, the boundaries of an image region where the image of the candidate group can appear; and

rejecting the candidate group if the determined image region is not completely included in the useable field of view of the imaging device.

4. The position-estimation method of claim 3, wherein the group-selecting step comprises:

analyzing a portion of the board, the portion corresponding to said image region, to determine whether said candidate group can be identified unambiguously; and

selecting said candidate group to serve as a reference group only if the analysis step determines that the candidate group can be identified unambiguously in said portion of the board.

5. The position-estimation method of claim 4, wherein the analyzing step comprises the step of assessing whether, in the determined portion of the board, there is any other group of one or more markings having the same spacing, or the same spacing and orientation, as the marking(s) constituting the candidate group, and designating the candidate group ambiguous if any such other group is found in the portion of the board.

6. The position-estimation method of claim 4, wherein the analyzing step comprises the step of scanning said image region in a specified direction whereby to assess whether the candidate group is the first or last group scanned and, if the candidate group is the first or last group scanned, designating the candidate group unambiguous and associating therewith data identifying the specified scanning direction.

7. The position-estimation method of claim 5 or 6, and comprising the step of, in the case where the candidate group is designated ambiguous:

enlarging the candidate group by addition of one or more markings constituting a near neighbor to the candidate group;

assessing whether, in the determined subset of the generated image, there is any other group of markings having the same spacing and orientation as the markings constituting the enlarged candidate group;

designating the enlarged candidate group ambiguous if any such other group is found in the portion of the board; and

for an ambiguous enlarged group, repeating the enlarging and assessing steps.

8. The position-estimation method of claim 7, wherein the enlarging step is not performed or repeated if the number of markings in the candidate group after enlargement would exceed a threshold number.

9. The position-estimation method of any one of claims 3 to 8, wherein the group-selecting step comprises repeatedly applying the step of designating one or more markings as a candidate group until all non-rejected markings in the field of view of the imaging device have been considered as candidate groups.

10. The position-estimation method of any previous claim, wherein the step of detecting the image of a reference group comprises the steps of:

determining, based on the maximal positional error of the imaging device, the boundaries of an error window where the image of the reference group can appear;

detecting the markings in the error window; and

finding the set of one or more markings in the error window best matching the one or more markings in the reference group.

11. The position-estimation method of claim 10, wherein the step of detecting the markings in the error window comprises detecting the boundaries of markings in the error window;

and the step of finding the best matching set of markings in the error window comprises finding the set of boundaries best matching the boundary(ies) of the marking(s) in the reference group.

12. The position-estimation method of any previous claim, and comprising the steps of:

selecting for consideration as candidate groups only straight-line segments on the board; and

rejecting segments that are shorter than twice the maximal positioning error of the imaging device in the direction along which the respective segment extends;

wherein the step of generating an image of a subset of the board comprises acquiring a profile along a line crossing the center of the error window, said line being oriented substantially perpendicular to the nominal orientation of the segments in the respective reference group and having a length at least twice the maximal positioning error of the imaging device in the direction along which the profile is taken.

13. The position-estimation method of claim 10, 11 or 12, wherein the step of finding the best matching set of markings comprises evaluating at least one of the orientation and spacing of the markings.

14. Apparatus having means adapted to implement at least the image data analysis and position estimation steps of the method according to any previous claim.

15. A system comprising a suitably programmed computer or a special purpose processor having circuit means which are arranged to perform at least the image data analysis and position estimation steps of the method according to any one of claims 1 to 13.

16. An apparatus or system according to claim 14 or 15, associated with means to acquire digital image data such that said apparatus/system has access to said data.

17. A computer program product comprising a set of instructions for carrying out at least the image data analysis and position estimation steps of the method according to any one of claims 1 to 13.

18. An apparatus, system or computer program product according to claim 14, 15, 16 or 17, and adapted to select the set of reference groups to be used in the position estimation method.