Photogrammetric image correlation and measurement system and method

• US 20020136444A1
• Filed: 07/31/2001
• Published: 09/26/2002
• Est. Priority Date: 07/31/2000
• Status: Active Grant

• Current Assignee: Geodetic Services Incorporated
• Original Assignee: Geodetic Services Incorporated
• Inventors: Blaha, George, Brown, John D.
• Granted Patent: US 6,826,299 B2
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G01B 11/2545 with one projection direction and several detection directions, e.g. stereo
• CPC Class Codes: G01C 11/06 by comparison of two or more pictures of the same area
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Abstract

A first and a second, distinguishable set of images are projected onto a surface, each image having a corresponding source element with known two-dimensional coordinates relative to the projector. A pose is determined of spaced two cameras in position to image at least a portion of the surface. The three-dimensional coordinates of at least some of the first set of images are determined with the cameras, from which are calculated an initial pose of the projector. Each of the at least some of the first set of images are matched with a corresponding source element, from which matching an improved projector pose is determined. The three-dimensional coordinates of at least some of the second set of images are determined using the improved projector pose and the cameras, and the surface is characterized from the three-dimensional coordinates of the first and the second set of images.

Claims

1. A method for characterizing a surface of an object comprising the steps of:

projecting from a projector a plurality of images onto a surface desired to be characterized, the images comprising a first set of images and a second set of images distinguishable from the first set, each of the first and the second set of images having a corresponding source element having known two-dimensional coordinates relative to the projector;

determining a pose of a first and a second camera positioned in spaced relation from each other and in position to image at least a portion of the desired surface;

determining three-dimensional coordinates of at least some of the first set of images on the surface using the first and the second cameras;

calculating from the determined three-dimensional coordinates an initial pose of the projector;

matching each of the at least some of the first set of images with a corresponding source element;

determining from the matching step an improved pose of the projector.

determining three-dimensional coordinates of at least some of the second set of images using the improved projector pose and the first and the second camera; and

characterizing the surface from the three-dimensional coordinates of the first and the second set of images.

2. The method recited in claim 1, wherein the projecting step comprises:

providing a slide having a predetermined pattern of translucent source elements and a substantially opaque background surrounding the translucent elements;

inserting the slide into the projector; and

shining light through the slide, the translucent elements forming the first and the second set of images on the surface.

3. The method recited in claim 1, wherein the first set of images comprises a significantly smaller number than the second set of images.

4. The method recited in claim 3, wherein each of the first set of images is larger than each of the second set of images.

5. The method recited in claim 4, wherein the second set of images comprises a set of dots and the first set of images comprises a set of dots surrounded by a circle.

6. The method recited in claim 1, wherein the first and the second camera pose determining step comprises the steps of:

for each camera, measuring two-dimensional coordinates of a plurality of reference points having known three-dimensional coordinates; and

determining the pose of the camera from the measured two-dimensional coordinates.

7. The method recited in claim 1, wherein the three-dimensional coordinate determination of the at least some of the first set of images comprises the steps of:

for each camera, sensing two-dimensional coordinates of at least some of the first set of images; and

analyzing the sensed coordinates to determine three-dimensional coordinates of the at least some of the first set of images.

8. The method recited in claim 7, wherein the analyzing step comprises performing a triangulation.

9. The method recited in claim 1, wherein the initial projector pose determining step comprises taking a plurality of combinations of sets of three of the first set of images, each combination tested against the known two-dimensional coordinates relative to the projector of at least some of the first set of images, a preferred combination comprising a best fit therebetween.

10. The method recited in claim 9, wherein the plurality of combinations comprises all possible combinations of all sets of three of the first set of images.

11. The method recited in claim 1, wherein the three-dimensional coordinates of at least some of the second set of images determining step comprises the steps of:

measuring the two-dimensional coordinates of the at least some of the second set of images with the first and the second camera to create a first and a second camera data set of the second set of images; and

analyzing the first and the second camera data set of the second set of images and the projector pose to determine the three-dimensional coordinates of the at least some of the second set of images.

12. The method recited in claim 11, wherein the analyzing step comprises performing a triangulation.

13. The method recited in claim 1, wherein the surface characterizing step comprises at least one of calculating a mathematical representation of the surface and calculating a deviation from a mathematical representation of the surface, based upon the determined three-dimensional coordinates of the first and the second set of images.

15. The system recited in claim 14, wherein the projecting means comprises:

a slide having a predetermined pattern of translucent source elements and a substantially opaque background surrounding the translucent elements; and

means for positioning the slide in the projector in an illumination pathway of the projector.

16. The system recited in claim 14, wherein the first set of images comprises a significantly smaller number than the second set of images.

17. The system recited in claim 16, wherein each of the first set of images comprises a larger image than each of the second set of images.

18. The system recited in claim 17, wherein the second set of images comprises a set of dots and the first set of images comprises a set of dots surrounded by a circle.

19. The system recited in claim 14, wherein the first and the second camera pose determining means comprises:

a plurality of reference points having known three-dimensional coordinates positioned adjacent the surface in a location capable of being sensed by the first and the second camera;

means for measuring two-dimensional coordinates of at least some of the sensed reference points using each camera; and

means for determining the pose of the first and the second camera from the measured three-dimensional coordinates of the reference points.

20. The system recited in claim 14, wherein the three-dimensional coordinate determining means of at least some of the first set of images comprises:

using each camera to sense two-dimensional coordinates of at least some of the first set of images; and

means for analyzing the sensed coordinates to determine three-dimensional coordinates of the at least some of the first set of images.

21. The system recited in claim 20, wherein the analyzing means comprises means for performing a triangulation.

22. The system recited in claim 14, wherein the initial projector pose determining means comprises the first and the second camera, comprising means for taking a plurality of combinations of sets of three of the first set of images, each combination testable against the known two-dimensional coordinates relative to the projector of at least some of the first set of images, a preferred combination comprising a best fit therebetween.

23. The system recited in claim 22, wherein the plurality of combinations comprises all possible combinations of all sets of three of the first set of images.

24. The system recited in claim 14, wherein the three-dimensional coordinates of at least some of the second set of images determining means comprises:

the first and the second camera, comprising means for sensing the at least some of the second set of images;

means for creating a first and a second camera data set of the second set of images; and

means for analyzing the first and the second data set of the second set of images to determine the three-dimensional coordinates of the at least some of the second set of images.

25. The system recited in claim 24, wherein the analyzing means comprises means for performing a triangulation.

26. The system recited in claim 14, wherein the surface characterizing means comprises means for calculating at least one of a mathematical representation of the surface and for calculating a deviation from a mathematical representation of the surface, based upon the determined three-dimensional coordinates of the first and the second set of images.

27. The system recited in claim 14, wherein the determining and the characterizing means comprise:

a processor in electronic communication with the projector and with the first and the second camera; and

analytical software resident in the processor for performing geometric calculations based upon data provided by the first and the second camera.

28. The system recited in claim 27, wherein the analytical software comprises means for performing a bundle adjustment and a triangulation.

14. A system for characterizing a surface of an object comprising:

a projector positionable in a pose;

means for projecting from the projector a plurality of images onto a surface desired to be characterized, the images comprising a first set of images and a second set of images distinguishable from the first set, each of the first and the second set of images having a corresponding source element having known two-dimensional coordinates relative to the projector;

a first and a second camera positioned in spaced relation from each other and in position to image at least a portion of the object surface;

means for determining a pose of the first and the second camera using at least some of the first set of images;

means for determining three-dimensional coordinates of at least some of the first set of images on the surface using the first and the second cameras;

means for calculating from the three-dimensional coordinates an initial pose of the projector;

means for matching each of the at least some of the first set of images with a corresponding source element;

means for determining from the matching an improved pose of the projector;

means for determining three-dimensional coordinates of at least some of the second set of images using the improved projector pose and the first and the second camera; and

means for characterizing the surface from the three-dimensional coordinates of the first and the second set of images.