Method and apparatus for reconstruction of three-dimensional surfaces from interference fringes

• US 4,525,858 A
• Filed: 01/03/1983
• Issued: 06/25/1985
• Est. Priority Date: 01/03/1983
• Status: Expired due to Fees

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Cline, Harvey E., Lorensen, William E., Holik, Andrew S.
• Primary Examiner(s): Boudreau, Leo H.
• Assistant Examiner(s): Mancuso, Joseph
• Application Number:
  US06/455,076
• Time in Patent Office: 904 Days
• Field of Search: 356/354, 356/355, 356/356, 356/374, 356/377, 356/379, 356/380, 356/386, 356/387, 356/376, 356/2, 382/22, 382/26, 382/9, 382/23, 382/1, 382/41, 364/522, 364/731, 364/518, 364/521, 364/715, 340/747, 340/755, 340/700, 340/729, 340/721, 250/558
• US Class Current: 382/154
• CPC Class Codes: G01B 11/25 by projecting a pattern, e.g. one or more lines, moiré fringes on the object G01B11/255 takes precedence ; image analysis for depth or shape recovery G06T7/50

Abstract

A fully automatic method for rapidly and unambiguously interpreting fringe patterns, including those having branched fringes, is provided. The information from the fringe patterns processed by the method of the invention can be used in testing, surface characterization and inspection applications. Further processing of the information from the two-dimensional fringe patterns yields information from which the three-dimensional surface can be quantitatively reconstructed for further use such as for display, as in microscopy, or as input for computer-aided design and computer-aided manufacture. Apparatus for conducting the method of the invention is also provided.

Claims

1. The fully automatic method of processing a pair of optically generated two-dimensional continuous, branched fringe patterns representative of a three-dimensional surface comprising the steps of:

A. transforming a pair of optically generated two-dimensional fringe patterns into first and second electronic images, said pair of fringe patterns representing the same three-dimensional surface, but containing sufficient information to permit the topography of said three-dimensional surface to be determined therefrom;

B. digitizing the first and second electronic images to form first and second arrays of integers;

C. thresholding the digitized images to transform the integers of the first and second arrays to either the digit one or the digit zero;

D. segmenting electronically the thresholded images to define first and second sets of fringes;

E. detecting electronically the edges of the fringes of the first and second sets of fringes to define first and second sets of contours; and

F. sequencing electronically the first set of contours by comparing the second set of contours to the first set of fringes to determine the spatial coordinates of the three-dimensional surface.

2. The method of claim 1 further including the steps of:

(i) following the sequencing step, selecting the contours defining a fringe, each contour being defined by a set of nodes;

(ii) calculating the distances between unconnected node pairs and listing in order of increasing distance; and

(iii) connecting said node pairs beginning with the node pair having the shortest distance and progressing through said list connecting node pairs of increasing length excluding those node pairs that would intersect previously connected node pairs or contours until all possible eligible unconnected node pairs are connected to form a triangulated polygonal representation of the three-dimensional surface.

3. The method of claim 1 wherein said optically generated fringe pattern is a moire fringe pattern.

4. The method of claim 1 wherein said optically generated fringe pattern is an interferometric fringe pattern.

5. The method of claim 1 wherein said segmenting step is accomplished by individually scanning the digitized and thresholded images and for each image collecting sets of connected elements of each array having the same binary value to define a plurality of fringes and labelling each fringe.

6. The method of claim 1 wherein said detecting step is accomplished by individually scanning the segmented images of the first and second sets of fringes to locate the first node occurring between adjacent elements having different fringe labels and tracking the boundary between adjacent nodes occurring between the same fringes to form a first labelled contour and repeating said locating and tracking steps until all nodes of the first and second sets of fringes are collected into labelled contours.

7. The method of claim 1 further including the step of comparing the spatial coordinates found by said sequencing step with the known design geometry and design tolerance to quantitatively determine whether the three-dimensional surface is within design specification.

8. The method of claim 2 further including the steps of displaying, smoothing and shading the triangulated polygonal representation of the three-dimensional surface.

9. Apparatus for fully automatically processing a pair of optically generated two-dimensional continuous, branched fringe patterns representative of a three-dimensional surface comprising:

A. means for transforming a pair of optically generated two-dimensional fringe patterns into first and second electronic images, said pair of fringe patterns representing the same three-dimensional surface, but containing sufficient information to permit the topography of said three-dimensional surface to be determined therefrom;

B. means for digitizing the first and second electronic images to form first and second arrays of integers;

C. means for thresholding the digitized images to transform the integers of the first and second arrays to either the digit one or the digit zero;

D. means for segmenting electronically the thresholded images to define first and second sets of fringes;

E. means for detecting electronically the edges of the fringes of the first and second sets of fringes to define first and second sets of contours;

F. means for sequencing electronically the first set of contours by comparing the second set of contours to the first set of fringes to determine the spatial coordinates of the three-dimensional surface; and

G. bus means for interconnecting said means for transforming, digitizing, thresholding, segmenting, detecting and sequencing.

10. The apparatus of claim 9 further including triangulating means, connected to said bus means, including:

(i) means for obtaining from the sequencing means the contours defining a fringe, each contour being defined by a set of nodes;

(ii) means for calculating the distances between unconnected node pairs and listing in order of increasing distance; and

(iii) means for connecting said node pairs beginning with the node pair having the shortest distance and progressing through said list connecting node pairs of increasing length excluding those node pairs that would intersect previously connected node pairs or contours until all possible eligible unconnected node pairs are connected to form a triangulated polygonal representation of the three-dimensional surface.

11. The apparatus of claim 9 further including means, connected to said bus means, for displaying, smoothing and shading the triangulated polygonal representation of the three-dimensional surface.

12. The apparatus of claim 9 wherein said optically generated fringe pattern is a moire fringe pattern.

13. The apparatus of claim 9 wherein said optically generated fringe pattern is an interferometric fringe pattern.

14. The apparatus of claim 9 wherein said means for segmenting comprise means for individually scanning the digitized and thresholded images and means for individually collecting for each image sets of connected elements of each array having the same binary value to define a plurality of fringes and labelling each fringe.

15. The apparatus of claim 9 wherein said detecting means comprise means for individually scanning the segmented images of the first and second sets of fringes to locate the first node occurring between adjacent elements having different fringe labels, means for tracking the boundary between adjacent nodes occurring between the same fringes to form a first labelled contour and means for repeating said scanning and tracking means until all nodes of the first and second sets of fringes are collected into labelled contours.

16. The apparatus of claim 9 further including means, connected to said bus means, for comparing the spatial coordinates found by said sequencing means with the known design geometry and design tolerance to quantitatively determine whether the three-dimensional surface is within design specification.

17. A computer-aided interference device for fully automatically producing a displayed, shaded, smoothed and manipulatable quantitative representation of a three-dimensional surface from a pair of optically generated two-dimensional fringe patterns comprising:

(A) means for transforming a pair of optically generated two-dimensional fringe patterns into first and second electronic images, said pair of fringe patterns representing the same three-dimensional surface, but containing sufficient information to permit the topography of said three-dimensional surface to be determined therefrom;

(B) means for digitizing the first and second electronic images to form first and second arrays of integers;

(C) means for thresholding the digitized images to transform the integers of the first and second arrays to either the digit one or the digit zero;

(D) means for segmenting electronically the thresholded images to define first and second sets of fringes;

(E) means for detecting electronically the edges of the fringes of the first and second sets of fringes to define first and second sets of contours;

(F) means for sequencing electronically the first set of contours by comparing the second set of contours to the first set of fringes to determine the spatial coordinates of the three-dimensional surface;

(G) triangulating means including;

(a) means for obtaining from the sequencing means the contours defining a fringe, each contour being defined by a set of nodes;

(b) means for calculating the distances between unconnected node pairs and listing in order of increasing distance; and

(c) means for connecting said node pairs beginning with the node pair having the shortest distance and progressing through said list connecting node pairs of increasing length excluding those node pairs that would intersect previously connected node pairs or contours until all possible eligible unconnected node pairs are connected to form a triangulated polygonal representation of the three-dimensional surface;

(H) visualizing means including means for displaying, smoothing, shading, and manipulating the triangulated polygonal representation of the three-dimensional surface; and

(I) bus means for interconnecting said means for transforming, digitizing, thresholding, segmenting, detecting, sequencing, triangulating, and visualizing.

18. The apparatus of claim 17 wherein said means for transforming and said means for digitizing comprise, in combination, a digitizing television camera.

19. The apparatus of claim 17 wherein said optically generated fringe pattern is a moire fringe pattern.

20. The apparatus of claim 17 wherein said optically generated fringe pattern is an interferometric fringe pattern.

21. The apparatus of claim 17 wherein said means for segmenting comprise means for individually scanning the digitized and thresholded images and means for individually collecting for each image sets of connected elements of each array having the same binary value to define a plurality of fringes and labelling each fringe.

22. The apparatus of claim 21 wherein said means for individually segmenting the digitized and thresholded images comprise means for selecting a seed element of the binary image and:

(i) means for setting current label to first label;

(ii) means for collecting all connected elements of the array having the same binary value as said seed element and labelling said collected elements with current label forming thereby a fringe of the current label;

(iii) means for changing current label to next label;

(iv) means for selecting the next unlabelled element and setting the seed element equal to this next unlabelled element; and

(v) means for repeating means (ii), (iii), and (iv) sequentially until there are no unlabelled elements forming thereby a plurality of labelled fringes.

23. The apparatus of claim 17 further including means, connected to said bus means, for comparing the spatial coordinates found by said sequencing means with the known design geometry and design tolerance to quantitatively determine whether the three-dimensional surface is within design specification.