Method and apparatus for measuring three-dimensional position and orientation of an object using light projection

• US 5,461,478 A
• Filed: 08/24/1993
• Issued: 10/24/1995
• Est. Priority Date: 12/26/1991
• Status: Expired due to Term

• Current Assignee: Fanuc Ltd (Fanuc Corporation)
• Original Assignee: Fanuc Ltd (Fanuc Corporation)
• Inventors: Hiraizumi, Mitsuo, Sakakibara, Shinsuke
• Primary Examiner(s): Rosenberger, Richard A.
• Assistant Examiner(s): KIM, ROBERT H
• Application Number:
  US08/108,589
• Time in Patent Office: 791 Days
• Field of Search: 356/375, 356/376, 356/377
• US Class Current: 356/623
• CPC Class Codes: G01B 11/245 using a plurality of fixed, simultaneously operating transducers G01B11/2408 - G01B11/2425, G01B11/255 take precedence
• CPC Class Codes: G01B 11/2513 with several lines being projected in more than one direction, e.g. grids, patterns

Abstract

A method and an apparatus capable of accurately measuring the three-dimensional position and orientation of an object in a short data processing time are provided, wherein a first slit light is projected from a first light projector for scanning an object, and each light image is obtained by a CCD camera. Similarly, a second slit light is projected from a second light projector for scanning the object and each light image is obtained by the CCD camera. The first and second slit lights are perpendicular to each other. The individual images obtained are processed to find a bent point and a disconnection point in each slit-light scan image. From among these points, a group of points which are reckoned to be lying on the same straight line is extracted, and the obtained straight line of points is used as edge information of the object. Based on the edge information and shape data of the object, three-dimensional position/orientation data is obtained. Any edge of the object can surely be detected with at least one of the slit lights, regardless of its direction, and thus, even if the scanning intervals of the slit lights are rough, edges of the object can surely be detected in a shorter measuring time is shortened.

Claims

1. A method for measuring three-dimensional position and orientation of an object, comprising the steps of:

(a) projecting a first slit light oriented in a first direction onto an object and scanning the object in a direction different from the first direction;

(b) projecting a second slit light oriented in a second direction different from the first direction onto the object and scanning the object in a direction different from the second direction;

(c) obtaining edge information of the object by processing images of the projected first and second slit lights; and

(d) determining the three-dimensional position and orientation of the object based upon the edge information and previously obtained shape information of the object.

2. The method according to claim 1, wherein said step (c) includes:

(c1) analyzing the slit light image obtained during each scanning of the object into a straight-line sequence of points which may include a disconnection or bend;

(c2) obtaining an endpoint and a bent point corresponding respectively to the disconnection and the bend of the straight-line sequence of points, based upon the point sequence information;

(c3) specifying, among the endpoints and bent points obtained with the slit lights oriented in the first direction, a group of endpoints and bent points that lie on an identical straight line, and specifying, among the endpoints and bent points obtained with the slit lights oriented in the second direction, a group of endpoints and bent points that lie on an identical straight line; and

(c4) using a straight line comprised of the specified group of points as edge information of the object.

3. A method for measuring three-dimensional position and orientation of an object, comprising the steps of:

(a) projecting a first slit light oriented in a first direction onto an object and scanning the object in a direction different from the first direction;

(b) projecting a second slit light oriented in a second direction different from the first direction onto the object and scanning the object in a direction different from the second direction;

(c) obtaining edge information and plane information of the object by processing images of the first and second projected slit lights; and

(d) determining the three-dimensional position and orientation of the object based upon the edge information, the plane information, and previously obtained shape information of the object.

4. The method according to claim 3, wherein, in obtaining the plane information of the object in said step (c), a part of the object is considered to form a plane when the projected slit light is straight and also parallel to the adjacent projected slit light.

5. An apparatus for measuring three-dimensional position and orientation of an object, comprising:

light projector means including projecting means for projecting a first slit light and a second slit light having a different direction from the first slit light, onto an object, and scanning means for successively shifting the first and second slit lights in different directions by a predetermined amount;

imaging means responsive to shifting of the slit lights in the respective directions caused by the scanning means, for obtaining a first multiple slit light image and a second multiple slit light image, respectively;

image processing means for extracting edge information of the object from the first and second multiple slit light images; and

position/orientation calculating means for calculating the three-dimensional position and orientation of the object based upon the edge information and previously obtained shape information of the object.

6. The apparatus according to claim 5, wherein the light projecting means comprises first and second light projectors arranged in different positions with respect to the imaging means, the first light projector including projecting means for projecting the first slit light and scanning means for successively shifting the first slit light by a predetermined amount in a direction almost perpendicular to that of the first slit light, and the second light projector including projecting means for projecting the second slit light and scanning means for successively shifting the second slit light by a predetermined amount in a direction almost perpendicular to that of said first slit light.

7. The apparatus according to claim 6, wherein the scanning means for successively shifting the first and second slit lights by a predetermined amount comprises a rotary mirror.

8. The apparatus according to claim 6, wherein the imaging means comprises a solid-state imaging camera, the first light projector being positioned in a horizontal relation to the solid-state imaging camera and including projecting means for projecting the first slit light in a vertical direction with respect to a visual field of the solid-state imaging camera, and the second light projector being positioned in a vertical relation to the solid-state imaging camera and including projecting means for projecting the second slit light in a horizontal direction with respect to the visual field of the solid-state imaging camera.

9. The apparatus according to claim 8, wherein the scanning means for successively shifting the first and second slit lights by a predetermined amount comprises a rotary mirror.

10. The apparatus according to claim 7, wherein the projecting means of each of the first and second light projectors comprises a laser diode connected to a laser power supply, and a cylindrical lens.

11. The apparatus according to claim 10, wherein the scanning means for successively shifting the first and second slit lights by a predetermined amount comprises a rotary mirror.

12. The apparatus according to claim 5, wherein the light projecting means comprises a single light projector arranged in one spatial position and including projecting means for projecting the first and second slit lights and scanning means for successively shifting the first and second slit lights in different directions by a predetermined amount.

13. The apparatus according to claim 12, wherein the scanning means for successively shifting the first and second slit lights by a predetermined amount comprises a rotary mirror.

14. The apparatus according to claim 12, wherein the projecting means of the light projector for projecting the first and second slit lights comprises first and second slit light generating means connected to a laser power supply, and optical-axis adjusting means for aligning optical axes of the slit lights radiated from the first and second slit light generating means with each other, which is arranged between the scanning means for successively shifting the first and second slit lights in different directions by a predetermined amount and the first and second slit light generator means.

15. The apparatus according to claim 14, wherein the scanning means for successively shifting the first and second slit lights by a predetermined amount comprises a rotary mirror.

16. The apparatus according to claim 14, wherein the optical-axis adjusting means comprises a shield plate and a half-prism or a half-mirror.

17. The apparatus according to claim 16, wherein the scanning means for successively shifting the first and second slit lights by a predetermined amount comprises a rotary mirror.

18. The apparatus according to claim 12, wherein the light projector comprises slit light generating means for radiating a slit light of any desired direction, and slit-light projecting direction changing means for rotating the slit light generating means about an optical axis, the slit-light projecting direction changing means being operated to cause first or second slit light to be radiated from the slit light generating means.

19. The apparatus according to claim 18, wherein the scanning means for successively shifting the first and second slit lights by a predetermined amount comprises a rotary mirror.

20. The apparatus according claim 5, wherein the scanning means for successively shifting the first and second slit lights by a predetermined amount comprises a rotary mirror.

21. The apparatus according to claim 5, wherein the image processing means extracts edge and plane information of the object from the first and second multiple slit light images, and the position/orientation calculating means calculates the three-dimensional position and orientation of the object based upon the edge information, the previously obtained shape information and the plane information.