TRIANGULATION SCANNER AND CAMERA FOR AUGMENTED REALITY

• US 20170251192A1
• Filed: 05/15/2017
• Published: 08/31/2017
• Est. Priority Date: 12/16/2014
• Status: Active Grant

• Current Assignee: Faro Technologies Incorporated
• Original Assignee: Faro Technologies Incorporated
• Inventors: Bridges, Robert E.
• Granted Patent: US 9,843,784 B2
• Time in Patent Office: Days
• CPC Class Codes: G01B 11/005 coordinate measuring machines
• CPC Class Codes: G01C 15/00 Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
• CPC Class Codes: G01C 3/08 Use of electric radiation detectors
• CPC Class Codes: G01S 3/786 the desired condition being maintained automatically
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals

Abstract

A method of combining 2D images into a 3D image includes providing a coordinate measurement device and a triangulation scanner having an integral camera associated therewith, the scanner being separate from the coordinate measurement device. In a first instance, the coordinate measurement device determines the position and orientation of the scanner and the integral camera captures a first 2D image. In a second instance, the scanner is moved, the coordinate measurement device determines the position and orientation of the scanner, and the integral camera captures a second 2D image. A cardinal point common to the first and second images is found and is used, together with the first and second images and the positions and orientations of the scanner in the first and second instances, to create the 3D image.

Claims

1. A method of combining a plurality of two-dimensional (2D) images into a three-dimensional (3D) image of an object, the method comprising steps of:

providing a six-degree of freedom triangulation scanner having a retroreflector and an integral augmented reality (AR) camera;

providing a coordinate measurement device having a distance meter, the device operable to direct a beam of light in a direction and measure a distance from the device to the retroreflector, and determine a 3D coordinates of the retroreflector;

determining with the device a first 3D coordinates of the retroreflector at a first position;

forming a first 2D image with the AR camera at the first position;

determining with the device a second 3D coordinates of the retroreflector at a second position;

forming a second 2D image with the AR camera at the second position;

determining a first cardinal point in common between the first 2D image and the second 2D image, the first cardinal point having a first location on the first 2D image and a second location on the second 2D image;

determining 3D coordinates of the first cardinal point based at least in part on the first 3D coordinates and the second 3D coordinates;

generating a first composite 3D image from the first 2D image and the second 2D image based at least in part on the 3D coordinates of the first cardinal point; and

storing in a memory the first composite 3D image.

2. The method of claim 1, wherein the triangulation scanner is a laser line probe or a structured area scanner.

3. The method of claim 1, further including a step of measuring a first plurality of points on a surface of the object.

4. The method of claim 3, further including a step of forming a first graphical representation that includes the first composite 3D image and the first plurality of points on the surface of the object.

5. The method of claim 4, further including a step of forming a second graphical representation that includes the first composite 3D image and the first plurality of points on the surface of the object.

6. The method of claim 1, wherein:

the first 2D image is a color image;

the second 2D image is a color image; and

the first composite 3D image is a color image.

7. The method of claim 3, wherein the first 2D image includes a first area of the surface of the object.

8. The method of claim 7, further comprising:

a step of providing a drawing; and

a step of superimposing the first composite 3D image onto the drawing.

9. The method of claim 1, further comprising:

providing a first graphical element; and

superimposing the first graphical element on the first composite 3D image.

10. The method of claim 9, wherein the first graphical element is a mechanical extension of the object.

11. The method of claim 9, wherein the first graphical element is placed within a volume represented by the first composite 3D image.

12. The method of claim 9, wherein the first graphical element is downloaded from a network connection.

13. The method of claim 7, further comprising:

forming a third 2D image with the camera, the third 2D image including a second area of the surface of the object, the second area including a region of the object not visible in the first composite 3D image; and

forming a second composite 3D image, the second composite 3D image including the third 2D image and at least a portion of the first 2D image or a portion of the second 2D image.

14. A system for combining a plurality of two-dimensional (2D) images into a three-dimensional (3D) image of an object, the system comprising:

a six-degree of freedom triangulation scanner having a retroreflector and an integral augmented reality (AR) camera;

a coordinate measurement device having a distance meter, the device operable to direct a beam of light to a direction and measure a distance from the device to the retroreflector and determine a 3D coordinates of the triangulation scanner;

one or more processors responsive to executable computer instructions, the one or more processors electrically coupled to the triangulation scanner and the device, the executable computer instructions comprising;

determining with the device a first 3D coordinates of the retroreflector at a first position;

forming a first 2D image with the AR camera at the first position;

determining with the device a second 3D coordinates of the triangulation scanner at the second position;

forming a second 2D image with the AR camera at the second position;

determining a first cardinal point in common between the first 2D image and the second 2D image, the first cardinal point having a first location on the first 2D image and a second location on the second 2D image;

determining 3D coordinates of the first cardinal point based at least in part on the first set of 3D coordinates and the second set of 3D coordinates;

creating a first composite 3D image from the first 2D image and the second 2D image based at least in part on the 3D coordinates of the first cardinal point in the first frame of reference; and

storing in a memory the first composite 3D image.

15. The system of claim 14, wherein the first 2D image includes a first area of a surface of the object.

16. The system of claim 15, further comprising:

a step of providing a drawing; and

a step of superimposing the first composite 3D image onto the drawing.

17. The system of claim 14, further comprising:

providing a first graphical element; and

superimposing the first graphical element on the first composite 3D image.

18. The system of claim 17, wherein the first graphical element is a mechanical extension of the object.

19. The system of claim 17, wherein the first graphical element is placed within a volume represented by the first composite 3D image.

20. The system of claim 15, further comprises:

forming a third 2D image with the camera, the third 2D image including a second area of the surface of the object, the second area including a region of the object not visible in the first composite 3D image; and

forming a second composite 3D image, the second composite 3D image including the third 2D image and at least a portion of the first 2D image or a portion of the second 2D image.