Visualization alignment for three-dimensional scanning

• US 10,019,837 B2
• Filed: 05/31/2016
• Issued: 07/10/2018
• Est. Priority Date: 05/31/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Simari, Matthew Adam, Stachniak, Szyman Piotr, Baiyya, Vijay, Liang, Lin
• Primary Examiner(s): Nguyen, Vu
• Application Number:
  US15/169,569
• Publication Number:
  US 20170345209A1
• Time in Patent Office: 770 Days
• Field of Search: None
• CPC Class Codes: G01B 11/24 for measuring contours or curvatures
• CPC Class Codes: G01B 11/2522 the position of the object changing and being recorded
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06V 10/16 using multiple overlapping images; Image stitching
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: H04N 13/211 using temporal multiplexing

Abstract

A method for generating a three-dimensional virtual representation includes performing a first scan of the physical object while the physical object has a first position. A displayed visualization of the physical object is generated based on the first scan. Aligning input is received that causes increased correspondence between the displayed visualization and a second position of the physical object. A second scan of the physical object is performed while the object is in the second position. Based on the first scan and the second scan, a three-dimensional virtual representation of the physical object is generated.

Claims

1. A method for generating a three-dimensional virtual representation of a physical object via a scanning system, the method comprising:

performing a first scan of the physical object while the physical object is in a first position;

receiving an aligning input that causes increased correspondence between a displayed visualization of the physical object and a second position of the physical object, such aligning input including (1) moving the displayed visualization to match the second position of the physical object or (2) moving the physical object into the second position to match with the displayed visualization;

performing a second scan of the physical object while the physical object is in the second position; and

generating a three-dimensional virtual representation of the physical object based on the first scan and the second scan.

2. The method of claim 1, further comprising performing one or more additional scans of the physical object and generating the three-dimensional virtual representation of the physical object based on the first scan, the second scan, and the one or more additional scans.

3. The method of claim 1, where responsive to receiving the aligning input, the displayed visualization and the second position of the physical object are aligned.

4. The method of claim 3, where the displayed visualization and the second position of the physical object are aligned responsive to receiving a prompt from a user of the scanning system.

5. The method of claim 1, further comprising rotating the displayed visualization, and where the aligning input (i) is received after the rotating of the displayed visualization and (ii) generated based on a repositioning of the physical object that brings the physical object into increased correspondence with the rotated displayed visualization.

6. The method of claim 1, further comprising rotating the displayed visualization, where the aligning input is received from a user of the scanning system and causes the rotating of the displayed visualization.

7. The method of claim 1, where a user of the scanning system moves the physical object to occupy the second position.

8. The method of claim 1, where the second scan captures one or more features of the physical object not captured by the first scan as a result of a difference between the first position and the second position.

9. The method of claim 1, where the scanning system includes a depth camera.

10. The method of claim 1, where generating the three-dimensional virtual representation includes performing an iterative closest point process based on the first scan and the second scan.

11. A computing system, comprising:

a logic machine; and

a storage machine holding instructions executable by the logic machine to;

receive data for a first scan of a physical object performed by a scanning system while the physical object is in a first position;

receive an aligning input that causes increased correspondence between a displayed visualization of the physical object and a second position of the physical object, such aligning input including (1) moving the displayed visualization to match the second position of the physical object or (2) moving the physical object into the second position to match with the displayed visualization; and

generate a three-dimensional virtual representation of the physical object based on the first scan and a second scan of the physical object performed by the scanning system while the physical object is in the second position.

12. The computing system of claim 11, where during the first scan and the second scan, the physical object is stationary and one or more components of the scanning system move around the physical object.

13. The computing system of claim 11, where during the first scan and the second scan, the physical object rotates relative to one or more components of the scanning system.

14. The computing system of claim 11, where the displayed visualization is presented to a user of the computing system via a display, and is superimposed over a dynamically updating image of the physical object.

15. The computing system of claim 11, where a user of the computing system moves the physical object to occupy the second position.

16. The computing system of claim 11, where responsive to receiving the aligning input, the displayed visualization and the second position of the physical object are aligned.

17. The computing system of claim 11, the instructions further executable to rotate the displayed visualization, where the aligning input (i) is received after the displayed visualization is rotated and (ii) generated based on a repositioning of the physical object that brings the physical object into increased correspondence with the rotated displayed visualization.

18. The computing system of claim 11, the instructions further executable to rotate the displayed visualization, where the aligning input is received from a user of the computing system and causes rotation of the displayed visualization.

19. The computing system of claim 11, where the second scan captures one or more features of the physical object not captured by the first scan as a result of a difference between the first position and the second position.

20. A computing system, comprising:

a scanning system;

a logic machine; and

a storage machine holding instructions executable by the logic machine to;

via the scanning system, perform a first scan of a physical object while the physical object has a first position;

generate a displayed visualization of the physical object based on the first scan;

present the displayed visualization to a user of the computing system via a display, the displayed visualization superimposed over a dynamically updating image of the physical object;

receive an aligning input from the user of the computing system that causes rotation of the displayed visualization toward a second position of the physical object;

via the scanning system, perform a second scan of the physical object while the physical object is in the second position; and

generate a three-dimensional virtual representation of the physical object based on the first scan and the second scan.