Three-dimensional object scanning feedback

• US 10,019,839 B2
• Filed: 06/30/2016
• Issued: 07/10/2018
• Est. Priority Date: 06/30/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Kohler, Jeffrey, Wright, Shawn Crispin, Scott, Jason Bradley, Copic, John
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Application Number:
  US15/199,480
• Publication Number:
  US 20180005433A1
• Time in Patent Office: 740 Days
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G05B 19/4207 in which a model is traced or scanned and corresponding data recorded
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/04 involving 3D image data

Abstract

Examples of providing feedback regarding a scan of a three-dimensional object are described. In one example, a method of computer modeling a three-dimensional object includes computer-tracking a three-dimensional pose of a scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning devices changes to measure different contours of the three-dimensional object from different vantage points, and assessing a sufficiency of contour measurements from one or more of the different vantage points based on measurements received from the scanning device. The example method further includes providing haptic feedback, via a haptic output device, indicating the sufficiency of contour measurements corresponding to a current three-dimensional pose of the scanning device.

Claims

1. A method of computer modeling a three-dimensional object, the method comprising:

computer-tracking a three-dimensional pose of a scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning device changes to measure different contours of the three-dimensional object from different vantage points;

assessing a sufficiency of contour measurements from one or more of the different vantage points based on measurements received from the scanning device; and

providing haptic feedback, via a haptic output device, indicating the sufficiency of contour measurements corresponding to a current three-dimensional pose of the scanning device.

2. The method of claim 1, wherein providing haptic feedback comprises decreasing one or more of an intensity and a frequency of haptic output provided by the haptic output device as the sufficiency of contour measurements increases.

3. The method of claim 1, wherein providing haptic feedback comprises individually controlling each of a plurality of haptic actuators to provide directional haptic feedback to a user in contact with the haptic output device.

4. The method of claim 1, wherein the haptic feedback is provided to the user directly via the scanning device.

5. The method of claim 1, wherein the haptic feedback indicates a speed of the scanning device.

6. The method of claim 1, wherein the haptic feedback indicates a distance of the scanning device from the three-dimensional object.

7. The method of claim 1, further comprising providing visual feedback, via an augmented reality display, indicating the sufficiency of contour measurements.

8. The method of claim 1, further comprising providing visual feedback, via an augmented reality display, indicating a field of view of the scanning device.

9. A method of computer modeling a three-dimensional object, the method comprising:

computer-tracking a three-dimensional pose of a scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning device changes to measure different contours of the three-dimensional object from different vantage points;

mapping the three-dimensional pose of the scanning device to a coordinate space shared by an augmented reality display; and

displaying, via the augmented reality display, an augmented scene including an augmentation indicating a current field of view of the scanning device from a current vantage point of the scanning device.

10. The method of claim 9, wherein the augmentation includes a frustum shape extending from the scanning device as the scanning device is viewed through a head-mounted display device.

11. The method of claim 10, wherein the frustum shape includes two or more differently-displayed segments, each of the two or more segments extending from either the scanning device or an adjacent segment of the two or more segments and terminating at a different distance from the scanning device.

12. The method of claim 10, wherein the augmented scene further includes a model of the three-dimensional object, the method further comprising forming and displaying portions of the model for which sufficient contour measurements are acquired.

13. The method of claim 12, wherein one or more visual properties of the model is based at least on the sufficiency of contour measurements of associated surfaces of the three-dimensional object.

14. The method of claim 12, wherein displaying the augmented scene comprises displaying the model of the three-dimensional object in a position that is offset from the three-dimensional object.

15. The method of claim 12, wherein displaying the augmented scene comprises displaying the model as an overlay on the three-dimensional object.

16. The method of claim 9, wherein the display device is a head-mounted display device.

17. A device for computer modeling a three-dimensional object, the device comprising:

an interface communicatively connected to a scanning device and an augmented reality display;

a logic machine; and

a storage machine holding instructions executable by the logic machine to;

computer-track a three-dimensional pose of the scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning device changes to measure different contours of the three-dimensional object from different vantage points;

map the three-dimensional pose of the scanning device to a coordinate space shared by the augmented reality display; and

display, via the augmented reality display, an augmented scene including the three-dimensional object, the scanning device, and an augmentation indicating a current field of view from a current vantage point of the scanning device.

18. The device of claim 17, wherein the augmented reality display includes a head-mounted display (HMD) device, and wherein the augmentation is displayed as extending from the scanning device and intersecting the three-dimensional object as the scanning device and three-dimensional object are viewed through the HMD device.

19. The device of claim 18, wherein the augmented scene further includes a model of the three-dimensional object, and wherein the instructions are further executable to form and display portions of the model based at least on a sufficiency of contour measurements of surfaces of the three-dimensional object that are scanned by the scanning device from the different vantage points.

20. The device of claim 19, wherein the scanning device includes one or more haptic actuators, and wherein the instructions are further executable to output haptic feedback controls to the one or more haptic actuators indicating the sufficiency of contour measurements of the three-dimensional object.