Visual feedback of 3D scan parameters

• US 7,813,591 B2
• Filed: 09/03/2006
• Issued: 10/12/2010
• Est. Priority Date: 01/20/2006
• Status: Active Grant

• Current Assignee: Solventum Intellectual Properties Company (Solventum Corp.)
• Original Assignee: 3M Innovative Properties Company (3M Company)
• Inventors: Boeries, Joseph, Rohaly, Janos, Paley, Eric B., Kriveshko, Ilya A., Weeks, Steven V., Tekeian, Edward K.
• Primary Examiner(s): Seth; Manav
• Application Number:
  US11/469,871
• Publication Number:
  US 20070172112A1
• Time in Patent Office: 1,500 Days
• Field of Search: 382/100, 382/103, 382/106, 382108-109, 382128-132, 382153-154, 382/285, 382293-296, 345418-424, 345/589, 345629-634, 345649-688
• US Class Current: 382/285
• CPC Class Codes: A61B 1/24 for the mouth, i.e. stomatoscopes, e.g. with tongue depressors tongue depressors per se A61B13/00; Instruments for opening or keeping open the mouth combined with saliva removers A61C17/00; mouth openers for animals A61D15/00
• CPC Class Codes: A61B 5/1077 Measuring of profiles
• CPC Class Codes: A61B 5/4547 Evaluating teeth
• CPC Class Codes: A61B 5/7435 Displaying user selection data, e.g. icons in a graphical user interface
• CPC Class Codes: A61C 11/08 with means to secure dental casts to articulator
• CPC Class Codes: A61C 11/085 Intermediary adjustment plates
• CPC Class Codes: A61C 13/0022 Blanks or green, unfinished dental restoration parts
• CPC Class Codes: A61C 19/04 Measuring instruments specially adapted for dentistry A61C5/44 takes precedence; testing vitality of teeth A61B5/0534; radiation diagnosis specially adapted for dentistry A61B6/51
• CPC Class Codes: A61C 9/0046 Data acquisition means or methods
• CPC Class Codes: A61C 9/0053 Optical means or methods, e.g. scanning the teeth by a laser or light beam
• CPC Class Codes: A61C 9/0086 Acoustic means or methods
• CPC Class Codes: B33Y 80/00 Products made by additive manufacturing
• CPC Class Codes: G01B 11/2513 with several lines being projected in more than one direction, e.g. grids, patterns
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/30 Polynomial surface description
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms

Abstract

The systems and methods disclosed herein provide visual feedback concerning one or more scanning parameters to a user during acquisition of a three dimensional scan.

Claims

1. A method for operating a scanning system that includes a scanning device and a display, the scanning device adapted for continuous acquisition of surface data from a subject, the scanning device having one or more scanning parameters, and the display adapted for displaying a digital surface reconstruction containing a plurality of three-dimensional points recovered from the surface data, the method comprising:

rendering the digital surface reconstruction in the display; and

providing a visual cue within the display that relates to the one or more scanning parameters;

wherein the one or more scanning parameters includes a range of distances for data capture, providing a visual cue further including color coding a plurality of rendered points of the digital surface reconstruction according to a current distance of each one of the plurality of rendered points relative to the range of distances for data capture;

wherein color coding includes rendering points more distant than the range of distances in a first color;

wherein color coding includes rendering points nearer than the range of distances in a second color;

wherein color coding includes rendering points within the range of distances in a third color.

2. The method of claim 1 wherein rendering the digital surface reconstruction includes rendering the digital surface reconstruction from a current point of view of the scanning device.

3. The method of claim 2 further comprising superimposing the digital surface reconstruction and a video image of the subject from the current point of view in the display.

4. The method of claim 1 wherein rendering the digital surface reconstruction includes rendering the digital surface reconstruction in real time.

5. The method of claim 1 wherein the one or more parameters includes an optimal distance from the scanning device to a subject.

6. The method of claim 1 wherein the one or more scanning parameters includes a field of view for data capture within the display, the visual cue including a box bounding the field of view.

7. The method of claim 6 wherein the one or more scanning parameters includes a range of distances for data capture within the display, the visual cue including a three-dimensional box bounding the field of view and the range of distances.

8. The method of claim 1 wherein the visual cue includes a dynamic object within the display, the dynamic object adapted to convey information relating to a distance between the scanning device and a subject of the surface data.

9. The method of claim 8 wherein the dynamic object includes an animated bullseye.

10. The method of claim 8 wherein the dynamic object relates to a most recent frame of surface data.

11. The method of claim 8 wherein the dynamic object provides a relative distance indicator for visual feedback to a user concerning whether the scanning device is at least one of too close, too far, or properly distanced from the subject.

12. The method of claim 11 wherein the relative distance indicator provides graduated feedback to assist a user in maintaining a proper scan distance.

13. The method of claim 1 wherein the distance between the scanning device and the subject is calculated as a mean distance from a plurality of points within a field of view of the scanning device.

14. The method of claim 1 further comprising capturing a two-dimensional video image with the scanning device and rendering the video image on the display.

15. The method of claim 14 further comprising superimposing the digital surface reconstruction on the video image in the display.

16. The method of claim 14 wherein the visual cue is updated at a video rate of the two-dimensional video image.

17. The method of claim 1 wherein the visual cue is updated in real time.