Semi-automatic plane extrusion for 3D modeling

• US 8,059,888 B2
• Filed: 10/30/2007
• Issued: 11/15/2011
• Est. Priority Date: 10/30/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ofek, Eyal, Chen, Billy
• Primary Examiner(s): CHANG, JON CARLTON
• Application Number:
  US11/928,083
• Publication Number:
  US 20090110327A1
• Time in Patent Office: 1,477 Days
• Field of Search: 382/154, 382/128, 382/130, 382/131, 382/132, 345/419, 345/420
• US Class Current: 382/154
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes

Abstract

In accordance with one or more aspects, a plane in a 3D coordinate system in which a 3D model is to be generated based on one or more 2D images is identified. A direction of extrusion for the plane is also identified. Additionally, a user identification of a region of interest on a 2D image is received and projected onto the plane. A location in the 3D model of the region of interest is then automatically identified by extruding the plane along the direction of extrusion until the region of interest in the plane matches a corresponding region of at least one of the one or more 2D images.

Claims

1. One or more computer storage media having stored thereon multiple instructions that, when executed by one or more processors, cause the one or more processors to:

identify a plane in a 3D coordinate system in which a 3D model is being generated based on one or more 2D images;

identify a direction of extrusion for the plane;

receive a user identification of a region of interest on a 2D image;

project the region of interest from the 2D image onto the plane; and

automatically identify a location of the region of interest in the 3D model by extruding the plane along the direction of extrusion until the region of interest in the plane matches a corresponding region of at least one of the one or more 2D images.

2. One or more computer storage media as recited in claim 1, wherein to automatically identify the location is to automatically identify the location of the region of interest in the 3D model by extruding the plane along the direction of extrusion until the region of interest in the plane matches the corresponding region of a single 2D image of the one or more 2D images, the single 2D image being different than the 2D image on which the user identification of the region of interest is received.

3. One or more computer storage media as recited in claim 1, wherein to automatically identify the location is to receive a user indication of a first location along the direction of extrusion, and then move the plane along the direction of extrusion to determine if the region of interest in the plane more closely matches the corresponding region of at least one of the one or more 2D images at a second location.

4. One or more computer storage media as recited in claim 1, wherein to receive the user identification is to receive an indication of an outline drawn on the 2D image to define the region of interest on the 2D image.

5. One or more computer storage media as recited in claim 1, wherein to identify the plane is to identify the plane automatically, and wherein to identify the direction of extrusion is to identify the direction of extrusion automatically.

6. One or more computer storage media as recited in claim 1, wherein to identify the plane is to receive a user indication of a location of the plane, and wherein to identify the direction of extrusion is to receive a user indication of the direction of extrusion.

7. One or more computer storage media as recited in claim 1, wherein the plane matches the corresponding region of at least one of the one or more 2D images if a value representing how well the plane matches a corresponding region of one of the one or more 2D images exceeds a threshold value.

8. A method of identifying a location of a portion of an object in a 3D model, the method comprising:

receiving a user input identifying a region of interest on a 2D image;

projecting the region of interest from the 2D image onto a plane in a 3D coordinate system in which the 3D model is being generated based on multiple 2D images; and

determining the location of the portion of the object by moving the plane along an extrusion direction until the region of interest on the plane matches a corresponding region of one or more of the multiple 2D images.

9. A method as recited in claim 8, further comprising:

receiving a user input identifying an initial location of the plane; and

receiving a user input identifying the extrusion direction.

10. A method as recited in claim 8, the determining comprising determining the location of the portion of the object by moving the plane along the extrusion direction until the region of interest on the plane matches a corresponding region of a single 2D image of one or more of the multiple 2D images, the single 2D image being different from the 2D image on which the user input identifying the region of interest is received.

11. A method as recited in claim 8, further comprising:

repeating the receiving, projecting, and determining for additional user-identified regions of interest.

12. A method as recited in claim 8, wherein the region of interest on the plane matches the corresponding region of one or more of the multiple 2D images at a location where the region of interest on the plane most closely matches the corresponding region of the one or more of the multiple 2D images.

13. A method as recited in claim 8, the determining comprising:

receiving a user input identifying a first location along the extrusion direction;

moving the plane along the extrusion direction to determine if the region of interest on the plane more closely matches the corresponding region of at least one of the one or more 2D images at a second location; and

using the second location as the location of the portion of the object if the region of interest on the plane more closely matches the corresponding region of at least one of the one or more 2D images at the second location.

14. A method as recited in claim 8, wherein receiving the user input identifying the region of interest on the 2D images comprises receiving an indication of an outline drawn on the 2D image.

15. A computing device comprising:

a processor; and

a computer readable media having stored thereon;

a projection module to project a user-selected region of interest on a 2D image onto a plane in a 3D coordinate system in which a 3D model is being generated; and

a plane extrusion module to automatically identify a location of the region of interest in the 3D model by moving the plane along an extrusion direction until the region of interest in the plane matches a corresponding region of at least one of one or more 2D images.

16. A computing device as recited in claim 15, the computer readable media having further stored thereon a region selection module to receive an indication from a user and automatically detect the region of interest based at least in part on the indication.

17. A computing device as recited in claim 16, wherein the region selection module is further to receive the indication marked on the 2D image, the 2D image being excluded from the at least one of the one or more 2D images.

18. A computing device as recited in claim 15, the computer readable media having further stored thereon:

a plane insertion module to automatically identify the plane in the 3D coordinate system; and

an extrusion direction identification module to automatically identify the extrusion direction.

19. A computing device as recited in claim 15, wherein the plane matches the corresponding region of at least one of the one or more 2D images if a value representing how well the plane matches a corresponding region of one of the one or more 2D images exceeds a threshold value.