Click to accept as built modeling

• US 9,424,371 B2
• Filed: 11/07/2011
• Issued: 08/23/2016
• Est. Priority Date: 11/05/2010
• Status: Active Grant

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Shear, Robert Matthew, Awe, James Matson, Pene, Brian A., Kuo, Eddy, Sahoo, Keshaba Chandra
• Primary Examiner(s): Kim, Eunhee
• Application Number:
  US13/290,973
• Publication Number:
  US 20120116728A1
• Time in Patent Office: 1,751 Days
• Field of Search: 345419-420, 701/201
• US Class Current: 1/1
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A method, system, apparatus, and computer program product provide the ability to augment an as-built model. A CAD drawing of a project as well as a digital representation of a physical implementation of the project are obtained. A relationship that maps the digital representation to the CAD drawing is defined/established. A component of the digital representation is identified based on the relationship (e.g., and a database/catalog). Information about the identified component is transmitted to and displayed on a computer (e.g., a mobile device).

Claims

1. A computer-implemented method for augmenting an as-built model comprising:

(a) obtaining, in a first computer, a computer-aided design (CAD) drawing of a project;

(b) receiving, in the first computer from a second computer, a digital representation of a physical implementation of the project;

(c) defining, in the first computer, a relationship that maps the digital representation to the CAD drawing;

(d) identifying, in the first computer, a component of the digital representation based on the relationship, wherein the identifying comprises a feedback loop that is performed until a specific CAD component is identified, the feedback loop comprising;

(1) referencing a content catalog to determine two or more component options for selection by a user;

(2) the transmitting transmits the tow or more component options to the second computer; and

(3) the second computer is configured to receive input from the user identifying which of the two or more component options more closely resembles the component;

(4) repeating the above feedback loop steps progressively narrowing the two or more component options until the specific CAD component is identified; and

(e) receiving, in the first computer, the identification of the specific CAD component identified from the second computer;

(f) updating, in the first computer, the CAD drawing based on the identification; and

(g) transmitting, from the first computer to the second computer, information about the identified component, wherein the second computer is configured to display the information.

2. The method of claim 1, wherein the digital representation comprises a digital image of the physical implementation.

3. The method of claim 1, wherein the digital representation is obtained by laser scanning.

4. The method of claim 1, wherein the defining the relationship comprises:

estimating a location and an orientation of a user in the digital representation with respect to a local coordinate system; and

associating the location in the digital representation with the CAD drawing such that an origin and coordinate axes of the digital representation and the CAD drawing are mapped to each other.

5. The method of claim 1, wherein the defining the relationship comprises:

mapping a landmark from the digital representation to a corresponding landmark in the CAD drawing.

6. The method of claim 1, wherein:

the information comprises tag overlays comprising asset information about the identified component.

7. The method of claim 1, further comprising:

receiving, in the first computer from the second computer, a markup drawn by a user on the digital representation displayed by the second computer.

8. The method of claim 1, further comprising:

transmitting a virtual 3D model that is based on the CAD drawing, from the first computer to the second computer, wherein;

the information comprises the virtual 3D model; and

the virtual 3D model is displayed by overlaying the virtual 3D model onto the digital representation displayed by the second computer.

9. The method of claim 1, wherein:

the information about the identified component is tracked and displayed in real time on live video feed by the second computer.

10. The method of claim 1, wherein:

the second computer comprises a mobile thin client device configured with an image capture mechanism and location capabilities.

21. The method of claim 7, wherein:

the markup drawn by the user marks up a particular component of the digital representation; and

the method further comprises displaying, via the first computer, the markup, on the CAD drawing, in an appropriate location on the CAD drawing, based on the relationship that maps the digital representation to the CAD drawing.

11. An apparatus for augmenting an as-built model displayed on a mobile device comprising:

(a) the mobile device having a memory; and

(b) an application executing on the mobile device, wherein the application is configured to;

(i) obtain a digital representation of a physical implementation of a project;

(ii) transmit the digital representation to a first computer, wherein the first computer is configured to;

(1) maintain a computer-aided design (CAD) drawing of the project;

(2) define a relationship that maps the digital representation to the CAD drawing; and

(3) identify a component of the digital representation based on the relationship and by performing a feedback loop until a specific CAD component is identified, the feedback loop comprising;

(A) referencing a content catalog to determine two or more component options for selection by a user; and

(B) the mobile device is configured to;

receive the two or more component options from the first computer;

obtain input from the user identifying which of the two or more component options more closely resembles the component;

repeating the above feedback loop steps progressively narrowing the two or more component options until the specific CAD component is identified; and

transmit the identification of the specific CAD component to the first computer, wherein the first computer is configured to update the CAD drawing based on the identification;

(iii) receive, from the first computer, information about the identified component; and

(iv) display the information.

12. The apparatus of claim 11, wherein the digital representation comprises a digital image of the physical implementation.

13. The apparatus of claim 11, wherein the digital representation is obtained by laser scanning.

14. The apparatus of claim 11, wherein the relationship is defined by:

estimating a location and an orientation of a user in the digital representation with respect to a local coordinate system; and

associating the location in the digital representation with the CAD drawing such that an origin and coordinate axes of the digital representation and the CAD drawing are mapped to each other.

15. The apparatus of claim 11, wherein the relationship is defined by:

mapping a landmark from the digital representation to a corresponding landmark in the CAD drawing.

16. The apparatus of claim 11, wherein:

the information comprises tag overlays comprising asset information about the identified component.

17. The apparatus of claim 11, wherein the mobile device is further configured to:

obtain markup drawn by a user on the mobile device, on the digital representation; and

transmit the markup to the first computer.

18. The apparatus of claim 11, wherein the mobile device is further configured to:

receive a virtual 3D model that is based on the CAD drawing, from the first computer, wherein the information comprises the virtual 3D model; and

display the virtual 3D model by overlaying the virtual 3D model onto the digital representation.

19. The apparatus of claim 11, wherein the mobile device is further configured to:

track and display the information about the identified component in real time on live video feed.

20. The apparatus of claim 11, wherein:

the mobile device further comprises an image capture mechanism and location capabilities.

22. The apparatus of claim 17 wherein:

the markup drawn by the user marks up a particular component of the digital representation; and

the application is further configured to display, via the first computer, the markup, on the CAD drawing, in an appropriate location on the CAD drawing, based on the relationship that maps the digital representation to the CAD drawing.