HOLOGRAPHIC BUILDING INFORMATION UPDATE

• US 20170053042A1
• Filed: 08/19/2015
• Published: 02/23/2017
• Est. Priority Date: 08/19/2015
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: James T. Reichert, Jr.
• Inventors: Nance, James L., Sugden, Benjamin John, Howard, John Charles, Tanner, Marcus, Reichert, James T. Jr., Christen, Jonathan R.
• Application Number:
  US14/830,212
• Publication Number:
  US 20170053042A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

A method is disclosed that includes accessing a building information modeling database comprising building information data of a structure. A position of a head-mounted display device with respect to the structure may be tracked, with the head-mounted display device comprising an at least partially see-through display. In response to a portal user input, a world-locked holographic portal may be displayed via the device on a surface of the structure, where the portal comprises a world-locked holographic representation of a portion of the structure otherwise hidden from view by the surface. In response to an operation user input, a virtual operation is performed on the structure, and the building information modeling database is updated based on the virtual operation.

Claims

1. A head-mounted display device, comprising:

a camera configured to capture images;

an at least partially see-through display;

a processor; and

a memory holding instructions executable by the processor to;

access a building information modeling database comprising building information data of a structure;

track a position of the head-mounted display device with respect to the structure;

in response to a portal user input, display a world-locked holographic portal on a surface of the structure, wherein the portal comprises a world-locked holographic representation of a portion of the structure otherwise hidden from view by the surface;

in response to an operation user input, perform a virtual operation on the structure; and

update the building information modeling database based on the virtual operation.

2. The head-mounted display device of claim 1, wherein the virtual operation comprises adding a virtual component to the structure, wherein the virtual component is selected from the building information data of the building information modeling database.

3. The head-mounted display device of claim 2, wherein the virtual component comprises a virtual load-bearing component, the instructions executable by the processor to:

display a world-locked holographic representation of the virtual load-bearing component at a proposed location in the structure; and

based on the proposed location of the virtual load-bearing component, receive a load calculation for the virtual load-bearing component.

4. The head-mounted display device of claim 1, the instructions executable by the processor to display on the surface a world-locked holographic installation template having installation dimensions corresponding to an actual component selected from the building information data of the building information modeling database.

5. The head-mounted display device of claim 2, the instructions executable by the processor to:

capture one or more of depth data and image data of an actual component represented by the virtual component as installed in the structure; and

add one or more of the depth data and the image data to the building information modeling database.

6. The head-mounted display device of claim 5, wherein one or more of the depth data and the image data are tagged in the building information modeling database with a component location of the actual component as installed in the structure.

7. The head-mounted display device of claim 1, the instructions executable by the processor to:

generate a holographic comment regarding the structure that is geo-located with the holographic portal, the comment comprising one or more of text, audio commentary from a user, an image of the holographic representation of the portion of the structure otherwise hidden from view, and a timestamp of the comment; and

add the holographic comment to the building information modeling database.

8. The head-mounted display device of claim 1, wherein the virtual operation comprises virtually altering a physical feature of the structure, and the instructions executable by the processor to update the building information modeling database to include the virtual alteration of the physical feature.

9. The head-mounted display device of claim 1, the instructions executable by the processor to display one or more of a world-locked holographic eligible location where the virtual operation may be performed and a world-locked holographic ineligible location where the virtual operation may not be performed.

10. The head-mounted display device of claim 1, the instructions executable by the processor to:

determine that the virtual operation relates to an event; and

based on the determination, communicate a timing alert to a user that associates the virtual operation with the event.

11. A method, comprising:

accessing a building information modeling database comprising building information data of a structure;

tracking a position of a head-mounted display device with respect to the structure, the head-mounted display device comprising an at least partially see-through display;

in response to a portal user input, displaying via the head-mounted display device a world-locked holographic portal on a surface of the structure, wherein the portal comprises a world-locked holographic representation of a portion of the structure otherwise hidden from view by the surface;

in response to an operation user input, performing a virtual operation on the structure; and

updating the building information modeling database based on the virtual operation.

12. The method of claim 11, wherein performing the operation comprises adding a virtual component to the structure, wherein the virtual component is selected from the building information data of the building information modeling database.

13. The method of claim 12, wherein the virtual component comprises a virtual load-bearing component, the method further comprising:

displaying a world-locked holographic representation of the virtual load-bearing component at a proposed location in the structure; and

receiving a load calculation for the virtual load-bearing component that is based on the proposed location of the virtual load-bearing component.

14. The method of claim 11, further comprising displaying on the surface a world-locked holographic installation template having installation dimensions corresponding to an actual component selected from the building information data of the building information modeling database.

15. The method of claim 12, further comprising:

capturing via the head-mounted display device one or more of depth data and image data of an actual component represented by the virtual component as installed in the structure; and

adding one or more of the depth data and the image data to the building information modeling database.

16. The method of claim 15, further comprising tagging the depth data and the image data in the building information modeling database with a component location of the actual component as installed in the structure.

17. The method of claim 11, further comprising:

capturing via the head-mounted display device a holographic comment regarding the structure that is geo-located with the holographic portal, the comment comprising one or more of text, audio commentary from a user, an image of the holographic representation of the portion of the structure otherwise hidden from view, and a timestamp of the comment; and

adding the holographic comment to the building information modeling database.

18. The method of claim 11, wherein performing the virtual operation comprises:

virtually altering a physical feature of the structure; and

updating the building information modeling database to include the virtual alteration of the physical feature.

19. The method of claim 11, further comprising:

determining that the virtual operation relates to an event; and

based on the determination, communicating a timing alert to a user that associates the virtual operation with the event.

20. A head-mounted display device, comprising:

a camera configured to capture images;

an at least partially see-through display;

a processor; and

a memory holding instructions executable by the processor to;

access a building information modeling database comprising building information data of a structure;

track a position of the head-mounted display device with respect to the structure;

in response to user input, display a world-locked holographic component at a proposed location in the structure, wherein the world-locked holographic component corresponds to an actual component that embodies a characteristic;

receive a calculation that is based on the proposed location of the holographic component and the characteristic; and

update the building information modeling database with the calculation.