Systems and methods for presenting building information
First Claim
1. A computer-implemented method for delivering to a user of a portable augmented reality display device data representative of a location of a piece of concealed equipment, the method comprising:
- maintaining access to a 3D-object library that contains data representative of 3D models in the form of renderable objects, wherein each 3D renderable object is associated with a piece of equipment which is concealed behind a floor or a wall and is definable in Building Information Modelling (BIM) data in a BIM repository;
operating a 3D-object generator, the 3D-object generator being configured to correlate BIM data with 3D models present in the 3D-object library, thereby to generate a 3D model of the building by combining the 3D objects based on positional layouts defined by the BIM data in the BIM repository; and
operating a 3D transformer, which is configured to;
(i) identify a real-world marker in video image data from a video camera device, the real-world marker being at a known location defined relative to the BIM data in the BIM repository wherein the video camera device is provided on a device coupled to the augmented reality display device;
(ii) determine a real-time orientation of the real-world marker relative to the video camera device;
(iii) based on the determined real-time orientation of the real-world marker, apply a matrix transformation to a 3D image provided by the 3D-object generator to define an oriented 3D image such that the oriented 3D image is consistent with viewing the 3D object from a viewpoint of the video camera device;
(iv) rendering the oriented 3D image as an overlay on the video image data on a display of the portable device; and
repeating steps (ii) to (iv) for at least a subset of the video image data frames thereby to assist a user of the portable device in locating concealed equipment that is not able to be visually located.
0 Assignments
0 Petitions
Accused Products
Abstract
Described herein are systems and methods for presenting building information. In overview, the technologies described herein provide relationships between Building Information Modeling (BIM) data (which includes building schematics defined in terms of standardized three dimensional models) and Building Management System (BMS) data (which includes data indicative of the operation of building components such as HVAC components and the like). Some embodiments use relationships between these forms of data thereby to assist technicians in identifying the physical location of particular pieces of equipment, for example in the context of performing inspections and/or maintenance. In some cases this includes the provision of 2D and/or 3D maps to portable devices, these maps including the location of equipment defined both in BIM and BMS data. In some cases, augmented reality technology is applied thereby to provide richer access to positional information.
-
Citations
19 Claims
-
1. A computer-implemented method for delivering to a user of a portable augmented reality display device data representative of a location of a piece of concealed equipment, the method comprising:
-
maintaining access to a 3D-object library that contains data representative of 3D models in the form of renderable objects, wherein each 3D renderable object is associated with a piece of equipment which is concealed behind a floor or a wall and is definable in Building Information Modelling (BIM) data in a BIM repository; operating a 3D-object generator, the 3D-object generator being configured to correlate BIM data with 3D models present in the 3D-object library, thereby to generate a 3D model of the building by combining the 3D objects based on positional layouts defined by the BIM data in the BIM repository; and operating a 3D transformer, which is configured to; (i) identify a real-world marker in video image data from a video camera device, the real-world marker being at a known location defined relative to the BIM data in the BIM repository wherein the video camera device is provided on a device coupled to the augmented reality display device; (ii) determine a real-time orientation of the real-world marker relative to the video camera device; (iii) based on the determined real-time orientation of the real-world marker, apply a matrix transformation to a 3D image provided by the 3D-object generator to define an oriented 3D image such that the oriented 3D image is consistent with viewing the 3D object from a viewpoint of the video camera device; (iv) rendering the oriented 3D image as an overlay on the video image data on a display of the portable device; and repeating steps (ii) to (iv) for at least a subset of the video image data frames thereby to assist a user of the portable device in locating concealed equipment that is not able to be visually located. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A server, comprising:
-
a memory for storing to a 3D-object library and a Building information Modelling (BIM) repository, the 3D-object library including data representative of 3D models in the form of renderable objects, wherein each 3D renderable object is associated with a piece of equipment which is concealed behind a floor or a wall and is defined in Building Information Modelling (BIM) data in the BIM repository; a 3D-object generator configured to correlate BIM data with 3D models present in the 3D-object library; and a 3D transformer configured to; (i) identify a real-world marker in video image data from a video camera device, the real-world marker being at a known location defined relative to the BIM data in the BIM repository, wherein the video camera device is provided on a device coupled to an augmented reality display device; (ii) determine a real-time orientation of the real-world marker relative to the video camera device; (iii) based on the determined real-time orientation of the real-world marker, apply a transformation to a 3D image provided by the 3D-object generator to define an oriented 3D image such that the oriented 3D image is consistent with viewing the 3D object from a viewpoint of the video camera device; (iv) rendering the oriented 3D image as an overlay on the video image data on a display of the portable device; and repeating steps (ii) to (iv) for at least a subset of the video image data frames thereby to assist a user of the portable device in locating concealed equipment that is not able to be visually located. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. A computer-implemented method for delivering to a user of a portable augmented reality display device data representative of a location of a piece of concealed equipment, the method comprising:
-
accessing a 3D-object library that contains data representative of 3D models in the form of renderable objects, wherein each 3D renderable object is associated with a piece of equipment which is concealed behind a floor or a wall and is definable in Building Information Modelling (BIM) data in a BIM repository; operating a 3D-object generator, the 3D-object generator being configured to correlate BIM data with 3D models present in the 3D-object library, and to generate a 3D model of at least part of the building by combining the 3D objects based on positional layouts defined by the BIM data in the BIM repository; and operating a 3D transformer configured to; (i) identify a real-world marker in video image data from a video camera device, the real-world marker being at a known location defined relative to the BIM data in the BIM repository wherein the video camera device is provided on a device coupled to the augmented reality display device; (ii) determine a real-time location and orientation of the real-world marker relative to the video camera device; and (iii) based on the determined real-time location and orientation of the real-world marker, apply a transformation to a 3D image provided by the 3D-object generator to define an oriented 3D image such that the oriented 3D image is consistent with viewing the 3D object from a viewpoint of the video camera device; (iv) rendering the oriented 3D image as an overlay on the video image data on a display of the portable device; repeating steps (ii) to (iv) for at least a subset of the video image data frames thereby to assist a user of the portable device in locating concealed equipment that is not able to be visually located. - View Dependent Claims (17, 18, 19)
-
Specification