System for generating virtual building plan data based upon stored and scanned building data and related methods

• US 10,354,439 B2
• Filed: 11/01/2016
• Issued: 07/16/2019
• Est. Priority Date: 10/24/2016
• Status: Active Grant

• Current Assignee: Unearthed Land Technologies LLC
• Original Assignee: Charles C. Carrington
• Inventors: Carrington, Charles C.
• Primary Examiner(s): Ma, Tize
• Application Number:
  US15/340,399
• Publication Number:
  US 20180114361A1
• Time in Patent Office: 987 Days
• Field of Search: None
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2210/04 Architectural design, interior design
• CPC Class Codes: G06T 2219/004 Annotating, labelling
• CPC Class Codes: G06V 20/17 taken from planes or by drones
• CPC Class Codes: G06V 20/176 Urban or other man-made structures
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings
• CPC Class Codes: H04W 4/90 Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]

Abstract

A system may include a building scanning device configured to scan a target building and generate scanned building data based thereon. The system may also include a processor and a communication interface coupled thereto. The processor may be configured to cooperate with the communication interface to obtain stored building data for the target building from a remote stored data source and cooperate with the building scanning device to obtain the scanned building data. The processor may also be configured to generate virtual building plan data based upon the stored building data and the scanned building data and drive at least one display based upon the virtual building plan data.

Claims

1. A method of generating virtual building plan data for active incident management, the method comprising:

using a processor coupled to a communication interface to

receive a request from a user for virtual building plan data, the request being indicative of an active incident at a target building,

after and within a threshold time of receiving the request

cooperate with the communication interface to obtain stored building data for the target building from a remote stored data source,

cooperate with a building scanning system located outside of the target building to obtain scanned building data, the scanned building data being obtained after receiving the request for virtual building plan data and including a first plurality of points on the exterior of the target building without a second plurality of points of the entire exterior of the target building that are possible to scan, the first plurality of points being a subset of the second plurality of points that is sufficient to spatially relate an interior floor plan of a virtual building plan to the target building,

generate the virtual building plan data based upon the stored building data and the scanned building data based upon the request from the user,

spatially relate the target building to the virtual building plan data based on the first plurality of points on the exterior of the target building in the scanned building data scanned from outside the target building relating to corresponding points on the virtual building plan, wherein the first plurality of points on the target building are linked to a plurality of respective GPS points of the exterior of the target building, interior points in the virtual building plan data are related to GPS points of the interior of the target building, and the interior points of the target building are related to the interior floor plan of a virtual building, and

drive at least one display associated with the user based upon the virtual building plan data to display the interior floorplan of the virtual building that is related spatially to the target building so that the virtual building plan data is available to manage the active incident.

2. The method of claim 1 wherein the processor is used to generate the virtual building plan data for three-dimensions.

3. The method of claim 1 wherein the virtual building plan data comprises wall data;

and wherein the processor is used to drive the at least one display to display an x-ray view through walls in the target building.

4. The method of claim 1 wherein a portable housing to be carried by the user is configured to carry processor and the communication interface.

5. The method of claim 1 wherein a user-wearable helmet to be carried by the user is configured to carry the processor and the communication interface.

6. The method of claim 1 wherein a user interface device is configured to be carried by the user and comprises a portable housing configured to carry the at least one display and a user device controller carried by the portable housing and configured to obtain the virtual building plan data from the processor and display the virtual building plan data on the at least one display.

7. The method of claim 1 wherein a user interface device is configured to be carried by the user and comprises a user-wearable helmet configured to carry the at least one display and a user device controller carried by the user-wearable helmet and configured to obtain the virtual building plan data from the processor and display the virtual building plan data on the at least one display.

8. The method of claim 7 wherein the user interface device comprises an orientation sensor carried by the user-wearable helmet;

and wherein the user device controller is configured to display the virtual building plan data based upon the orientation sensor.

9. The method of claim 1 wherein the stored building data comprises at least one of permitting data, property appraisal data, and property taxation data.

10. The method of claim 1 wherein the processor is used to cooperate with the communication interface to obtain the stored building data for the target building from a remote stored data source comprising at least one governmental data source.

11. The method of claim 1, wherein a point on an exterior of the target building is geospatially related to a corresponding point on the virtual building plan.

12. The method of claim 1, wherein both of the virtual building and the target building are related to a geospatial position.

13. The method of claim 1, wherein a plurality of geospatial locations are related onto the display of the virtual building.

14. The method of claim 1, wherein the building scanning system is a ground mounted device located outside the target building.

15. The method of claim 1, wherein the building scanning system includes a telescoping scanning device.

16. The method of claim 1, wherein the building scanning system includes a telephoto scanning device.

17. The method of claim 1, wherein the building scanning system is remotely located at a distance above scanned points on the building.

18. The method of claim 1, wherein the scanned building data is related to a geospatial position.

19. The method of claim 1, wherein a user device that is configured to be at least one of worn and carried by the user is related spatially to both of the virtual building and the target building.

20. The method of claim 19, wherein the virtual building, the target building, and the user device are all geospatially related.

21. A method of displaying virtual building plan data on a display of a user interface device, the user interface device being configured to be carried by the user and comprising a user-wearable helmet configured to carry the display and a user device controller carried by the user-wearable helmet, the method comprising:

using the user device controller for

obtaining the virtual building plan data from a virtual building plan data generator comprising a processor coupled to a communication interface and configured to receive a request from a user for virtual building plan data, the request being indicative of an active incident at a target building, the processor being configured to, after and within a threshold time of receiving the request cooperate with the communication interface to obtain stored building data for the target building from a remote stored data source, cooperate with a building scanning system located outside of the target building to obtain scanned building data, the scanned building data being obtained after receiving the request for virtual building plan data and including a first plurality of points on the exterior of the target building without a second plurality of points of the entire exterior of the target building that are possible to scan, the first plurality of points being a subset of the second plurality of points that is sufficient to spatially relate an interior floor plan of a virtual building plan to the target building, generate the virtual building plan data based upon the stored building data and the scanned building data based upon the request from the user, spatially relate the target building to the virtual building plan data based on the first plurality of points on the exterior of the target building in the scanned building data scanned from outside the target building relating to corresponding points on the virtual building plan, wherein the first plurality of points on the target building are linked to a plurality of respective GPS points of the exterior of the target building, interior points in the virtual building plan data are related to GPS points of the interior of the target building, and the interior points of the target building are related to the interior floor plan of a virtual building, and

cooperating with the processor to display the virtual building plan data to display the interior floorplan of the virtual building that is related spatially to the target building so that the virtual building plan data is available to manage the active incident.

22. The method of claim 21 wherein the processor is configured to generate the virtual building plan data for three-dimensions;

and wherein the method comprises using the user device controller to display the virtual building plan data in three-dimensions.

23. The method of claim 21 wherein the virtual building plan data comprises wall data;

and wherein the method comprises using the user device controller to display the virtual building plan data in an x-ray view through walls in the target building.

24. A method of displaying virtual building plan data on a display of a user interface device, the user interface device being configured to be carried by the user and comprising a portable housing configured to carry the display and a user device controller carried by the portable housing, the method comprising:

using the user device controller for

obtaining the virtual building plan data from a virtual building plan data generator comprising a processor coupled to a communication interface and configured to receive a request from a user for virtual building plan data, the request being indicative of an active incident at a target building, the processor being configured to, after and within a threshold time of receiving the request cooperate with the communication interface to obtain stored building data for the target building from a remote stored data source, cooperate with a building scanning system located outside of the target building to obtain scanned building data, the scanned building data being obtained after receiving the request for virtual building plan data and including a first plurality of points on the exterior of the target building without a second plurality of points of the entire exterior of the target building that are possible to scan, the first plurality of points being a subset of the second plurality of points that is sufficient to spatially relate an interior floor plan of a virtual building plan to the target building, generate the virtual building plan data based upon the stored building data and the scanned building data based upon the request from the user, spatially relate the target building to the virtual building plan data based on the first plurality of points on the exterior of the target building in the scanned building data scanned from outside the target building relating to corresponding points on the virtual building plan, wherein the first plurality of points on the target building are linked to a plurality of respective GPS points of the exterior of the target building, interior points in the virtual building plan data are related to GPS points of the interior of the target building, and the interior points of the target building are related to the interior floor plan of a virtual building, and

cooperating with the processor to display the virtual building plan data to display the interior floorplan of the virtual building that is related spatially to the target building so that the virtual building plan data is available to manage the active incident.

25. The method of claim 24 wherein the processor is configured to generate the virtual building plan data for three-dimensions;

and wherein the method comprises using the user device controller to display the virtual building plan data in three-dimensions.

26. The method of claim 24 wherein the virtual building plan data comprises wall data;

and wherein the method comprises using the user device controller to display the virtual building plan data in an x-ray view through walls in the target building.