Exterior hybrid photo mapping
First Claim
1. A method on a user equipment (UE), the method comprising:
- capturing a plurality of images of an exterior of a structure when traversing a plurality of locations in a vicinity of the structure;
capturing a plurality of measurement sets, wherein each measurement set corresponds to at least one image in the plurality of images and each measurement set comprises Inertial Measurement Unit (IMU) measurements and available wireless measurements with correction information for the available wireless measurements;
estimating, based, in part, on the plurality of images and the corresponding plurality of measurement sets, a 3D structural envelope of the structure and a trajectory of the UE;
transmitting information comprising the estimated trajectory of the UE, the 3D structural envelope, the plurality of images, and the corresponding measurement sets, to a first server wirelessly coupled to the UE; and
receiving, based, in part, on the transmitted information, a corrected trajectory of the UE registered to absolute coordinates and a 3D structural envelope of the structure registered to the absolute coordinates.
1 Assignment
0 Petitions
Accused Products
Abstract
Embodiments disclosed pertain to the use of user equipment (UE) for the generation of a 3D exterior envelope of a structure based on captured images and a measurement set associated with each captured image. In some embodiments, a sequence of exterior images of a structure is captured and a corresponding measurement set comprising Inertial Measurement Unit (IMU) measurements, wireless measurements (including Global Navigation Satellite (GNSS) measurements) and/or other non-wireless sensor measurements may be obtained concurrently. A closed-loop trajectory of the UE in global coordinates may be determined and a 3D structural envelope of the structure may be obtained based on the closed loop trajectory and feature points in a subset of images selected from the sequence of exterior images of the structure.
49 Citations
30 Claims
-
1. A method on a user equipment (UE), the method comprising:
-
capturing a plurality of images of an exterior of a structure when traversing a plurality of locations in a vicinity of the structure; capturing a plurality of measurement sets, wherein each measurement set corresponds to at least one image in the plurality of images and each measurement set comprises Inertial Measurement Unit (IMU) measurements and available wireless measurements with correction information for the available wireless measurements; estimating, based, in part, on the plurality of images and the corresponding plurality of measurement sets, a 3D structural envelope of the structure and a trajectory of the UE; transmitting information comprising the estimated trajectory of the UE, the 3D structural envelope, the plurality of images, and the corresponding measurement sets, to a first server wirelessly coupled to the UE; and receiving, based, in part, on the transmitted information, a corrected trajectory of the UE registered to absolute coordinates and a 3D structural envelope of the structure registered to the absolute coordinates. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A User Equipment (UE) comprising:
-
a camera configured to capture a plurality of images of an exterior of a structure when traversing a plurality of locations in a vicinity of the structure; a plurality of sensors, the plurality of sensors comprising an Inertial Measurement Unit (IMU); a wireless module configured to take wireless measurements of available wireless signals, and acquire correction information for the wireless measurements; a processor, coupled to the camera, the plurality of sensors and the wireless module, wherein the processor is configured to; obtain the plurality of images of the exterior of the structure; obtain a plurality of measurement sets, wherein each measurement set corresponds to at least one image in the plurality of images, and each measurement set comprises IMU measurements and the wireless measurements with correction information for the wireless measurements; estimate, based, in part, on the plurality of images and the corresponding plurality of measurement sets, a 3D structural envelope of the structure and a trajectory of the UE; transmitting information comprising the estimated trajectory of the UE, and the 3D structural envelope, the plurality of images, and the corresponding measurement sets, to a first server wirelessly coupled to the UE; and receive, based, in part, on the transmitted information, a corrected trajectory of the UE registered to absolute coordinates and a 3D structural envelope of the structure registered to the absolute coordinates. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24)
-
-
25. A User Equipment (UE) comprising:
-
imaging means configured to capture a plurality of images of an exterior of a structure when traversing a plurality of locations in a vicinity of the structure; sensing means, the sensing means comprising an Inertial Measurement Unit (IMU) means; wireless measurement means configured to take wireless measurements of available wireless signals, and acquire correction information for the wireless measurements; means for obtaining the plurality of images of the exterior of the structure; means for obtaining a plurality of measurement sets, wherein each measurement set corresponds to at least one image in the plurality of images, and each measurement set comprises IMU measurements and the wireless measurements with correction information for the wireless measurements; means for estimating, based, in part, on the plurality of images and the corresponding plurality of measurement sets, a 3D structural envelope of the structure and a trajectory of the UE; means for transmitting information comprising the estimated trajectory of the UE, the 3D structural envelope, the plurality of images, and the corresponding measurement sets, to a server wirelessly coupled to the UE; and means for receiving, based, in part, on the transmitted information, a corrected trajectory of the UE registered to absolute coordinates and a 3D structural envelope of the structure registered to the absolute coordinates. - View Dependent Claims (26)
-
-
27. A non-transitory computer-readable medium comprising instructions, which, when executed by a processor, cause the processor to be configured to:
-
capture a plurality of images of an exterior of a structure when traversing a plurality of locations in a vicinity of the structure; capture a plurality of measurement sets, wherein each measurement set corresponds to at least one image in the plurality of images and each measurement set comprises Inertial Measurement Unit (IMU) measurements and available wireless measurements with correction information for the available wireless measurements; estimate, based, in part, on the plurality of images and the corresponding plurality of measurement sets, a 3D structural envelope of the structure and a trajectory of the UE; transmit information comprising the estimated trajectory of the UE, and the 3D structural envelope, the plurality of images, and the corresponding measurement sets, to a first server wirelessly coupled to the UE; and receive, based, in part, on the transmitted information, a corrected trajectory of the UE registered to absolute coordinates and a 3D structural envelope of the structure registered to the absolute coordinates. - View Dependent Claims (28, 29, 30)
-
Specification