Methods and systems for capturing the condition of a physical structure via chemical detection

• US 10,176,632 B2
• Filed: 02/22/2018
• Issued: 01/08/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Original Assignee: State Farm Mutual Automobile Insurance Company (State Farm)
• Inventors: Freeman, James M., Schmidgall, Roger D., Boyer, Patrick H., Christopulos, Nicholas U., Maurer, Jonathan D., Tofte, Nathan L., Jordan, II, Jackie O.
• Primary Examiner(s): Du, Haixia
• Application Number:
  US15/902,354
• Publication Number:
  US 20180180543A1
• Time in Patent Office: 320 Days
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: G01N 21/64 Fluorescence; Phosphorescence
• CPC Class Codes: G01N 21/8851 Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002
• CPC Class Codes: G01N 22/02 Investigating the presence of flaws
• CPC Class Codes: G01N 2201/06113 Coherent sources; lasers
• CPC Class Codes: G01N 2201/10 Scanning
• CPC Class Codes: G01S 13/89 for mapping or imaging
• CPC Class Codes: G01S 15/89 for mapping or imaging
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G01S 7/4817 relating to scanning
• CPC Class Codes: G06F 30/13 Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
• CPC Class Codes: G06Q 30/0278 Product appraisal
• CPC Class Codes: G06Q 30/0283 Price estimation or determination
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: G06Q 50/16 Real estate
• CPC Class Codes: G06Q 50/163 Real estate management
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation
• CPC Class Codes: G06T 2207/10028 : Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/10032 : Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 7/0002 : Inspection of images, e.g. flaw detection
• CPC Class Codes: H04N 13/106 : Processing image signals for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/254 : in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 13/271 : wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 13/275 : from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control
• CPC Class Codes: H04R 23/008 : using optical signals for detecting or generating sound

Abstract

In a computer-implemented method and system for capturing the condition of a structure, the structure is scanned with a three-dimensional (3D) scanner. The 3D scanner generates 3D data. A point cloud or 3D model is constructed from the 3D data. The point cloud or 3D model is then analyzed to determine the condition of the structure.

Claims

1. A computer-implemented method of inspecting a structure, the method comprising:

spraying a chemical on at least part of a structure, wherein the at least part of the structure is a roof of the structure;

detecting, via one or more processors, luminescence emanating from the chemical sprayed on the at least part of the structure;

analyzing, via the one or more processors, the detected luminescence emanating from the chemical sprayed on the at least part of the structure to identify a three-dimensional (3D) feature corresponding to potential damage; and

generating, via the one or more processors, an estimation of a condition of the structure based upon the three-dimensional feature identified from the detected luminescence.

2. The computer-implemented method of claim 1, wherein spraying a chemical on at least part of a structure comprises spraying a phosphorescent chemical.

3. The computer-implemented method of claim 1, the method further comprising generating, via an image sensor, image data based upon one or more electromagnetic (EM) waves that are emanating from the structure and that are received at the image sensor.

4. The computer-implemented method of claim 3, the method further comprising analyzing the generated image data to detect the luminescence emanating from the chemical sprayed on the at least part of the structure to determine a distribution of the chemical across a plurality of subareas of a scanned area of the structure.

5. The computer-implemented method of claim 4, the method further comprising analyzing the generated image data to detect a degree of luminescence for each of the plurality of subareas of the scanned area.

6. The computer-implemented method of claim 3, wherein generating, via the image sensor, the image data based upon the EM waves that are emanating from a scanned area of the structure and that are received at the image sensor comprises:

generating the image data based upon one or more infrared waves that are received at the image sensor.

7. The computer-implemented method of claim 3, wherein generating, via the image sensor, the image data based upon the EM waves that are emanating from a scanned area of the structure and that are received at the image sensor comprises:

generating the image data based upon one or more ultraviolet waves that are received at the image sensor.

8. The computer-implemented method of claim 1, the method further comprising generating, via an image sensor, image data based upon one or more electromagnetic (EM) waves that are emanating from the structure and that are received at the image sensor.

9. The computer-implemented method of claim 8, the method further comprising analyzing the generated image data to detect the luminescence emanating from the chemical sprayed on the at least part of the structure for each of the plurality of subareas of a scanned area of the structure.

10. The computer-implemented method of claim 1, the method further comprising analyzing, by the one or more processors, the detected luminescence to identify a crack or a crevice.

11. The computer-implemented method of claim 1, the method further comprising causing the one or more processors to calculate a financial cost estimate based upon the estimation of the condition of the structure.

12. The computer-implemented method of claim 1, the method further comprising constructing, by the one or more processors, a 3D model from a stored point cloud.

13. The computer-implemented method of claim 1, the method further comprising generating, via an image sensor, image data based upon one or more electromagnetic (EM) waves reflected from the chemical.

14. The computer-implemented method of claim 1, the method further comprising generating, via an image sensor, image data based upon one or more electromagnetic (EM) waves that are emanating from the structure and that are received at the image sensor, wherein the image sensor is one or more 3D scanners that are physically connected to a device for conveying the image sensor, the device being an aerial device or a non-aerial device;

and

wherein the method further comprises moving the device to a position where the image sensor can receive the one or more EM waves.

15. The computer-implemented method of claim 14, wherein the device includes an antenna for wirelessly receiving control commands.

16. A property inspection system, the property inspection system comprising:

an image sensor configured to generate image data based upon one or more electromagnetic (EM) waves that are emanating from a chemical sprayed on at least part of the structure and that are received at the image sensor, wherein the at least part of the structure includes a roof of the structure;

one or more processors communicatively coupled to the image sensor, the one or more processors configured to;

(i) analyze the image data generated by the image sensor to detect luminescence emanating from the chemical sprayed on the at least part of the structure;

(ii) analyze the detected luminescence to identify a three-dimensional (3D) feature corresponding to potential damage; and

(iii) generate an estimation of a condition of the structure based upon the three-dimensional feature identified from the detected luminescence.

17. The property inspection system of claim 16, further comprising a device for conveying the image sensor, wherein the image sensor is physically connected to the device, the device being an aerial device or a non-aerial device.

18. The property inspection system of claim 17, wherein the device includes a control system for autonomous operation.

19. The property inspection system of claim 16, wherein one or more 3D scanners are physically connected to a device for conveying the one or more 3D scanners, the device being an aerial device or a non-aerial device;

and

wherein the one or more processors are further configured to cause the one or more 3D scanners to scan a subarea having a topographical feature.

20. A computer-implemented method of inspecting a structure, the method comprising:

spraying a chemical on at least part of a structure;

detecting, via one or more processors, luminescence emanating from the chemical sprayed on the at least part of the structure;

analyzing, via the one or more processors, the detected luminescence emanating from the chemical sprayed on the at least part of the structure to identify a three-dimensional (3D) feature corresponding to potential damage;

generating, via the one or more processors, an estimation of a condition of the structure based upon the three-dimensional feature identified from the detected luminescence;

generating, via an image sensor, image data based upon one or more electromagnetic (EM) waves that are emanating from the structure and that are received at the image sensor and

analyzing the generated image data to detect (i) the luminescence emanating from e chemical sprayed on the at least part of the structure to determine a distribution of the chemical across a plurality of subareas of a scanned area of the structure, and (ii) a degree of luminescence for each of the plurality of subareas of the scanned area.