Automated system and methodology for feature extraction

• US 10,402,676 B2
• Filed: 02/09/2017
• Issued: 09/03/2019
• Est. Priority Date: 02/15/2016
• Status: Active Grant

• Current Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Original Assignee: Pictometry International Corporation (Eagleview Technologies, Inc. /Wa/)
• Inventors: Wang, Yandong, Giuffrida, Frank
• Primary Examiner(s): Bayat, Ali
• Application Number:
  US15/428,860
• Publication Number:
  US 20170236024A1
• Time in Patent Office: 936 Days
• Field of Search: 382201
• CPC Class Codes: G06F 18/2321 using statistics or function optimisation, e.g. modelling of probability density functions
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30184 Infrastructure
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/763 Non-hierarchical techniques, e.g. based on statistics of modelling distributions
• CPC Class Codes: G06V 20/176 Urban or other man-made structures
• CPC Class Codes: G06V 20/64 Three-dimensional objects

Abstract

An automated method performed by at least one processor running computer executable instructions stored on at least one non-transitory computer readable medium, comprising: classifying first data points identifying at least one man-made roof structure within a point cloud and classifying second data points associated with at least one of natural structures and ground surface to form a modified point cloud; identifying at least one feature of the man-made roof structure in the modified point cloud; and generating a roof report including the at least one feature.

Claims

1. One or more non-transitory computer readable medium storing a set of computer executable instructions for running on one or more computer systems that when executed cause the one or more computer systems to:

classify at least one feature within an image as a man-made structure, wherein the man-made structure is a building having a roof, wherein classification of the feature as a man-made structure includes;

analyzing data points within a point cloud indicative of a man-made structure, a natural structure, and a ground structure to automatically classify certain of the data points within the point cloud representing the man-made structure as the man-made structure;

determining first information about the man-made structure by analyzing the data points classified as the man-made structure;

correlating the data points within the point cloud classified as the man-made structure with one or more images;

spectrally analyze image raster content of at least one section of the one or more images correlated with the data points within the point cloud that are classified as the man-made structure to generate second information in which the second information is an update of the first information; and

determine an estimated roof pitch by analyzing the one or more images.

2. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 1, wherein the first information is a boundary of the building.

3. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 1, wherein the second information is a boundary of the building.

4. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 1, further comprising generating a roof report including one image showing the roof and the estimated roof pitch.

5. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 1, wherein classification of man-made structures includes determination of shape of a grouping of data points.

6. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 5, wherein determination of shape of the grouping of data points includes analyzing the grouping of data points to determine a variation of surface normal direction between data points.

7. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer system of claim 1, further comprising spatially cataloguing location of data points associated with the image.

8. One or more non-transitory computer readable medium storing a set of computer executable instructions for running on one or more computer systems that when executed cause the one or more computer systems to:

classify at least one feature within an image as a man-made structure, wherein classification of the feature as a man-made structure includes;

analyzing data points within a point cloud indicative of a man-made structure, a natural structure, and a ground structure to automatically classify certain of the data points within the point cloud representing the man-made structure as the man-made structure, wherein the data points having a Z value above a first elevation are classified as at least one of the man-made structure and the natural structure;

determining first information about the man-made structure by analyzing the data points classified as the man-made structure, wherein the first information includes an outline of the man-made structure;

correlating the data points within the point cloud classified as the man-made structure with one or more images; and

spectrally analyze image raster content of at least one section of the one or more images correlated with the data points within the point cloud that are classified as the man-made structure to generate second information in which the second information is an update of the first information.

9. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 8, wherein the outline is a first outline, and wherein the second information is a second outline of the man-made structure based upon the first outline.

10. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer system of claim 8, wherein the man-made structure is a building having a roof.

11. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 10, further comprising determining an estimated roof pitch by analyzing data points within the point cloud.

12. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 10, further comprising determining an estimated roof pitch by analyzing the one or more images.

13. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer system of claim 10, further comprising generating a roof report including one image showing the roof and an estimated roof pitch.

14. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 8, wherein to classify at least one feature within the image as a man-made structure includes determination of shape of a grouping of data points.

15. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 14, wherein determination of shape of the grouping of data points includes analyzing the grouping of data points to determine a variation of surface normal direction between data points.

16. One or more non-transitory computer readable medium storing a set of computer executable instructions for running on one or more computer system that when executed cause the one or more computer systems to:

classify at least one feature within an image as a man-made structure, wherein classification of the feature as a man-made structure includes;

analyzing data points within a point cloud indicative of a man-made structure, a natural structure, and a ground structure to automatically classify certain of the data points within the point cloud representing the man-made structure as the man-made structure;

determining first information about the man-made structure by analyzing the data points classified as the man-made structure;

correlating the data points within the point cloud classified as the man-made structure with one or more images; and

spectrally analyze image raster content of at least one section of the one or more images correlated with the data points within the point cloud that are classified as the man-made structure, including grouping of data points based on one or more similar characteristics, to generate second information in which the second information is an update of the first information.

17. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer system of claim 16, wherein similar characteristics include similar spectral signatures.

18. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer system of claim 16, wherein similar characteristics include similar thermal signatures.

19. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer system of claim 16, wherein the man-made structure is a building having a roof.

20. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 19, further comprising determining an estimated roof pitch by analyzing data points within the point cloud.

21. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 19, further comprising determining an estimated roof pitch by analyzing the one or more images.

22. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer system of claim 19, further comprising generating a roof report including one image showing the roof and an estimated roof pitch.

23. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 16, wherein to classify at least one feature within the image as a man-made structure includes determination of shape of a grouping of data points.

24. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 23, wherein determination of shape of the grouping of data points includes analyzing the grouping of data points to determine a variation of surface normal direction between data points.

25. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 16, wherein the first information is a boundary of the man-made structure.

26. The one or more non-transitory computer readable medium storing the set of computer executable instructions for running on one or more computer systems of claim 16, wherein the second information is a boundary of the man-made structure.