Systems and methods for autonomous perpendicular imaging of test squares

• US 10,810,426 B2
• Filed: 11/15/2019
• Issued: 10/20/2020
• Est. Priority Date: 11/04/2016
• Status: Active Grant

• Current Assignee: Loveland Innovations, Inc.
• Original Assignee: Loveland Innovations, LLC
• Inventors: Loveland, Jim, Larson, Leif, Christiansen, Dan, Christiansen, Tad, Christiansen, Cam
• Primary Examiner(s): Pham, Nam D
• Application Number:
  US16/685,295
• Publication Number:
  US 20200089931A1
• Time in Patent Office: 340 Days
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30184 Infrastructure
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: G06T 7/38 Registration of image sequences
• CPC Class Codes: G06V 20/17 taken from planes or by drones
• CPC Class Codes: G06V 20/176 Urban or other man-made structures
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G09B 29/006 Representation of non-cartographic information on maps, e.g. population distribution, wind direction, radiation levels, air and sea routes
• CPC Class Codes: G09B 29/106 using electronic means
• CPC Class Codes: G09B 9/30 Simulation of view from aircraft
• CPC Class Codes: G09B 9/301 by computer-processed or -generated image
• CPC Class Codes: G09B 9/302 the image being transformed by computer processing, e.g. updating the image to correspond to the changing point of view
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

An assessment and reporting system may utilize one or more scanning techniques to provide useful assessments and/or reports for structures and other objects. The scanning techniques may be performed in sequence and optionally used to further fine-tune each subsequent scan. The system may receive or determine a pitch of a surface of a structure or otherwise orthogonally align an optical axis of a camera with respect to a planar surface. An imaging system may capture perpendicular images of sample regions that have a defined area-squared.

Claims

1. An imaging system for a vehicle to capture orthogonal images of a surface at an angle with respect to a downward direction, comprising:

a positioning system to determine a position of a vehicle relative to a surface of a structure that is at an angle relative to a downward direction;

a tilt angle determination system to determine a tilt angle for a camera to orthogonally align an optical axis of the camera with the angled surface;

a camera control module to implement at least one of;

adjust the tilt angle of the camera to orthogonally align the optical axis of the camera with respect to the angled surface, and

adjust a location of the camera relative to the surface to facilitate orthogonal alignment of the optical axis of the camera with respect to the angled surface.

2. The imaging system of claim 1, wherein the tilt angle determination system comprises at least one sensor to measure distance, wherein each sensor is configured to measure a distance to the surface at a known angle relative to the optical axis of the camera.

3. The imaging system of claim 1, wherein the tilt angle determination system comprising an image processor to process at least one captured image of the surface to determine an angle of the surface.

4. The imaging system of claim 1, wherein the tilt angle determination system comprising an image processor to process at least one captured image of the surface to determine an angle of the surface.

5. A system, comprising:

a camera to capture images of a portion of a roof of a structure; and

an imaging system to;

adjust an angle of the camera to a non-zero angle relative to a downward direction to align an optical axis of the camera substantially orthogonal to an angled surface of the roof, and

capture an image of the angled surface of the roof with the optical axis of the camera aligned perpendicular to the angled surface.

6. The system of claim 5, further comprising a camera control module to align the angle of the camera substantially orthogonal with respect to the angled surface of the roof based three equidistant distances measured by a sensor of at a common angle relative to the optical axis of the camera.

7. The system of claim 5, wherein a pitch of the surface of the roof is determined from a three-dimensional model of at least a portion of the structure.

8. The system of claim 5, further comprising a pitch determination system to determine the angled surface of the roof, and wherein the pitch of the roof is used to adjust the angle of the camera of to align the optical axis of the camera substantially orthogonal to the angled surface of the roof.

9. The system of claim 8, wherein the pitch determination system is part of a remote system in communication with the UAV.

10. The system of claim 8, wherein the pitch determination system comprising an image processing system to determine an angle of the surface of the roof based on at least one captured image.

11. The system of claim 10, wherein the image processing system utilizes computer vision to identify an angle of the surface of the roof.

12. The system of claim 5, further comprising a pitch determination system to determine a pitch of the angled surface of the roof, and wherein the pitch of the roof is used adjust the angle of the camera of to align the optical axis of the camera substantially orthogonal to the angled surface of the roof.

13. The system of claim 5, wherein the imaging system is configured to capture an image with a target square footage of 100 square feet.

14. The system of claim 5, wherein the camera comprises one of a visible light imaging camera and an infrared imaging camera.

15. A method, comprising:

identifying a non-zero angle with respect to ground to which a camera can be adjusted for a given location relative to a structure to align an optical axis of the camera orthogonal to an angled surface of a roof of a structure; and

capturing an image of at least a portion of the angled surface of the roof of the structure that includes a sample region of the surface with a predefined target area-squared (A²) using an imaging system with the optical axis of the camera aligned perpendicular to the angled surface based on the identified non-zero angle.

16. The method of claim 15, wherein the camera includes an image sensor having an effective aspect ratio that is one of 2:

2, 3;

2, 4;

3, and 16;

9.

17. The method of claim 15, wherein the sample region of the surface of the roof having the target area-squared fills an entire frame of the captured image without cropping.

18. The method of claim 15, wherein an image sensor of the camera includes a rectangular aspect ratio, and wherein the predefined area-squared (A²) fills an entire rectangular frame.

19. The method of claim 15, wherein the sample region is one of:

rectangular, square, and triangular.

20. The method of claim 15, wherein the predefined area-squared (A²) comprises a 100 square-foot “

test square”

that is rectangular.