Systems and methods for autonomous perpendicular imaging of test squares

• US 10,089,530 B2
• Filed: 01/30/2018
• Issued: 10/02/2018
• Est. Priority Date: 11/04/2016
• Status: Active Grant

• Current Assignee: Loveland Innovations, Inc.
• Original Assignee: Loveland Innovations, LLC
• Inventors: Loveland, Jim, Larson, Leif, Christiansen, Dan, Christiansen, Tad, Christiansen, Cam
• Primary Examiner(s): Pham, Nam D
• Application Number:
  US15/883,172
• Publication Number:
  US 20180165505A1
• Time in Patent Office: 245 Days
• Field of Search: 348144
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30184 Infrastructure
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: G06T 7/38 Registration of image sequences
• CPC Class Codes: G06V 20/13 Satellite images
• CPC Class Codes: G06V 20/17 taken from planes or by drones
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G09B 9/30 Simulation of view from aircraft
• CPC Class Codes: G09B 9/301 by computer-processed or -generated image
• CPC Class Codes: G09B 9/302 the image being transformed by computer processing, e.g. updating the image to correspond to the changing point of view
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

An unmanned aerial vehicle (UAV) assessment and reporting system may utilize one or more scanning techniques to provide useful assessments and/or reports for structures and other objects. The scanning techniques may be performed in sequence and optionally used to further fine tune each subsequent scan. The system may include shadow elimination, annotation, and/or reduction for the UAV itself and/or other objects. A UAV may receive or determine a pitch of roof of a structure. The pitch of the roof may be used to capture perpendicular images of sample regions that have a defined area-squared.

Claims

1. An unmanned aerial vehicle (UAV) assessment system for capturing orthogonal images of sample regions of having a target square footage, comprising:

a camera to capture images of at least a portion of a roof of a structure; and

an imaging system to;

adjust a tilt angle of the camera of the UAV to a non-zero angle relative to the downward direction to align an optical axis of the camera substantially perpendicular to the surface of the roof of the structure, and

capture an image of a portion of the roof of the structure that corresponds to a sample region of the surface of the roof having a target square footage with the optical axis of the camera aligned perpendicular to the surface of the roof by adjusting the tilt angle of the camera of the UAV, based at least partially on the pitch of the surface of the roof.

2. The UAV assessment system of claim 1, wherein the pitch of the surface of the roof is determined from a three-dimensional mode of at least a portion of the structure.

3. The UAV assessment system of claim 1, further comprising a pitch determination system to determine the pitch of a surface of the roof.

4. The UAV assessment system of claim 3, wherein the pitch determination system is part of a remote system in communication with the UAV.

5. The UAV assessment system of claim 1, wherein the target square footage corresponds to a target area defined in square meters.

6. The UAV assessment system of claim 1, wherein the sample region is square.

7. The UAV assessment system of claim 1, wherein the sample region is rectangular.

8. The UAV assessment system of claim 1, wherein the sample region comprises one of a circle and an oval.

9. The UAV assessment system of claim 1, wherein the sample region of the surface of the roof having the target square footage fills an entire frame of the captured image.

10. The UAV assessment system of claim 1, wherein the captured image of the sample region of the surface of the roof having the target square footage is cropped to fill an entire frame of the captured image with the target square footage.

11. The UAV assessment system of claim 1, wherein the target square footage comprises 100 square feet.

12. The UAV assessment system of claim 1, wherein at least one of the distance at which the image is captured and the field of view of the camera is user-specified.

13. The UAV assessment system of claim 1, wherein the camera comprises one of a visible light imaging camera and an infrared imaging camera.

14. A method for determining a pitch of a roof and imaging sample regions having a target area-squared (A²), comprising:

identifying a pitch of a surface of a roof of a structure, wherein the roof is at an angle relative to a downward direction; and

capturing an image of at least a portion of the surface of the roof of the structure that includes a sample region of the surface with a predefined target area-squared (A²) using an imaging system with an optical axis of a camera aligned perpendicular to the surface of the roof at a non-zero angle relative to the downward direction by adjusting a tilt angle of the camera of the UAV, based on the identified pitch of the surface of the roof.

15. The method of claim 14, wherein the camera includes an image sensor having an effective aspect ratio that is one of 2:

2, 4;

3, and 16;

9.

16. The method of claim 14, wherein the sample region of the surface of the roof having the target area-squared fills an entire frame of the captured image without cropping.

17. The method of claim 14, wherein an image sensor of the camera includes a rectangular aspect ratio, and wherein the predefined area-squared (A²) fills an entire rectangular frame.

18. The method of claim 14, wherein the sample region is one of:

rectangular, square, and triangular.

19. The method of claim 14, wherein the predefined area-squared (A²) comprises a 100 square-foot test square.