Aerial survey image capture system

• US 10,378,895 B2
• Filed: 08/28/2015
• Issued: 08/13/2019
• Est. Priority Date: 08/29/2014
• Status: Active Grant

• Current Assignee: Spookfish Innovations Pty., Ltd.
• Original Assignee: Spookfish Innovations Pty., Ltd.
• Inventors: Cope, Simon, von Bertouch, Michael
• Primary Examiner(s): Brown, Jr., Howard D
• Application Number:
  US15/503,998
• Publication Number:
  US 20170248421A1
• Time in Patent Office: 1,446 Days
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01S 19/51 Relative positioning
• CPC Class Codes: G03B 15/006 Apparatus mounted on flying objects
• CPC Class Codes: G05D 1/0055 with safety arrangements
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G08G 5/0021 located in the aircraft
• CPC Class Codes: G08G 5/0052 for cruising combined instruments indicating more than one navigational value G01C23/00
• CPC Class Codes: G08G 5/0086 for monitoring terrain radar or analogous systems specially adapted for terrain avoidance G01S13/935
• CPC Class Codes: G08G 5/045 Navigation or guidance aids, e.g. determination of anti-collision manoeuvers radar or analogous systems specially adapted for anti-collision between aircraft G01S13/933

Abstract

An aerial survey image capture system for a survey aircraft is disclosed. The system comprises a camera system arranged to capture successive images of ground beneath a survey aircraft. The camera system has associated camera parameters, and a loss of separation (LOS) avoidance system for a survey aircraft. The LOS avoidance system is arranged to determine a predicted closest point of approach (CPA) distance between the survey aircraft and the nearby aircraft based on their locations and movements, compare the CPA distance with a defined minimum separation distance corresponding to a LOS, and determine an estimate for at least one navigation parameter of the survey aircraft required for the CPA distance to remain above the defined minimum separation distance. The system is further arranged to modify camera system parameters so as to at least partially compensate for a change in survey efficiency when the estimated at least one navigation parameter is used to navigate the survey aircraft.

Claims

1. An aerial survey image capture system for a survey aircraft navigable using navigation parameters that include altitude, speed and direction, the system comprising:

a camera system arranged to capture successive images of ground beneath a survey aircraft as the survey aircraft travels on a defined flight path;

the camera system having associated camera parameters indicative of image capture characteristics of the camera system including defined image overlap between captured images;

the defined flight path and the camera parameters being such that sufficient multiple images are obtained of ground features that a bundle adjustment process can be carried out on the ground images and a photogrammetric solution produced based on the images;

the aerial survey image capture system comprising;

a loss of separation (LOS) avoidance system for a survey aircraft;

the LOS avoidance system arranged to;

receive information indicative of the location and movement of the survey aircraft and to receive information indicative of the location and movement of a nearby aircraft in the vicinity of the survey aircraft;

determine a predicted closest point of approach (CPA) distance between the survey aircraft and the nearby aircraft based on the received information indicative of the location and movement of the survey aircraft and the information indicative of the location and movement of the nearby aircraft;

compare the CPA distance with a defined minimum separation distance corresponding to a loss of separation (LOS); and

determine an estimate for at least one navigation parameter of the survey aircraft that is required for the CPA distance to remain above the defined minimum separation distance; and

a camera parameter modifier arranged to produce modified camera system parameters in response to the estimated at least one navigation parameter, the modified camera system parameters modifying characteristics of image capture by the camera system so as to substantially maintain the defined image overlap between captured images and thereby at least partially compensate for a change in survey efficiency when the estimated at least one navigation parameter is used to navigate the survey aircraft without modifying the defined flight path.

2. A system as claimed in claim 1, wherein the camera parameter modifier comprises an image capture controller arranged to control the rate of image capture by the camera system so as to at least partially compensate for a change in survey efficiency when the estimated at least one navigation parameter is used to navigate the survey aircraft.

3. A system as claimed in claim 2, comprising an image capture rate calculator arranged to calculate the image capture rate required in order to at least partially compensate for a change in survey efficiency when the estimated at least one navigation parameter is used to navigate the survey aircraft, the image capture rate calculator arranged to provide the image capture controller with the calculated required image capture rate, wherein the image capture rate calculator is arranged to calculate the image capture rate using the following formula:

4. A system as claimed in claim 1, wherein the camera parameter modifier comprises a camera movement controller arranged to control movement characteristics of the camera system so as to at least partially compensate for a change in survey efficiency when the estimated at least one navigation parameter is used to navigate the survey aircraft.

5. A system as claimed in claim 4, wherein the camera system includes a camera assembly arranged to sweep as images are captured, and the camera movement controller is arranged to increase or reduce the rate of sweep or the range of sweep of the camera assembly so as to modify the amount of overlap between adjacent captured images when the estimated at least one navigation parameter is used to navigate the survey aircraft.

6. A system as claimed in claim 1, comprising an ADS-B device arranged to receive information indicative of the location and movement of nearby aircraft in the vicinity of the survey aircraft.

7. A system as claimed in claim 6, wherein the ADS-B device is located on the survey aircraft.

8. A system as claimed in claim 7, wherein the ADS-B device is located at a ground location in the vicinity of the survey aircraft.

9. A system as claimed in claim 1, wherein the estimate for the at least one navigation parameter of the survey aircraft that is required for the CPA distance to remain above the defined minimum separation distance is determined at a ground location and wirelessly communicated to the survey aircraft.

10. A system as claimed in claim 1, wherein the system is arranged to calculate the time to the closest point of approach (CPA) distance based on the information indicative of the location and movement of the nearby aircraft and the information indicative of the location and movement of the survey aircraft, and wherein the system is arranged to calculate the closest point of approach (CPA) distance using the calculated time to the closest point of approach (CPA) distance.

11. A system as claimed in claim 1, wherein the system is arranged to display on the survey aircraft or produce audible information indicative of at least one navigation parameter of the survey aircraft that is required for the CPA distance to remain above the defined minimum separation distance.

12. A system as claimed in claim 1, wherein the at least one navigation parameter includes at least one of a speed of travel of the survey aircraft and an altitude of the survey aircraft.

13. A system as claimed in claim 1, wherein the system is arranged to determine whether the survey aircraft and the nearby aircraft are at different altitudes converging towards the same altitude, and if so, the system is arranged to calculate the predicted altitudes of the survey aircraft and the nearby aircraft at the CPA distance.

14. A system as claimed in claim 13, wherein if the altitude of the survey aircraft at the CPA distance and the altitude of the nearby aircraft at the CPA distance are not substantially the same, the system is arranged such that an estimate for the speed and/or direction of travel of the survey aircraft is not determined.

15. A method of capturing aerial survey images in a survey aircraft navigable using navigation parameters that include altitude, speed and direction, the method comprising:

capturing successive images of ground beneath a survey aircraft as the survey aircraft travels on a defined flight path using a camera system, the camera system having associated camera parameters indicative of image capture characteristics of the camera system including defined image overlap between captured images, the defined flight path and the camera parameters being such that sufficient multiple images are obtained of ground features that a bundle adjustment process can be carried out on the ground images and a photogrammetric solution produced based on the images;

receiving information indicative of the location and movement of the survey aircraft;

receiving information indicative of the location and movement of a nearby aircraft in the vicinity of the survey aircraft;

determining a predicted closest point of approach (CPA) distance between the survey aircraft and the nearby aircraft based on the received information indicative of the location and movement of the survey aircraft and the information indicative of the location and movement of the nearby aircraft;

comparing the CPA distance with a defined minimum separation distance corresponding to a loss of separation (LOS);

if the CPA distance is less than the defined minimum separation distance, determining an estimate for at least one navigation parameter of the survey aircraft that is required for the CPA distance to remain above the defined minimum separation distance; and

producing modified camera system parameters in response to the estimated at least one navigation parameter, the modified camera system parameters modifying characteristics of image capture by the camera system so as to substantially maintain the defined image overlap between captured images and thereby at least partially compensate for a change in survey efficiency when the estimated at least one navigation parameter is used to navigate the survey aircraft without modifying the defined flight path.

16. A method as claimed in claim 15, comprising controlling the rate of image capture by the camera system so as to at least partially compensate for a change in survey efficiency when the estimated at least one navigation parameter is used to navigate the survey aircraft.

17. A method as claimed in claim 16, comprising increasing or reducing the rate of image capture by the camera system so as to at least partially compensate for a change in survey efficiency when the estimated at least one navigation parameter is used to navigate the survey aircraft.

18. A method as claimed in claim 15, comprising controlling movement characteristics of the camera system so as to at least partially compensate for a change in survey efficiency when the estimated at least one navigation parameter is used to navigate the survey aircraft.

19. A method as claimed in claim 18, comprising sweeping a camera assembly as images are captured, and increasing or reducing the rate of sweep or the range of sweep of the camera assembly so as to modify the amount of overlap between adjacent captured images when the estimated at least one navigation parameter is used to navigate the survey aircraft.

20. A method as claimed in claim 15, further comprising:

calculating the time to the closest point of approach (CPA) distance based on the information indicative of the location and movement of the nearby aircraft and the information indicative of the location and movement of the survey aircraft; and

calculating the closest point of approach (CPA) distance using the calculated time to the closest point of approach (CPA) distance.

21. A method as claimed in claim 15, wherein the at least one navigation parameter includes at least one of a speed of travel of the survey aircraft and an altitude of the survey aircraft.

22. A method as claimed in claim 15, further comprising:

determining whether the survey aircraft and the nearby aircraft are at different altitudes converging towards the same altitude, and if so, calculating the predicted altitudes of the survey aircraft and the nearby aircraft at the CPA distance; and

determining an estimate for the speed and/or direction of travel of the survey aircraft if the altitude of the survey aircraft at the CPA distance and the altitude of the nearby aircraft at the CPA distance are not substantially the same.