Method and system for creating a photomap using a dual-resolution camera system

• US 10,358,235 B2
• Filed: 04/30/2013
• Issued: 07/23/2019
• Est. Priority Date: 04/11/2008
• Status: Active Grant

• Current Assignee: NearMap Pty Ltd.
• Original Assignee: NearMap Pty Ltd.
• Inventors: Nixon, Stuart William
• Primary Examiner(s): Navas, Jr., Edemio
• Application Number:
  US13/873,857
• Publication Number:
  US 20130235199A1
• Time in Patent Office: 2,275 Days
• Field of Search: None
• CPC Class Codes: B64D 47/08 Arrangements of cameras
• CPC Class Codes: B64G 1/1021 Earth observation satellites
• CPC Class Codes: B64G 1/1028 using optical means for mapping, surveying or detection, e.g. of intelligence
• CPC Class Codes: B64G 1/1085 Swarms and constellations
• CPC Class Codes: B64U 20/87 Mounting of imaging devices, e.g. mounting of gimbals
• CPC Class Codes: G01C 11/06 by comparison of two or more pictures of the same area
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors

Abstract

A method and system are presented in which images are captured from overview and detail imaging devices such that overview images are created with a first degree of redundancy, and detail images are captured with less overlap and a second degree of redundancy.

Claims

1. A method of creating a seamless photomap of a survey area, the method comprising:

(a) moving a vehicle relative to the survey area along a set of substantially parallel survey paths;

(b) capturing, during vehicle movement and via an overview imaging system carried by the vehicle, a sequence of overview images, each overview image depicting an overview area of the survey area, consecutive overview areas along each survey path having a first degree of forward overlap, adjacent overview areas associated with adjacent survey paths having side overlap;

(c) capturing, during vehicle movement and via a first detail imaging system carried by the vehicle, a sequence of detail image strips, each detail image strip comprising at least one detail image, each detail image depicting at least a portion of an overview area, each detail image having a higher resolution than a resolution of the overview image corresponding to the overview area, consecutive detail image strips along each survey path having a second degree of forward overlap, the second degree of overlap being smaller than the first degree of overlap, adjacent detail image strips associated with adjacent survey paths having side overlap, adjacent detail images within each strip having side overlap;

(d) identifying, in a plurality of the overview images and detail images, common features corresponding to common ground points;

(e) estimating, via bundle adjustment and using locations of the identified ground points in the plurality of overview images and detail images, an exterior orientation associated with each detail image; and

(f) merging, using at least some of the estimated exterior orientations, the detail images to create the seamless photomap.

2. The method of claim 1, wherein the first detail imaging system views vertically, and the seamless photomap contains a substantially vertical view.

3. The method of claim 2 further comprising:

capturing, via a second detail imaging system, a sequence of oblique detail image strips, and creating, from the oblique detail image strips, an oblique photomap of the survey area.

4. The method of claim 1, wherein the vehicle is one of a spacecraft, an airborne vehicle, an aircraft, a balloon, an unmanned aerial vehicle (UAV), a seagoing vessel, and a submarine.

5. The method of claim 1, wherein at least one of the imaging systems comprises at least one sensor, the at least one sensor being one of a digital image sensor, a push broom sensor, and a whisk broom sensor.

6. The method of claim 1, wherein at least one of the imaging systems comprises at least one sensor, the at least one sensor being one of an electromagnetic imager, a visible electromagnetic imager, an infrared electromagnetic imager, a thermographic imager, and an ultrasound imager.

7. A system for creating a seamless photomap of a survey area, the system comprising:

(a) a vehicle configured to move relative to the survey area along a set of substantially parallel survey paths;

(b) an overview imaging system disposed on the vehicle and configured to capture, during vehicle movement, a sequence of overview images, each overview image depicting an overview area of the survey area, consecutive overview areas along each survey path having a first degree of forward overlap, adjacent overview areas associated with adjacent survey paths having side overlap;

(c) a first detail imaging system disposed on the vehicle and configured to capture, during the vehicle movement, a sequence of detail image strips, each detail image strip including at least one detail image, each detail image depicting at least a portion of an overview area, each detail image having a higher resolution than a resolution of the overview image corresponding to the overview area, consecutive detail image strips along each survey path having a second degree of forward overlap, the second degree of overlap being smaller than the first degree of overlap, adjacent detail image strips associated with adjacent survey paths having side overlap, adjacent detail images within each strip having side overlap; and

(d) a computer system configured to;

identify, in a plurality of the overview images and detail images, common features corresponding to common ground points,

estimate, via bundle adjustment and using locations of the identified ground points in the plurality of overview images and detail images, an exterior orientation associated with each detail image, and

merging, using at least some of the estimated exterior orientations, the detail images to create the seamless photomap.

8. The system of claim 7, wherein the first detail imaging system views vertically, and the seamless photomap contains a substantially vertical view.

9. The system of claim 8, further comprising:

a second detail imaging system configured to capture a sequence of oblique detail image strips, wherein the computer system is further configured to create, from the oblique detail image strips, an oblique photomap of the survey area.

10. The system of claim 7, further comprising:

an enclosure within which the imaging systems are mounted.

11. The system of claim 10, wherein each imaging system is removably mounted within the enclosure.

12. The system of claim 10, wherein the enclosure is configured to be mounted to the exterior of the vehicle.

13. The system of claim 10, wherein the enclosure is configured to be removably mounted to the exterior of the vehicle.

14. The system of claim 7, wherein each of the imaging systems comprises at least one imaging device.

15. The system of claim 14, further comprising:

a plurality of data storage devices, each data storage device associated with a respective one of the imaging devices and configured to store images captured by the imaging device.

16. The system of claim 15, wherein each data storage device is a flash memory data storage device.

17. The system of claim 14, wherein at least one of the imaging devices comprises at least one sensor, the at least one sensor being one of a digital image sensor, a push broom sensor, and a whisk broom sensor.

18. The system of claim 7, wherein the vehicle is one of a spacecraft, an airborne vehicle, an aircraft, a balloon, an unmanned aerial vehicle (UAV), a seagoing vessel, and a submarine.

19. The system of claim 14, wherein at least one of the imaging devices comprises at least one sensor, the at least one sensor being one of an electromagnetic imager, a visible electromagnetic imager, an infrared electromagnetic imager, a thermographic imager, and an ultrasound imager.