Method and Apparatus for Automated Camera Location and Orientation with Image Processing and Alignment to Ground Based Reference Point(s)

• US 20130027554A1
• Filed: 05/09/2012
• Published: 01/31/2013
• Est. Priority Date: 07/31/2011
• Status: Abandoned Application

• Current Assignee: William D. Meadow
• Original Assignee: William D. Meadow
• Inventors: Meadow, William D.
• Application Number:
  US13/467,974
• Publication Number:
  US 20130027554A1
• Time in Patent Office: Days
• US Class Current: 348/144
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

The present invention relates to methods and apparatus to obtain precise location and orientation of an aerial imaging platform and photographs taken from its cameras via image pattern matching using mathematical algorithms and known locations of artifacts. More specifically, software techniques to implement freely available global road mapping data to enable low cost and highly automated registration of aerial images that include highly accurate positional data.

Claims

1. Apparatus for processing one or more frame(s) of image data captured from an Aircraft, the apparatus comprising:

a computer server comprising a processor and a storage device; and

executable software stored on the storage device and executable on demand, the software operative with the processor to cause the computer server to;

receive digital data comprising one or more Aerial Images with Location Data of a subject;

wherein the one or more Aerial Images with Location Data are captured by one or more image capturing devices firmly mounted to an Aircraft;

identify at least one Target Feature for Alignment within the one or more Aerial Images with Location Data of a subject;

extract and align the one or more Aerial Images with Location Data with Available Mapping Data; and

calculate a significantly more accurate location and viewpoint orientation of the one or more image capturing devices at a point in time during flight during the capture of the one or more Aerial Images with Location Data.

2. The Apparatus of claim 1, wherein the software is additionally operative with the processor to cause the computer server to:

determine an image capturing device'"'"'s Analysis Domain for the location and orientation of the one or more image capturing devices from measurements from one or more sensing devices.

3. The apparatus of claim 2, wherein the one or more location sensing devices comprise a global positioning system device.

4. The apparatus of claim 1, wherein the extraction and alignment of the one or more Aerial Images with Location Data with the Available Mapping Data is performed in relation to one or more extracted identified stationary Target Feature(s) for alignment.

5. The Apparatus of claim 4, wherein the software is additionally operative with the processor to cause the computer server to:

manipulate the received data to Flatten one or more Aerial Images with Location Data in relation to one or both an angle of capture and perspective.

6. The apparatus of claim 4, wherein the at least one of the identified stationary Target Artifact for Alignment comprises one or more of a centerline of a roadway, a manmade structure, a waterway, and a boundary resulting from a wavelength other than light visible to a human.

7. The apparatus of claim 4, wherein the software is additionally operative with the processor to cause the computer server to:

enhance at least one identified stationary Target Artifact for Alignment for edge detection via software techniques.

8. The apparatus of claim 5, wherein the extracted Target Feature(s) for Alignment are used to compare one or more of the Flattened one or more Aerial Images with Location Data with Available Mapping Data to generate correction values which account for factors that influence the orientation of the image capturing device comprise one or more of:

roll, pitch, yaw and heading.

9. The apparatus of claim 8, wherein the correction values generated are stored for the processing of other Aerial Images with Location Data captured with other image capturing devices having different orientations which are also firmly mounted to the Aircraft.

10. The apparatus of claim 1, wherein the software is additionally operative with the processor to cause the computer server to:

Overlay Metadata on a generated composite image descriptive of the composite image.

11. The apparatus of claim 10, wherein the software is additionally operative with the processor to cause the computer server to:

overlay links to additional data related to the generated composite image.

12. The apparatus of claim 1, wherein the one or more Aerial Images are captured with multiple image capturing devices from a capture position oblique to the subject.

13. Apparatus for processing a frame of image data captured from an Aircraft, the apparatus comprising:

a computer server comprising a processor and a storage device; and

executable software stored on the storage device and executable on demand, the software operative with the processor to cause the server to;

receive digital data comprising one or more Aerial Images with Location Data of a subject captured by one or more image capturing devices firmly mounted to an Aircraft;

receive digital available Mapping Data comprising location data;

identify at least one Target Feature for Alignment found in the Available Mapping Data within the one or more Aerial images;

match the identified Target Feature for Alignment in the one or more Aerial Image(s) with Location Data with the same Target Feature for Alignment in the mapping data; and

calculate a significantly more accurate location of the subject from the alignment of the identified Target Feature(s) for Alignment.

14. The Apparatus of claim 13, wherein the software is additionally operative with the processor to cause the computer server to:

manipulate the received data to Flatten one or more Aerial Images with Location Data in relation to one or both an angle of capture and perspective.

15. The apparatus of claim 14, wherein the Target Feature(s) for Alignment of the Available Mapping Data are used to compare one or more of the Flattened one or more Aerial Images with Location Data to generate correction values which account for factors that influence the orientation of the image capturing device comprise one or more of:

roll, pitch, yaw and heading.

16. The apparatus of claim 15, wherein the correction values generated are stored for the processing of other Aerial Images with Location Data captured with other image capturing devices having different orientations which are also firmly mounted to the Aircraft.

17. The apparatus of claim 13, wherein the one or more Aerial Images are captured with multiple image capturing devices from a capture position oblique to the subject.

18. Apparatus for processing a frame of image data captured from an Aircraft, the apparatus comprising:

a computer server comprising a processor and a storage device; and

executable software stored on the storage device and executable on demand, the software operative with the processor to cause the server to;

receive digital data comprising one or more Aerial Images with Location Data of a subject, wherein the one or more Aerial Images with Location Data of a subject are captured by one or more image capturing device(s) firmly mounted to the Aircraft;

synthesize one of the one or more Aerial Images with Location Data with a previous frame using a distance difference between frames value; and

minimize pixel differences between frames by varying the roll, pitch, yaw and heading and location of the field of view of the image capturing device.

19. The apparatus of claim 18, wherein the one or more Aerial Images are captured with multiple image capturing devices from a capture position oblique to the subject.

20. The Apparatus of claim 18, wherein the software is additionally operative with the processor to cause the computer server to:

determine an image capturing device'"'"'s Analysis Domain for the roll, pitch, yaw and heading and location of the one or more image capturing devices from measurements obtained from one or more sensing devices.