System and method providing automatic alignment of aerial/satellite imagery to known ground features
First Claim
1. A computer-implemented method performed by a computing device where the computing device includes at least a processor for executing instructions from a memory, the method comprising:
- segmenting, via at least the processor, acquired image data to generate extracted boundary data, where the acquired image data is one of aerial image data or satellite image data representing features of a portion of the Earth'"'"'s surface at incorrect geo-spatial coordinates, and where the extracted boundary data represents boundaries of the features at the incorrect geo-spatial coordinates, wherein the segmenting comprises;
performing at least a thresholding operation on the acquired image data to generate binary image data;
performing at least a morphological operation on the binary image data to generate noise-reduced image data; and
performing at least an edge detection operation on the noise-reduced image data to generate the extracted boundary data;
matching, via at least the processor, the extracted boundary data to expected boundary data derived from a set of ground truth data, where the expected boundary data represents the boundaries of the features at correct geo-spatial coordinates;
estimating, via at least the processor, adjustment parameters representing an amount and a type of a geo-spatial misalignment between the extracted boundary data and the expected boundary data;
applying, via at least the processor, the adjustment parameters to the acquired image data to adjust the acquired image data to generate a corrected image having corrected image data at corrected geo-spatial coordinates to mitigate the geo-spatial misalignment;
analyzing, via at least the processor, the corrected image data to determine at least one environmental condition of the portion of the Earth'"'"'s surface;
generating, via at least the processor, control output data based on the at least one environmental condition; and
controlling operation of a remote computer, at least by transmitting the control output data to the remote computer over a network, to control operation of a machine to modify the at least one environmental condition.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems, methods, and other embodiments are disclosed for correcting errors in the geo-spatial locations of acquired image data. In one embodiment, acquired aerial or satellite image data is segmented to generate extracted boundary data. The extracted boundary data represents boundaries of features of a portion of the Earth'"'"'s surface, but at incorrect geo-spatial coordinates. The extracted boundary data is matched to expected boundary data derived from ground truth data. The expected boundary data represents boundaries of the features at correct geo-spatial coordinates. Adjustment parameters are generated that represent a geo-spatial misalignment between the extracted boundary data and the expected boundary data. Metadata in a header of the acquired image data is modified to include the adjustment parameters. The adjustment parameters may be applied to the acquired image data to generate corrected image data at correct geo-spatial coordinates.
20 Citations
18 Claims
-
1. A computer-implemented method performed by a computing device where the computing device includes at least a processor for executing instructions from a memory, the method comprising:
-
segmenting, via at least the processor, acquired image data to generate extracted boundary data, where the acquired image data is one of aerial image data or satellite image data representing features of a portion of the Earth'"'"'s surface at incorrect geo-spatial coordinates, and where the extracted boundary data represents boundaries of the features at the incorrect geo-spatial coordinates, wherein the segmenting comprises; performing at least a thresholding operation on the acquired image data to generate binary image data; performing at least a morphological operation on the binary image data to generate noise-reduced image data; and performing at least an edge detection operation on the noise-reduced image data to generate the extracted boundary data; matching, via at least the processor, the extracted boundary data to expected boundary data derived from a set of ground truth data, where the expected boundary data represents the boundaries of the features at correct geo-spatial coordinates; estimating, via at least the processor, adjustment parameters representing an amount and a type of a geo-spatial misalignment between the extracted boundary data and the expected boundary data; applying, via at least the processor, the adjustment parameters to the acquired image data to adjust the acquired image data to generate a corrected image having corrected image data at corrected geo-spatial coordinates to mitigate the geo-spatial misalignment; analyzing, via at least the processor, the corrected image data to determine at least one environmental condition of the portion of the Earth'"'"'s surface; generating, via at least the processor, control output data based on the at least one environmental condition; and controlling operation of a remote computer, at least by transmitting the control output data to the remote computer over a network, to control operation of a machine to modify the at least one environmental condition. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer system, comprising:
a processor connected to memory comprising instructions that when executed by the processor cause the processor to; segment acquired image data to generate extracted boundary data, where the acquired image data is one of aerial image data or satellite image data representing features of a portion of the Earth'"'"'s surface at incorrect geo-spatial coordinates, and where the extracted boundary data represents boundaries of the features at the incorrect geo-spatial coordinates, wherein the segmenting comprises; performing at least a thresholding operation on the acquired image data to generate binary image data; performing at least a morphological operation on the binary image data to generate noise-reduced image data; and performing at least an edge detection operation on the noise-reduced image data to generate the extracted boundary data; match the extracted boundary data to expected boundary data derived from a set of ground truth data, where the expected boundary data represents the boundaries of the features at correct geo-spatial coordinates; estimate adjustment parameters representing an amount and a type of a geo-spatial misalignment between the extracted boundary data and the expected boundary data; apply the adjustment parameters to the acquired image data to adjust the acquired image data to generate a corrected image having corrected image data at corrected geo-spatial coordinates to mitigate the geo-spatial misalignment; analyze the corrected image data to determine at least one environmental condition of the portion of the Earth'"'"'s surface; generate control output data based on the at least one environmental condition; and control operation of a remote computer, at least by transmitting the control output data to the remote computer over a network, to control operation of a machine to modify the at least one environmental condition. - View Dependent Claims (11, 12, 13, 14, 15)
-
16. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a computing device, cause the computing device to at least:
-
segment, via the one or more processors, acquired image data to generate extracted boundary data, where the acquired image data is one of aerial image data or satellite image data representing features of a portion of the Earth'"'"'s surface at incorrect geo-spatial coordinates, and where the extracted boundary data represents boundaries of the features at the incorrect geo-spatial coordinates, wherein the segmenting comprises; performing at least a thresholding operation on the acquired image data to generate binary image data; performing at least a morphological operation on the binary image data to generate noise-reduced image data; and performing at least an edge detection operation on the noise-reduced image data to generate the extracted boundary data; match, via the one or more processors, the extracted boundary data to expected boundary data derived from a set of ground truth data, where the expected boundary data represents the boundaries of the features at correct geo-spatial coordinates; estimate, via the one or more processors, adjustment parameters representing an amount and a type of a geo-spatial misalignment between the extracted boundary data and the expected boundary data; apply, via the one or more processors, the adjustment parameters to the acquired image data to adjust the acquired image data to generate a corrected image having corrected image data at corrected geo-spatial coordinates to mitigate the geo-spatial misalignment; analyze, via the one or more processors, the corrected image data to determine at least one environmental condition of the portion of the Earth'"'"'s surface; generate, via the one or more processors, control output data based on the at least one environmental condition; and control, via the control output data, at least one external mechanism to modify the at least one environmental condition. - View Dependent Claims (17, 18)
-
Specification