Fast multi-spectral image registration by modeling platform motion

• US 10,769,801 B2
• Filed: 12/05/2018
• Issued: 09/08/2020
• Est. Priority Date: 04/11/2016
• Status: Active Grant

• Current Assignee: Goodrich Corporation (Raytheon Technologies Corporation d/b/a RTX)
• Original Assignee: Goodrich Corporation (Raytheon Technologies Corporation d/b/a RTX)
• Inventors: Saquib, Suhail Shabbir, Egan, Matthew D.
• Primary Examiner(s): Kassa, Yosef
• Application Number:
  US16/210,091
• Publication Number:
  US 20190114791A1
• Time in Patent Office: 643 Days
• Field of Search: 382170, 382171, 382190, 382260, 382268, 382275, 382284, 382294, 382295, 358 12, 358 326, 358 337, 358537
• CPC Class Codes: G06T 2207/10036 Multispectral image; Hyperspectral image
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: G06T 7/32 using correlation-based methods
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths

Abstract

A method of predicting warps for image registration includes receiving warp data for a first band pair in an N-band system. The method includes fitting a warp model to the warp data to produce an offset profile for the first band pair, predicting a respective offset profile for at least one other band pair in the N-band system, and using the predicted respective offset profile to generate a warp for the at least one other band pair. The method also includes registering images of the at least one other band pair using the warp for the at least one other band pair. In another aspect, a method of predicting warps for image registration includes receiving warp data for m band pairs in an N-band system, wherein m≤(N−1) and m>2, to register images.

Claims

1. A method of predicting warps for image registration comprising:

receiving warp data for a first band pair in an N-band system;

fitting a warp model to the warp data to produce an offset profile for the first band pair;

predicting a respective offset profile for at least one other band pair in the N-band system;

using the predicted respective offset profile to generate a warp for the at least one other band pair; and

registering images of the at least one other band pair using the warp for the at least one other band pair, wherein predicting a respective offset profile includes shifting and scaling the offset profile for the first band pair, wherein predicting a respective offset profile includes estimating stick spacing for the N-bands of a focal plane array (FPA), wherein shifting and scaling values of the offset profile for the first band pair are derived from the stick spacing of the bands in the first band pair and the bands in the at least one other band pair, wherein the shifting and scaling values for predicting the at least one other band pair, d and e, from the first band pair, f and g, are given as

2. A method as recited in claim 1, wherein predicting a respective offset profile for the at least one other band pair, d and e, includes shifting and scaling the offset profile for the first band pair, f and g

ĉ

_de(fg)(y)=ĉ

_fg(y−

Δ

y_de(fg))r_de(fg),

where ĉ

_fg(⋅

) denotes offset profile estimated for first band pair fg and g.

3. A method as recited in claim 1, wherein using the predicted respective offset profile to generate a warp for the at least one other band pair includes using a respective optical distortion profile for each respective band pair.