Method of recognizing an object in an image using multi-sensor integration through conditionally optimal geoscene generation and registration

• US 7,343,051 B1
• Filed: 03/07/2005
• Issued: 03/11/2008
• Est. Priority Date: 03/07/2005
• Status: Active Grant

• Current Assignee: Shin-Yi Hsu
• Original Assignee: Shin-Yi Hsu
• Inventors: Hsu, Shin-yi
• Primary Examiner(s): Mancuso; Joseph
• Assistant Examiner(s): Chu; Randolph
• Application Number:
  US11/074,245
• Time in Patent Office: 1,100 Days
• Field of Search: 382/284, 382/113, 382/201, 382/394
• US Class Current: 382/294
• CPC Class Codes: G06V 20/13 Satellite images

Abstract

A method of recognizing an object in an image using multi-sensor integration through conditionally optimal geoscene generation and registration is provided. At least two images, one of which is a conditionally optimum, ortho-rectified base image, are input and used to generate a geoscene using at least two ground control points in a latitude-longitude geospatial domain. Georegistration of the geoscene produces a registered geoimage which may be output. A virtual geospatial information system database may be compiled from the georegistered images. A virtual transverse Mercator (VTM) projection is defined which allows processing images falling on both sides of the equator or across traditional UTM boundaries. An Affine transform is used for coordinate transformation in generating geoscenes. The georegistration process utilizes the union and the intersection of image pixels, and geolayering with interacting layers including geogrids and text layers, to define main body and background pixels to facilitate object recognition.

Claims

1. A method of generating a virtual geospatial information system (VGIS) database, the steps comprising:

a) inputting at least two images, one of said images being a base image for georegistration;

b) generating at least one geoscene using at least two ground control points in a lat-long geospatial domain;

c) performing georegistration of said at least one geoscene in said lat-long geospatial domain to produce a registered geoimage; and

d) outputting a geoimage;

whereby a pixel in said at least one geoscene is represented by;

i) (x,y) coordinates in the image domain;

ii) (z) coordinate in the spectral and elevation/height domains;

iii) UTM representation in the geospatial domain;

iv) latitude/longitude in the geospatial domain; and

v) Virtual Transverse Mercator.

2. The method of generating a VGIS database as recited in claim 1, wherein said base image comprises a conditionally optimal base image (COBI).

3. The method of generating a VGIS database as recited in claim 2, wherein said COBI comprises an ortho-rectified image.

4. The method of generating a VGIS database as recited in claim 1, wherein said generating step (b) comprises using at least one of a UTM and a VTM projection.

5. The method of generating a VGIS database as recited in claim 1, wherein said generating step (b) comprises performing an Affine transform for coordinate transformation.

6. The method of generating a VGIS database as recited in claim 1, wherein said performing georegistration step (c) comprises locating at least one of:

the intersection, and the union of pixels in said at least two input images, said intersected and said unioned pixels defining a main body of said registered geoimage.

7. The method of generating a VGIS database as recited in claim 6, wherein pixels other than pixels of said main body are background pixels.

8. The method of generating a VGIS database as recited in claim 1, wherein said performing georegistration step (c) comprises at least one of the processes:

geogridding, geooverlaying, and geomasking.

9. The method of generating a VGIS database as recited in claim 1, wherein said georegistration step (c) is performed in at least two stages.

10. The method of generating a VGIS database as recited in claim 1, wherein said geoimage of said outputting step (d) comprises at least one of:

a non-georegistered image, a registered geoimage, a geomosaic, a geogridded geoimage, a geooverlayed geoscene, and a geomasked geoscene.

11. The method of generating a VGIS database as recited in claim 10, wherein a geogrid associated with said geogridded geoimage comprises text.

12. The method of generating a VGIS database as recited in claim 1, wherein said registered geoimage comprises geoscene characteristic information.

13. The method of generating a VGIS database as recited in claim 12, wherein said geoscene characteristic information comprises at least one of:

a scene dimension, pixel resolution in at least one of an x-scale and a y-scale, the central meridian, the geoscene used, degrees of offset from the north, degrees of offset from the east, a UTM meridian, and a VTM meridian.

14. The method of generating a VGIS database as recited in claim 4, wherein said VTM projection comprises a local central meridian determined from a distribution of geolocations of pixels in at least one of said at least two input images.

15. The method of generating a VGIS database as recited in claim 14, wherein at least one of said generating a geoscene step (b) and said performing georegistration step (c) utilize a VTM system whereby said geoscene generation and said georegistration may be performed on an image having pixels on both the north side and the south side of the equator.

16. The method of generating a VGIS database as recited in claim 15, wherein said VTM system comprises means for performing at least one of the functions:

geoscene generation, geolocation, georegistration, geomosaicking, geogridding, geooverlaying, and geomasking.

17. The method of generating a VGIS database as recited in claim 1, wherein said outputting step (d) comprises normalizing a registered image such that a background pixel is assigned a tone value of zero and a minimum tone value for said registered image is one.

18. The method of generating a VGIS database as recited in claim 1, wherein one of said at least two images comprises at least one of:

map data, and signal data.

19. The method of generating a VGIS database as recited in claim 18, wherein said map data and signal data are provided by a source independent from a source of others of said at least two images.

20. A method of generating a virtual geospatial information system (VGIS) database, the steps comprising:

a) defining a virtual geoquad (VGQ) system for uniquely identifying geographic regions comprising 7.5 minutes latitude by 7.5 minutes longitude;

b) assigning an identification code to each VGQ;

c) inputting at least two images, one of said images being a base image for georegistration;

d) generating at least one geoscene using at least two ground control points in a lat-long geospatial domain;

e) using said unique identification code, performing georegistration of said at least one geoscene in said lat-long geospatial domain to produce a registered geoimage; and

f) outputting a geoimage;

whereby a pixel in said at least one geoscene is represented by;

i) (x,y) coordinates in the image domain;

ii) (z) coordinate in the spectral and elevation/height domains;

iii) UTM representation in the geospatial domain;

iv) latitude/longitude in the geospatial domain; and

v) Virtual Transverse Mercator.

21. The method of generating a VGIS database as recited in claim 20, wherein a VGQ defined in said defining a VGQ system step (a) comprises a VGQ having origins defined at least one of:

the equator, and the Greenwich Central Meridian.

22. The method of generating a VGIS database as recited in claim 21, wherein said VGQ is identified by a numeric code, a value of 0001_—

0001 defining a first possible VGQ and 2880_—

2880 defining a last VGQ.

23. The method of generating a VGIS database as recited in claim 21, wherein each of said VGQs is divided into four geoquarterquads, each of said geoquarterquads being identified by at least one of:

a numeric designation, and a textual designation, and a combination alpha-numeric designation.

24. The method of generating a VGIS database as recited in claim 21, wherein said generating step (d) comprises the sub-step of identifying all of said input images belonging to a particular one of said geoquads.

25. The method of generating a VGIS database as recited in claim 20, wherein said performing georegistration step (e) comprises locating at least one of:

the intersection, and the union of pixels in said at least two input images, said intersected and said unioned pixels defining a main body of said registered geoimage, wherein pixels other than said pixels of said main body being background pixels.

26. The method of generating a VGIS database as recited in claim 20, wherein said georegistration step (e) is performed in at least two stages.

27. The method of generating a VGIS database as recited in claim 20, wherein said registered geoimage comprises geoscene characteristic information.

28. The method of generating a VGIS database as recited in claim 27, wherein said geoscene characteristic information comprises at least one of:

a scene dimension, pixel resolution in at least one of an x-scale and a y-scale, the central meridian, the geoscene used, degrees of offset from the north, degrees of offset from the east, a UTM meridian, and a VTM meridian.

29. The method of generating a VGIS database as recited in claim 23, wherein said VTM projection comprises a local central meridian determined from a distribution of geolocations of pixels in at least one of said at least two input images.

30. The method of generating a VGIS database as recited in claim 23, wherein at least one of said generating a geoscene step (d) and said performing georegistration step (e) utilize a VTM system whereby said geoscene generation and said georegistration may be performed on an image having pixels on both the north side and the south side of the equator.

31. The method of generating a VGIS database as recited in claim 30, wherein said outputting step (f) comprises normalizing a registered image such that a background pixel is assigned a tone value of zero and a minimum tone value for said registered image is one.

32. The method of generating a VGIS database as recited in claim 20, wherein one of said at least two images comprises at least one of:

map data, and signal data.

33. The method of generating a VGIS database as recited in claim 32, wherein said map data and signal data are provided by a source independent from a source of others of said at least two images.

34. A method of generating a virtual geospatial information system (VGIS) database, the steps comprising:

a) defining a Virtual Transverse Mercator (VTM) projection;

b) inputting at least two images, one of said images being a base image for georegistration;

c) generating at least one geoscene using at least two ground control points in a lat-long geospatial domain defined using at least one of said VTM projection and a Universal Transverse Mercator (UTM) projection;

d) using at least one of said VTM and UTM projections, performing at least one of the functions;

geoscene generation, georegistration, geolocation, geomosaicking, geooverlaying, geogridding, and geomasking of said at least one geoscene in said lat-long geospatial domain to produce a registered geoimage; and

e) outputting a geoimage;

whereby a pixel in said at least one geoscene is represented by;

i) (x,y) coordinates in the image domain;

ii) (z) coordinate in the spectral and elevation/height domains;

iii) UTM representation in the geospatial domain;

iv) Latitude/longitude in the geospatial domain; and

v) Virtual Transverse Mercator.

35. The method of generating a VGIS database as recited in claim 34, wherein in at least one of said generating a geoscene step (c) and said georegistering step (d), only said UTM projection is used when all pixels in all of said at least two images fall on a single side of the equator and fall within a single UTM zone.

36. The method of generating a VGIS database as recited in claim 34, wherein said generating step (c) comprises performing an Affine transform for coordinate transformation.

37. The method of generating a VGIS database as recited in claim 34, wherein said performing georegistration step (d) comprises locating at least one of:

intersecting, unioning, geogridding, geooverlaying, and geomasking of pixels in said at least two input images to define a main body of said registered geoimage.

38. The method of generating a VGIS database as recited in claim 37, wherein pixels other than pixels of said main body are background pixels.

39. The method of generating a VGIS database as recited in claim 34, wherein said georegistration step (d) is performed in at least two stages using at least one of said UTM and said VTM projections.

40. The method of generating a VGIS database as recited in claim 34, wherein said geoimage of said outputting step (d) comprises at least one of:

a non-georegistered image, a registered geoimage, a geomosaic, a geogridded geoimage, a geooverlayed geoscene, and a geomasked geoscene.

41. The method of generating a VGIS database as recited in claim 34, wherein said registered geoimage comprises geoscene characteristic information defined in at least one of said UTM and said VTM projections.

42. The method of generating a VGIS database as recited in claim 41, wherein said geoscene characteristic information comprises at least one of:

a scene dimension, pixel resolution in at least one of an x-scale and a y-scale, the central meridian, the geoscene used, degrees of offset from the north, degrees of offset from the east, a geogrid, and geotext for at least one of said UTM and said VTM projections, a UTM meridian, a VTM meridian.

43. The method of generating a VGIS database as recited in claim 34, wherein said VTM projection comprises a local central meridian determined from a distribution of geolocations of pixels in at least one of said at least two input images.

44. The method of generating a VGIS database as recited in claim 34, wherein at least one of said generating a geoscene step (c) and said performing georegistration step (d) utilize a VTM system whereby said functions of geoscene generation, georegistration, geolocation, geomosaicking, geooverlaying, geogridding, and geomasking geoscene generation and georegistration may be performed on an image having pixels on both the north side and the south side of the equator.

45. The method of generating a VGIS database as recited in claim 34, wherein said outputting step (e) comprises normalizing a registered image such that a background pixel is assigned a tone value of zero and a minimum tone value for said registered image is one.

46. The method of generating a VGIS database as recited in claim 34, wherein one of said at least two images comprises at least one of:

map data, and signal data in at least one of said UTM and said VTM projections.

47. The method of generating a VGIS database as recited in claim 34, wherein said map data and signal data are provided by a source independent from a source of others of said at least two images.