Image-based georeferencing

• US 9,042,657 B2
• Filed: 03/13/2013
• Issued: 05/26/2015
• Est. Priority Date: 09/14/2009
• Status: Active Grant

• Current Assignee: Trimble Navigation Limited (Trimble Inc.)
• Original Assignee: Trimble Navigation Limited (Trimble Inc.)
• Inventors: Janky, James M., McCusker, Michael V., Longaker, Harold L., France, Peter G.
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): WOLDEMARIAM, AKLILU K
• Application Number:
  US13/799,266
• Publication Number:
  US 20130195362A1
• Time in Patent Office: 804 Days
• Field of Search: 382/195, 382/100, 382/103, 382/113, 382/233, 345/629, 345/569, 345/665, 345/667, 340/988, 340/995
• US Class Current: 382/195
• CPC Class Codes: G01C 15/00 Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 7/74 involving reference images or patches

Abstract

An image-based georeferencing system comprises an image receiver, an image identification processor, a reference feature determiner, and a feature locator. The image receiver is configured for receiving a first image for use in georeferencing. The image comprises digital image information. The system includes a communicative coupling to a georeferenced images database of images. The image identification processor is configured for identifying a second image from the georeferenced images database that correlates to the first image. The system includes a communicative coupling to a geographic location information system. The reference feature determiner is configured for determining a reference feature common to both the second image and the first image. The feature locator is configured for accessing the geographic information system to identify and obtain geographic location information related to the common reference feature.

Claims

1. An image-based georeferencing system, said system comprising:

an image receiver configured for receiving a first image for use in georeferencing, said image comprising digital image information and said first image comprising a terrestrial image of a physical object, wherein physical position information of said physical object is unknown;

a communicative coupling with a georeferenced images database of images;

an image identification processor configured for identifying a second image from said georeferenced images database that correlates to said first image;

a communicative coupling with a geographic location information system;

a reference feature determiner configured for determining a reference feature common to both said second image and said first image;

a feature locator configured for accessing said geographic location information system to identify and obtain geographic location information related to said common reference feature, wherein said feature locator determines a georeferenced position fix for said common reference feature, and

a geospatial and geographic information system (GIS) to identify said common reference feature and to obtain said geographic location information related to said common reference feature if said common reference feature is not georeferenced in said second image identified from said georeferenced images database.

2. The system of claim 1, further comprising:

an augmenter configured for augmenting said first image to associate said geographic location information regarding said common reference information and thereby create a georeferenced third image.

3. The system of claim 1, further comprising:

a location-of-capture determiner configured for utilizing said geographic location information related to said common feature to determine a georeferenced location of capture of said first image.

4. The location-of-capture determiner of claim 3, wherein said geographic location information comprises at least three non-collinear geolocated points from at least three respective features of said first image.

5. The system of claim 1, further comprising:

an output engine configured for providing georeferenced information derived from said first image as an output accessible by a user of said system.

6. The system of claim 1, further comprising:

a registration comparer configured for comparing georeferenced registration information received in conjunction with said first image to existing georeferenced registration information associated with said second image to determine which is more accurate, wherein level of accuracy is determined based upon comparing accuracy of sources of said georeferenced registration information; and

a registration updater configured for updating said existing geo-registration information with said candidate georeferenced registration information if said geo-registration information for said first image is determined to be more accurate than said geo-registration information for said second image.

7. The system of claim 6, wherein said registration comparer comprises:

a provenance checker for checking for and determining a provenance of accuracy for a georeferenced position fix.

8. The system of claim 6, wherein said registration comparer comprises:

a vertical Z-coordinate accuracy estimator to determine the accuracy of a Z-coordinate of a position fix associated with either said first image or said second image.

9. The system of claim 1, further comprising:

a coordinate system transformer configured for transforming said geographic location information related to said common reference feature into a desired coordinate system.

10. The system of claim 1, further comprising:

an image capture device for capturing said first image.

11. The system of claim 10, wherein said image capture device further comprises:

a communicative coupling with a global navigation satellite system (GNSS) receiver configured for providing georeferenced location information regarding a location of capture of said first image.

12. The system of claim 10, wherein said image capture device further comprises:

a communicative coupling with a mobile communication device.

13. The system of claim 1, wherein said feature locator comprises:

an accuracy validator configured to validate a level of accuracy associated with geographic location information accessed from said geographic location information system by said feature locator.

14. An image-based georeferencing system, said system comprising:

a georeferenced images database; and

a georeferenced images database management system comprising;

a feature locator for locating a plurality of reference points in a georeferenced first image, said first image comprising at least one terrestrial image of a physical object, wherein physical position information of said physical object is unknown and wherein said reference points are suitable for use in locating additional features in a field of view of said first image wherein said feature locator determines a georeferenced position fix for said common reference feature;

an augmenter for augmenting said georeferenced first image with annotation marks indicative of said reference points to create an augmented georeferenced image from said georeferenced first image; and

a geospatial and geographic information system (GIS) to identify said common reference feature and to obtain said geographic location information related to said common reference feature if said common reference feature is not georeferenced in said second image identified from said georeferenced images database.

15. The system of claim 14, further comprising:

a data storage system for storing said augmented georeferenced image and a list of said reference points in said georeferenced images database.

16. The system of claim 14, wherein said georeferenced images database management system further comprises:

a coordinate system transformer for performing a registration transformation process to bring an arbitrary coordinate reference system of said georeferenced first image into registration with a second selected coordinate system.

17. The system of claim 16, wherein said second selected coordinate system is a local coordinate system specified by a user of said image-based georeferencing system.

18. The system of claim 17, wherein said second selected coordinate system is reference coordinate system used in conjunction with global navigation satellite system determined coordinates.

19. An image-based georeferencing system, said system comprising:

an image receiver configured for receiving a first image for use in georeferencing, said first image comprising a terrestrial image of a physical object and comprising digital image information and an annotated point representative of an object location within said first image, wherein physical position information of said physical object is unknown;

an image identification processor configured for processing said first image to identify a second image in a georeferenced images database that contains said annotated pointwherein said image identification processor determines a georeferenced position fix for said common reference feature; and

an augmenter for augmenting said first image with georeferenced coordinates of said annotated point in a first coordinate system associated with said second image;

and

a geospatial and geographic information system (GIS) to identify said common reference feature and to obtain said geographic location information related to said common reference feature if said common reference feature is not georeferenced in said second image identified from said georeferenced images database.

20. The system of claim 19, further comprising:

a data storage system for storing said first image and said georeferenced coordinates of said annotated point in a georeferenced images database.