Image-based georeferencing

• US 8,942,483 B2
• Filed: 09/14/2009
• Issued: 01/27/2015
• Est. Priority Date: 09/14/2009
• Status: Active Grant

• Current Assignee: Trimble Inc.
• Original Assignee: Trimble Navigation Limited (Trimble Inc.)
• Inventors: Janky, James M., McCusker, Michael V., Longaker, Harold L., France, Peter G.
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): WOLDEMARIAM, AKLILU K
• Application Number:
  US12/559,322
• Publication Number:
  US 20110064312A1
• Time in Patent Office: 1,961 Days
• Field of Search: 382/195, 382/113, 382/294, 382/100, 382/218, 382/225, 382/305, 396/318, 396/310, 396/294
• US Class Current: 382/195
• CPC Class Codes: G01C 15/00 Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59

Abstract

An image-based georeferencing system comprises an image receiver, an image identification processor, a reference feature determiner, and a feature locator. The image receiver is configured for receiving a first image for use in georeferencing. The image comprises digital image information. The system includes a communicative coupling to a georeferenced images database of images. The image identification processor is configured for identifying a second image from the georeferenced images database that correlates to the first image. The system includes a communicative coupling to a geographic location information system. The reference feature determiner is configured for determining a reference feature common to both the second image and the first image. The feature locator is configured for accessing the geographic information system to identify and obtain geographic location information related to the common reference feature.

Claims

1. A method of obtaining geolocation information, said method comprising:

capturing a first image with a camera to achieve a captured image, said captured image comprising a field of view including an object with an identifiable feature;

providing said captured image to an image-based georeferencing system, said image-based georeferencing system comprising a feature locator configured for accessing geographic location information;

determining, by said image-based georeferencing system, a common reference feature that is common to both captured image and an image identified from an image database, wherein said common reference feature comprises said identifiable feature;

retrieving, by said feature locator of said image-based georeferencing system, a georeferenced position fix for said common reference feature, and wherein if said common reference feature is not georeferenced in said image identified from said image database, accessing, by said image-based georeferencing system, a geospatial and geographic information system (GIS) to identify said common reference feature and to obtain said geographic location information related to said common reference feature;

receiving, from said feature locator, an accuracy level determination for said georeferenced position fix, wherein said accuracy level determination comprises a description of a level of accuracy for a source rendering said georeferenced position fix, wherein said accuracy level determination further comprises an accuracy validation comprising a validation of a presence of Z-coordinate information in said georeferenced position fix;

locating, by said feature locator, additional features in said field of view of said captured image based on said georeferenced position fix for said common reference feature and said accuracy level determination; and

receiving, from said image-based georeferencing system, an augmented version of said first image comprising augmented location information regarding said field of view.

2. The method as recited in claim 1, wherein said capturing said first image with a camera comprises:

capturing said first image with said camera, wherein said camera comprises a digital camera integrated with a mobile communications device.

3. The method as recited in claim 1, wherein said capturing said first image further comprises:

receiving a user selection of a point of interest in said field of view via a user interaction with a graphic user interface associated with a device selected from the group consisting of;

a digital camera;

a mobile communications device configured to display said first image; and

a computing device with a display.

4. The method as recited in claim 1, wherein providing said captured image with said identifiable feature to said image-based georeferencing system further comprises:

providing geographic data associated with said captured image.

5. The method as recited in claim 4, wherein said providing geographic data associated with said captured image comprises:

providing a global navigation satellite system (GNSS) determined location associated with a location of capture of said captured image.

6. The method as recited in claim 1, wherein said receiving, from said image-based georeferencing system, an augmented version of said captured image comprising said augmented location information regarding said field of view comprises:

receiving said augmented version of said captured image in exchange for a payment of a fee.

7. The method as recited in claim 1, wherein said receiving from said image-based georeferencing system an augmented version of said captured image comprising said augmented location information regarding said field of view comprises:

receiving said captured image augmented with georeferenced location information regarding a user-selected point of interest in said field of view of said captured image.

8. The method as recited in claim 1, wherein said receiving from said image-based georeferencing system an augmented version of said captured image comprising said augmented location information regarding said field of view comprises:

receiving said captured image augmented with geographic location information associated with a reference feature identified in said captured image.

22. The method of claim 1, further comprising:

if said Z-coordinate information is not available for performing georeferencing of other location points, then sending a real-time message that advises an image supplier to capture and supply another image from a different location of capture.

9. A method of obtaining a georeferenced location, said method comprising:

capturing a first image with a camera to achieve a captured image, said captured image comprising a field of view including an object with an identifiable feature;

providing said captured image to an image-based georeferencing system, said image-based georeferencing system comprising a feature locator configured for accessing geographic location information;

determining, by said image-based georeferencing system, a common reference feature that is common to both captured image and an image identified from an image database, wherein said common reference feature comprises said identifiable feature;

retrieving, by said feature locator of said image-based georeferencing system, a georeferenced position fix for said common reference feature, and wherein if said common reference feature is not georeferenced in said image identified from said image database, accessing, by said image-based georeferencing system, a geospatial and geographic information system (GIS) to identify said common reference feature and to obtain said geographic location information related to said common reference feature;

receiving, from said feature locator, an accuracy level determination for said georeferenced position fix, wherein said accuracy level determination comprises a description of a level of accuracy for a source rendering said georeferenced position fix, wherein said accuracy level determination further comprises an accuracy validation comprising a validation of a presence of Z-coordinate information in said georeferenced position fix;

locating, by said feature locator, additional features in said field of view of said captured image based on said georeferenced position fix for said common reference feature and said accuracy level determination; and

receiving, from said image-based georeferencing system, a georeferenced location of said camera during capture of said captured image, said georeferenced location determined by said image-based georeferencing system based upon geographic location information associated with a plurality of reference features found by said image-based georeferencing system to be present in said captured image.

10. The method as recited in claim 9 wherein said providing said captured image with said identifiable feature to an image-based georeferencing system further comprises:

providing geographic data associated with said captured image.

11. The method as recited in claim 10, wherein said providing geographic data associated with said captured image comprises:

providing a user supplied location of said camera at a time of capture of said captured image, wherein said user supplied location serves to narrow searching requirements of said image-based georeferencing system.

12. The method as recited in claim 9, wherein said receiving from said image-based georeferencing system a georeferenced location of said camera during capture of said captured image comprises:

receiving said georeferenced location of said camera during capture of said captured image in exchange for payment of a fee.

13. A computer-implemented method of providing position information, said computer-implemented method comprising:

with an image-based georeferencing system, identifying a cataloged second image that correlates to a first image, wherein said first image is captured with a camera to achieve a captured image, said image-based georeferencing system comprising a feature locator configured for accessing geographic location information;

determining, by said image-based georeferencing system, a common reference feature that is common to both captured image and said an image identified from an image database, wherein said common reference feature comprises said identifiable feature;

retrieving, by said feature locator of said image-based georeferencing system, a georeferenced position fix for said common reference feature, and wherein if said common reference feature is not georeferenced in said image identified from said image database, accessing, by said image-based georeferencing system, a geospatial and geographic information system (GIS) to identify said common reference feature and to obtain geographic location information related to said common reference feature;

providing said geographic location information regarding related to said common reference feature for access by a user of said image-based georeferencing system;

receiving, from said feature locator, an accuracy level determination for said georeferenced position fix, wherein said accuracy level determination comprises a description of a level of accuracy for a source rendering said georeferenced position fix, wherein said accuracy level determination further comprises an accuracy validation comprising a validation of a presence of Z-coordinate information in said georeferenced position fix; and

locating, by said feature locator, additional features in said field of view of said captured image based on said georeferenced position fix for said common reference feature and said accuracy level determination.

14. The computer-implemented method as recited in claim 13, wherein said identifying a cataloged second image that correlates to a first image comprises:

receiving said captured image, wherein said captured image comprises a terrestrial scene that includes at least one object with an identifiable feature.

15. The computer-implemented method as recited in claim 14, wherein said receiving said captured image further comprises:

receiving geographic data associated with said captured image.

16. The computer-implemented method as recited in claim 15, wherein said receiving geographic data associated with said captured image comprises:

receiving geographic location information related to said identifiable feature in said field of view of said captured image.

17. The computer-implemented method as recited in claim 15, wherein said receiving geographic data associated with said captured image comprises:

receiving geographic location information related to a location of capture of said captured image.

18. The computer-implemented method as recited in claim 13, wherein said identifying a second image that correlates to said first image comprises:

utilizing an image recognition algorithm to compare said captured image with a plurality of cataloged images in a georeferenced image database to identify said second image that correlates to said captured image.

19. The computer-implemented method as recited in claim 13, wherein said accessing geographic location information related to said common reference feature comprises:

accessing a geographic location information database related to said cataloged image to determine said geographic location information regarding said common reference feature.

20. The computer-implemented method as recited in claim 13, wherein said providing said geographic location information regarding said common reference feature for access by a user of said image-based georeferencing system comprises:

providing a third image comprising a georeferenced version of said captured image, said third image comprising said geographic location information annotated relative to said common reference feature.

21. The computer-implemented method as recited in claim 13, wherein said providing said geographic location information regarding said common reference feature for access by a user of said image-based georeferencing system comprises:

providing said geographic location information regarding said common reference feature for access by said user in exchange for a fee.