Image-based georeferencing

• US 9,471,986 B2
• Filed: 01/26/2015
• Issued: 10/18/2016
• Est. Priority Date: 09/14/2009
• Status: Active Grant

• Current Assignee: Trimble Inc.
• Original Assignee: Trimble Navigation Limited (Trimble Inc.)
• Inventors: Janky, James M., McCusker, Michael V., Longaker, Harold L., France, Peter G.
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): WOLDEMARIAM, AKLILU K
• Application Number:
  US14/605,652
• Publication Number:
  US 20150170368A1
• Time in Patent Office: 631 Days
• Field of Search: 382/100, 382/103, 382/154, 382/195, 382/201, 382/285, 382/289
• US Class Current: 1/1
• CPC Class Codes: G01C 15/00 Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 7/74 involving reference images or patches

Abstract

A computer-implemented method of providing georeferenced information regarding a location of capture of an image is provided. The method includes receiving a first image at an image-based georeferencing system, the first image comprising digital image information and identifying a cataloged second image that correlates to the first image. The method further includes automatically determining reference features common to both the second image and the first image, accessing geographic location information related to the common reference features, utilizing the geographic location information related to the common features to determine a georeferenced location of capture of the first image and providing the georeferenced location of capture for access by a user of the image-based georeferencing system.

Claims

1. A method of determining geographic information for a location of capture of an image using an image-based georeferencing system comprising one or more processors, the method comprising:

receiving a first image at the one or more processors of the image-based georeferencing system, the first image captured by a camera at the location of capture, the first image comprising first digital image information representing a plurality of reference features;

identifying, with the one or more processors, a cataloged second image comprising second digital image information representing the reference features, wherein the first digital image information is different from the second digital image information;

automatically determining, with the one or more processors, the reference features common to both the second digital image information and the first digital image information;

accessing, with the one or more processors, georeferenced location information for the common reference features, wherein the georeferenced location information is associated with the second image, wherein the georeferenced location information is accessed from a geographic information system (GIS) repository, and wherein the accessed georeferenced location information is not represented by information representing an image;

determining, with the one or more processors, geographic location information for the location of capture at least partly based on the first digital image information and on the accessed georeferenced location information; and

providing the geographic location information for the location of capture to a user.

2. The method as recited in claim 1, further comprising:

providing the georeferenced location information for the common reference features for access by the user of the image-based georeferencing system.

3. The method as recited in claim 1, wherein receiving the first image at the one or more processors comprises:

receiving a digital photograph captured with a digital camera of a mobile communications device.

4. The method as recited in claim 1, wherein receiving the first image at the one or more processors comprises:

receiving a digital representation of a terrestrial scene, wherein the terrestrial scene includes at least one identifiable object.

5. The method as recited in claim 1, wherein receiving the first image at the one or more processors comprises:

receiving geographic data associated with the first image.

6. The method as recited in claim 5, wherein receiving the geographic data associated with the first image comprises:

receiving geographic location information related to a manmade structure in a field of view of the first image.

7. The method as recited in claim 5, wherein receiving the geographic data associated with the first image comprises:

receiving geographic location information related to a location of capture of the first image.

8. The method as recited in claim 1, wherein identifying the cataloged second image comprises:

using an image recognition algorithm to compare the first image with a plurality of cataloged images in a georeferenced image database to identify the cataloged second image.

9. The method as recited in claim 1, wherein accessing the georeferenced location information comprises:

accessing data in the GIS repository.

10. The method as recited in claim 1, wherein determining the geographic location information for the location of capture comprises:

refining an accuracy of the geographic location information for the location of capture based on the accessed georeferenced location information for the common reference features.

11. The method as recited in claim 1, wherein providing the geographic location information for the location of capture comprises:

providing the geographic location information for the location of capture in exchange for a fee.

12. A method of updating a database of georeferenced images using an image-based georeferencing system comprising one or more processors, the method comprising:

with the one or more processors of the image-based georeferencing system, identifying a cataloged second image comprising second digital image information representing a plurality of reference features, wherein the reference features are also represented in first digital image information of a first digital image, and wherein the first digital image was captured by a camera at a location of capture;

with the one or more processors, automatically determining the reference features common to both the second digital image information and the first digital image information;

with the one or more processors, accessing georeferenced location information for the common reference features, wherein the georeferenced location information is associated with the second image, wherein the georeferenced location information is accessed from a geographic information system (GIS) repository, and wherein the accessed georeferenced location information is not represented by information representing an image;

associating the georeferenced location information with the reference features in the first image to create a third image comprising a georeferenced version of the first image; and

storing the third image in a georeferenced image database.

13. The method of claim 12, wherein storing the third image in a georeferenced image database comprises:

comparing georeferenced registration information received in conjunction with the first image to existing georegistration information associated with the cataloged second image to determine which is more accurate based upon comparison of accuracy of sources of the georeferenced registration information; and

updating the existing georegistration information with the georeferenced registration information of the first image if the georeferenced registration information of the first image is determined to be more accurate than that of the second image.

14. The method of claim 13, wherein comparing the georeferenced registration information comprises:

performing a Z-coordinate accuracy estimation to determine accuracy of a Z-coordinate of a position fix associated with a feature in the first image.

15. A non-transitory computer readable storage medium having computer readable instructions stored thereon that when executed cause a computer system to perform a method of determining geographic information for a location of capture of an image, the method comprising:

receiving a first image at an image-based georeferencing system, the first image captured by a camera at the location of capture, the first image comprising first digital image information representing a plurality of reference features;

identifying a cataloged second image comprising second digital image information representing the reference features, wherein the first digital image information is different from the second digital image information;

automatically determining the reference features common to both the second digital image information and the first digital image information;

accessing georeferenced location information for the common reference features, wherein the georeferenced location information is associated with the second image, wherein the georeferenced location information is accessed from a geographic information system (GIS) repository, and wherein the accessed georeferenced location information is not represented by information representing an image;

determining geographic location information for the location of capture at least partly based on the first digital image information and on the accessed georeferenced location information; and

providing the geographic location information for the location of capture to a user of said image-based georeferencing system.

16. The non-transitory computer readable storage medium as recited in claim 15, wherein the method further comprises:

providing the georeferenced location information for the common reference features for access by the user of the image-based georeferencing system.

17. The non-transitory computer readable storage medium as recited in claim 15, wherein receiving the first image at the image-based georeferencing system comprises:

receiving a digital photograph captured with a digital camera of a mobile communications device.

18. The non-transitory computer readable storage medium as recited in claim 15, wherein identifying the cataloged second image comprises:

utilizing an image recognition algorithm to compare the first image with a plurality of cataloged images in a georeferenced image database to identify the cataloged second image.

19. The non-transitory computer readable storage medium as recited in claim 15, wherein accessing the georeferenced location information comprises:

accessing data in the GIS repository, wherein the data is related to the cataloged second image.

20. The non-transitory computer readable storage medium as recited in claim 15, wherein providing the geographic location information for the location of capture comprises:

providing the geographic location information for the location of capture in exchange for a fee.