Navigating on images

• US 8,660,316 B2
• Filed: 03/04/2010
• Issued: 02/25/2014
• Est. Priority Date: 03/04/2010
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: Navteq B.V.
• Inventors: Mays, Joseph P., Bach, Jeffrey R.
• Primary Examiner(s): Patel, Nirav G
• Application Number:
  US12/717,190
• Publication Number:
  US 20110216935A1
• Time in Patent Office: 1,454 Days
• Field of Search: None
• US Class Current: 382/113
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/3446 Details of route searching algorithms, e.g. Dijkstra, A*, arc-flags, using precalculated routes
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G01C 21/3848 Data obtained from both position sensors and additional sensors
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 10/75 Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries

Abstract

Systems, devices, features, and methods for navigating on images are disclosed. For example, one method includes identifying a point selected on an initial image. An image component, such as a pixel, of the initial image corresponding to the identified point is determined. The image component of the initial image represents an origin. A route from the origin to a destination is generated, and the destination corresponds to another image component, such as another pixel.

Claims

1. A method of routing directly on images, the method comprising:

identifying a point selected on an initial image;

determining an image pixel of the initial image corresponding to the identified point, the image pixel of the initial image representing an origin;

accessing a data tag associated with the image pixel, wherein the data tag designates the image pixel as navigable or non-navigable;

determining common geographic features in images from the initial image to another image to correlate the intermediate image pixels; and

generating a route from the origin to a destination when the data tag designates the image pixel as navigable,

wherein the destination corresponds to another image pixel, and wherein the route comprises a connection between the origin and the destination via intermediate image pixels between the image pixel of the initial image and the other image pixel, wherein the other image pixel corresponding to the destination comprises an image pixel of the other image,

wherein the intermediate image pixels are designated as navigable pixels.

2. The method of claim 1, wherein the initial image and the other image comprise images of streets or roads.

3. The method of claim 1, wherein the image pixel representing the origin comprises an image pixel corresponding to a ground or floor, and wherein the image pixel representing the destination comprises an image pixel corresponding to a ground or floor.

4. The method of claim 1, wherein the intermediate image pixels correspond to other image pixels in the initial image or the other image.

5. The method of claim 1, wherein at least some of the intermediate image pixels correspond to image pixels of an intermediate image different than the initial image and the other image.

6. The method of claim 1, wherein generating the route comprises retrieving correlation data between the origin, destination, and the intermediate image pixels.

7. The method of claim 6, wherein determining common geographic features includes using scale invariant feature transform.

8. The method of claim 1, wherein the navigable pixels correspond to image pixels associated with a ground or floor.

9. The method of claim 1, wherein the identified point of the initial image is selected via an end user input.

10. The method of claim 1, wherein the initial image includes a ground portion and a sky portion.

11. A method of routing directly on images, the method comprising:

identifying a point selected on an initial photograph image;

determining an image pixel of the initial image corresponding to the identified point, the image pixel of the initial photograph image representing an origin;

accessing a data tag associated with the image pixel, wherein the data tag designates the image pixel as navigable or non-navigable; and

generating a route from the origin to a destination when the data tag designates the image pixel as navigable,

wherein the destination corresponds to another image pixel of a second image, and wherein the route comprises a connection between the origin and the destination via intermediate image pixels of common geographic features between the initial photograph image and the second image including the other image pixel,

wherein generating the route comprises using a cost factor to determine the intermediate image pixels.

12. A navigation system for routing with images, the system comprising:

an image database including a plurality of street view images corresponding to geographic areas;

memory including data corresponding to correlations between image pixels of the plurality of street view images; and

a processor configured to generate a route from an origin point on one of the plurality of images to a destination point on another of the plurality of street view images based on at least some of the data corresponding to the correlations between the image pixels based on common geographic features,

wherein the route comprises a connection between the origin point and the destination point via intermediate image pixels between the image pixel of the initial image and the other image pixel, and wherein the intermediate image pixels are designated as navigable pixels.

13. A non-transitory computer-readable medium including computer-executable instructions for performing a method of determining a route between an origin and a destination, the method comprising:

determining a first image pixel corresponding to the origin on a first digital image that shows the origin, wherein the first digital image that shows the origin was collected by a camera;

determining a second image pixel corresponding to the destination on a second digital image that shows the destination;

correlating the first digital image and the second digital image through at least one common feature;

determining a route from the origin to the destination via adjacent intermediate image pixels that correspond to a navigable geographic feature, wherein the navigable geographic feature forms at least part of the route from the origin to the destination;

identifying the first image pixel corresponding to the origin on the first digital image that shows the origin as a navigable pixel; and

identifying the second image pixel corresponding to the destination on the second digital image that shows the destination as a navigable pixel.

14. The non-transitory computer-readable medium of claim 13, wherein the first digital image that shows the origin includes a ground portion and a sky portion.

15. The non-transitory computer-readable medium of claim 13, wherein the first digital image that shows the origin is a three-dimensional image.

16. A method of routing directly on images, the method comprising:

identifying a point selected on an initial image;

determining an image pixel of the initial image corresponding to the identified point, the image pixel of the initial image representing an origin; and

generating a route from the origin to a destination,

wherein the destination corresponds to another image pixel of another image, wherein the route comprises a connection between the origin and the destination via intermediate image pixels between the image pixel of the initial image and the other image pixel, and

wherein generating the route comprises determining common geographic features in images from the initial image to the other image to correlate the intermediate image pixels.