Geo-locating an Object from Images or Videos

• US 20110110557A1
• Filed: 11/06/2009
• Published: 05/12/2011
• Est. Priority Date: 11/06/2009
• Status: Abandoned Application

• Current Assignee: Nicholas Clark, Paul Maassef, Richard Willmore
• Original Assignee: Nicholas Clark, Paul Maassef, Richard Willmore
• Inventors: Maassef, Paul, Clark, Nicholas, Willmore, Richard
• Application Number:
  US12/614,374
• Publication Number:
  US 20110110557A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G01C 11/06 by comparison of two or more pictures of the same area

Abstract

The present invention discloses a novel method, computer program product, and system for determining a spatial location of a target object from the selection of points in multiple images that correspond to the object location within the images. In one aspect, the method includes collecting location and orientation information of one or more image sensors producing the images; the collected location and orientation information is then used to determine the spatial location of the target object.

Claims

1. A computer-implemented method for determining a spatial location of a target object identified from user selected points in multiple images, the method comprising:

collecting location and orientation information of one or more image sensors when producing the images; and

estimating the spatial location of the target object based on the location and orientation information collected from the one or more image sensors.

2. The method of claim 1, further comprising:

displaying one of the multiple images;

determining whether to render a virtual object on the displayed image based on location information of the virtual object and field of view of the displayed image; and

rendering the virtual object in accordance with the location information and metadata of the virtual object, wherein the metadata contains at least representation attributes of the virtual object.

3. The method of claim 2, further comprising:

displaying information associated with the rendered virtual object.

4. The method of claim 2, further comprising:

receiving the user'"'"'s input to set display criteria; and

determining whether to render the virtual object on the displayed image additionally based on the user set display criteria.

5. The method of claim 1, further comprising:

receiving input to determine one of the selected points in a displayed image.

6. The method of claim 5, further comprising:

rendering a presentation of the selected point to indicate the selected point'"'"'s position on display.

7. The method of claim 5, further comprising:

generating one ray representing a sightline towards the selected point from the corresponding image sensor'"'"'s location based on the location and orientation information of the corresponding image sensor that produced the displayed image; and

saving the geo-coordinates corresponding to the generated ray.

8. The method of claim 7, further comprising:

comparing the input against saved geo-coordinates of a previously generated ray.

9. The method of claim 1, wherein one of the multiple images is an overhead view retrieved from a mapping program.

10. The method of claim 8, further comprising:

calculating confidence of estimating the target object'"'"'s geo-coordinates based upon location information associated with an intersection of generated rays; and

rendering a presentation to portray the calculated confidence.

11. A computer program product for determining a spatial location of a target object identified from selected points in multiple images, encoded on a computer-readable medium, operable to cause one or more processors to perform operations comprising:

collecting location and orientation information of one or more image sensors when producing the images; and

estimating the spatial location of the target object based on the location and orientation information collected from the one or more image sensors.

12. The product of claim 11, wherein the operations further comprise:

displaying one of the multiple images;

determining whether to render a virtual object on the displayed image based on location information of the virtual object and field of view of the displayed image; and

rendering the virtual object in accordance with the location information and metadata of the virtual object, wherein the metadata contains at least representation attributes of the virtual object.

13. The product of claim 12, wherein the operations further comprises:

displaying information associated with the rendered virtual object.

14. The product of claim 12, wherein the operations further comprise:

receiving the user'"'"'s input to set display criteria; and

determining whether to render the virtual object on the displayed image additionally based on the user set display criteria.

15. The product of claim 11, wherein the operations further comprise:

receiving input to determine one of the selected points in a displayed image.

16. The product of claim 15, wherein the operations further comprise:

rendering a presentation of the selected point to indicate the selected point'"'"'s position on display.

17. The product of claim 15, wherein the operations further comprise:

generating one ray representing a sightline towards the selected point from the corresponding image sensor'"'"'s location based on the location and orientation information of the corresponding image sensor that produced the displayed image; and

saving the geo-coordinates corresponding to the generated ray.

18. The product of claim 17, wherein the operations further comprise:

comparing the input against saved geo-coordinates of a previously generated ray.

19. The product of claim 11, wherein one of the multiple images is an overhead view retrieved from a mapping program.

20. The product of claim 18, wherein the operations further comprise:

calculating confidence of estimating the target object'"'"'s geo-coordinates based upon location information associated with an intersection of generated rays; and

rendering a presentation to portray the calculated confidence.

21. A system for determining a spatial location of a target object identified from user selected points in multiple images, the system comprising:

a computer readable medium comprising a computer program product; and

one or more processors operable to execute the computer program product to perform operations comprising;

collecting location and orientation information of one or more image sensors when producing the images; and

estimating the spatial location of the target object based on the location and orientation information collected from the one or more image sensors.

22. The system of claim 22, wherein the operations further comprise:

receiving input to determine one of the selected points in a displayed image; and

rendering a presentation of the selected point to indicate the selected point'"'"'s position on display.

23. The system of claim 22, wherein the operations further comprise:

generating one ray representing a sightline towards the selected point from the corresponding image sensor'"'"'s location based on the location and orientation information of the corresponding image sensor that produced the displayed image; and

saving the geo-coordinates corresponding to the generated ray.

24. The system of claim 23, wherein the operations further comprise:

comparing the input against saved geo-coordinates of a previously generated ray.

25. The system of claim 24, wherein the operations further comprise:

calculating confidence of estimating the target object'"'"'s geo-coordinates based upon location information associated with an intersection of generated rays; and

rendering a presentation to portray the calculated confidence.