Landmark Identification Using Metadata

• US 20110052073A1
• Filed: 08/25/2010
• Published: 03/03/2011
• Est. Priority Date: 08/26/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Wallace, Alexander David, Bhatt, Nikhil, Hanson, Eric, Cherna, Tim
• Granted Patent: US 8,611,592 B2
• Time in Patent Office: Days
• US Class Current: 382/190
• CPC Class Codes: G06V 20/39 Urban scenes
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata

Abstract

Methods, systems, and apparatus are presented for associating a point of interest with a captured image. In one aspect, metadata associated with a digital image can be accessed, the metadata identifying an image capture location. Further, a depth of field corresponding to the digital image can be determined and one or more points of interest can be identified that are located within the determined depth of field. Additionally, one of the one or more identified points of interest can be selected as an image subject and the metadata associated with the digital image can be edited to include data identifying the selected point of interest.

Claims

1. A computer-implemented method of associating a point of interest with a captured image, the method comprising:

accessing metadata associated with a digital image, the metadata identifying an image capture location;

determining a depth of field corresponding to the digital image;

identifying one or more points of interest located within the determined depth of field;

selecting one of the one or more identified points of interest as an image subject; and

editing the metadata associated with the digital image to include data identifying the selected point of interest.

2. The computer-implemented method of claim 1, wherein the metadata identifying an image capture location includes a Global Positioning System (GPS) coordinate.

3. The computer-implemented method of claim 1, wherein determining a depth of field further comprises:

accessing metadata identifying a subject distance, a focal length, and an f-stop corresponding to the digital image.

4. The computer-implemented method of claim 3, wherein determining a depth of field further comprises:

accessing metadata identifying a sensor type corresponding to the digital image.

5. The computer-implemented method of claim 1, further comprising:

selecting one of the one or more identified points of interest based on proximity to the image capture location.

6. The computer-implemented method of claim 1, further comprising:

submitting a request specifying the image capture location and determined depth of field to a database including point of interest data; and

receiving a response from the database including one or more identified points of interest.

7. The computer-implemented method of claim 1, further comprising:

accessing metadata associated with the digital image, the metadata identifying a compass heading; and

determining, based at least in part on the compass heading, a horizontal field of view corresponding to the digital image.

8. The computer-implemented method of claim 7, wherein identifying one or more points of interest further comprises:

excluding points of interest located outside of the determined horizontal field of view.

9. A computer-implemented method of associating a point of interest with a captured image, the method comprising:

accessing metadata associated with a digital image, the metadata identifying an image capture location and a compass heading;

determining a depth of field corresponding to the digital image;

determining a field of view corresponding to the digital image based on the determined depth of field and the compass heading;

identifying one or more points of interest located within the determined field of view;

selecting one of the one or more identified points of interest as an image subject; and

associating the selected point of interest with the digital image.

10. The computer-implemented method of claim 9, further comprising:

accessing metadata identifying an orientation value corresponding to the digital image.

11. The computer-implemented method of claim 10, wherein determining a field of view further comprises:

determining a vertical angle of view based on the orientation value; and

adjusting the determined field of view in accordance with the determined vertical angle of view.

12. The computer-implemented method of claim 10, wherein the orientation value is captured using a gyroscope.

13. The computer-implemented method of claim 9, further comprising:

accessing metadata identifying a focus point value corresponding to the digital image.

14. The computer-implemented method of claim 9, wherein identifying one or more points of interest further comprises:

submitting a query to a database of point of interest data, the query specifying the determined field of view; and

receiving, in response to the query, a set of one or more identified points of interest.

15. The computer-implemented method of claim 14, further comprising:

excluding a point of interest from the set of one or more identified points of interest in response to identifying a blocking structure located between the image capture location and the point of interest.

16. The computer-implemented method of claim 9, wherein determining a depth of field further comprises:

accessing metadata identifying a subject distance, a focal length, and an f-stop corresponding to the digital image.

17. The computer-implemented method of claim 9, wherein determining a depth of field further comprises:

accessing metadata identifying a lens used to capture the digital image.

18. The computer-implemented method of claim 9, wherein determining a field of view further comprises:

accessing metadata identifying a lens used to capture the digital image; and

determining a horizontal angle of view based on the lens.

19. A computer program product, encoded on a computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

accessing metadata associated with a digital image, the metadata identifying an image capture location;

determining a depth of field corresponding to the digital image;

identifying one or more points of interest located within the determined depth of field;

selecting one of the one or more identified points of interest as an image subject; and

editing the metadata associated with the digital image to include data identifying the selected point of interest.

20. The computer program product of claim 19, further operable to cause data processing apparatus to perform operations comprising:

converting the metadata identifying the image capture location into a Global Positioning System (GPS) coordinate format.

21. The computer program product of claim 19, further operable to cause data processing apparatus to perform operations comprising:

determining the depth of field based on metadata identifying a subject distance, a focal length, and an f-stop corresponding to the digital image.

22. The computer program product of claim 19, further operable to cause data processing apparatus to perform operations comprising:

selecting one of the one or more identified points of interest based on proximity to the image capture location.

23. The computer program product of claim 19, further operable to cause data processing apparatus to perform operations comprising:

submitting a request specifying the image capture location and determined depth of field to a database including point of interest data; and

receiving a response from the database including one or more identified points of interest.

24. The computer program product of claim 19, further operable to cause data processing apparatus to perform operations comprising:

accessing metadata associated with the digital image, the metadata identifying a compass heading; and

determining, based at least in part on the compass heading, a horizontal field of view corresponding to the digital image.

25. The computer program product of claim 24, further operable to cause data processing apparatus to perform operations comprising:

excluding points of interest located outside of the determined horizontal field of view.

26. A computer program product, encoded on a computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

accessing metadata associated with a digital image, the metadata identifying an image capture location and a compass heading;

determining a depth of field corresponding to the digital image;

determining a field of view corresponding to the digital image based on the determined depth of field and the compass heading;

identifying one or more points of interest located within the determined field of view;

selecting one of the one or more identified points of interest as an image subject; and

associating the selected point of interest with the digital image.

27. The computer program product of claim 26, further operable to cause data processing apparatus to perform operations comprising:

accessing metadata identifying an orientation value corresponding to the digital image.

28. The computer program product of claim 27, further operable to cause data processing apparatus to perform operations comprising:

determining a vertical angle of view based on the orientation value; and

adjusting the determined field of view in accordance with the determined vertical angle of view.

29. The computer program product of claim 26, further operable to cause data processing apparatus to perform operations comprising:

submitting a query to a database of point of interest data, the query specifying the determined field of view; and

receiving, in response to the query, a set of one or more identified points of interest.

30. The computer program product of claim 29, further operable to cause data processing apparatus to perform operations comprising:

excluding a point of interest from the set of one or more identified points of interest in response to identifying a blocking structure located between the image capture location and the point of interest.

31. The computer program product of claim 26, further operable to cause data processing apparatus to perform operations comprising:

determining the depth of field in accordance with metadata identifying a subject distance, a focal length, and an f-stop corresponding to the digital image.

32. The computer program product of claim 26, further operable to cause data processing apparatus to perform operations comprising:

determining the depth of field in accordance with metadata identifying a lens used to capture the digital image.

33. The computer program product of claim 26, further operable to cause data processing apparatus to perform operations comprising:

accessing metadata identifying a lens used to capture the digital image;

determining a horizontal angle of view based on the lens; and

adjusting the field of view in accordance with the determined horizontal angle of view.

34. A system comprising:

an image capture device including a compass and a memory device, the memory device tangibly storing at least one digital image and corresponding metadata; and

a computing system communicatively coupled to the image capture device, the computing system including processor electronics configured to perform operations comprising;

accessing the metadata corresponding to the digital image, the metadata identifying an image capture location and a compass heading;

determining a depth of field corresponding to the digital image;

determining a field of view corresponding to the digital image based on the determined depth of field and the compass heading;

identifying one or more points of interest located within the determined field of view;

selecting one of the one or more identified points of interest as an image subject; and

associating the selected point of interest with the digital image.