Landmark identification using metadata

• US 8,611,592 B2
• Filed: 08/25/2010
• Issued: 12/17/2013
• Est. Priority Date: 08/26/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Wallace, Alexander David, Cherna, Tim, Hanson, Eric, Bhatt, Nikhil
• Primary Examiner(s): Carter, Aaron W
• Application Number:
  US12/868,653
• Publication Number:
  US 20110052073A1
• Time in Patent Office: 1,210 Days
• Field of Search: 382/103, 382/106, 382/181, 382/305
• US Class Current: 382/103
• CPC Class Codes: G06V 20/39 Urban scenes
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata

Abstract

Methods, systems, and apparatus are presented for associating a point of interest with a captured image. In one aspect, metadata associated with a digital image can be accessed, the metadata identifying an image capture location. Further, a depth of field corresponding to the digital image can be determined and one or more points of interest can be identified that are located within the determined depth of field. Additionally, one of the one or more identified points of interest can be selected as an image subject and the metadata associated with the digital image can be edited to include data identifying the selected point of interest.

Claims

1. A computer-implemented method of associating a point of interest with a captured image, the method comprising:

accessing metadata associated with a digital image, the metadata identifying an image capture location;

determining a depth of field corresponding to the digital image;

identifying a plurality of points of interest located within the determined depth of field;

selecting one of the plurality of identified points of interest as an image subject based, at least in part, on a proximity of each of the plurality of identified points of interest to the image capture location; and

editing the metadata associated with the digital image to include data identifying the selected point of interest.

2. The computer-implemented method of claim 1, wherein the metadata identifying an image capture location includes a Global Positioning System (GPS) coordinate.

3. The computer-implemented method of claim 1, wherein determining a depth of field comprises:

accessing metadata identifying a subject distance, a focal length, and an f-stop corresponding to the digital image.

4. The computer-implemented method of claim 3, wherein determining a depth of field further comprises:

accessing metadata identifying a sensor type corresponding to the digital image.

5. The computer-implemented method of claim 1, wherein identifying a plurality of points of interest comprises:

submitting a request specifying the image capture location and determined depth of field to a database including point of interest data; and

receiving a response from the database including the plurality of points of interest.

6. The computer-implemented method of claim 1, further comprising:

accessing metadata associated with the digital image, the metadata identifying a compass heading; and

determining, based at least in part on the compass heading, a horizontal field of view corresponding to the digital image.

7. The computer-implemented method of claim 6, wherein identifying a plurality of points of interest further comprises:

excluding points of interest located outside of the determined horizontal field of view from the plurality of identified points of interest.

8. A computer-implemented method of associating a point of interest with a captured image, the method comprising:

accessing metadata associated with a digital image, the metadata identifying an image capture location and a compass heading;

determining a depth of field corresponding to the digital image;

determining a field of view corresponding to the digital image based on the determined depth of field and the compass heading;

identifying a plurality of points of interest located within the determined field of view;

selecting one of the plurality of identified points of interest as an image subject based, at least in part, on a proximity of each of the plurality of identified points of interest to the image capture location; and

associating the selected point of interest with the digital image.

9. The computer-implemented method of claim 8, further comprising:

accessing metadata identifying an orientation value corresponding to the digital image.

10. The computer-implemented method of claim 9, wherein determining a field of view further comprises:

determining a vertical angle of view based on the orientation value; and

adjusting the determined field of view in accordance with the determined vertical angle of view.

11. The computer-implemented method of claim 9, wherein the orientation value is captured using a gyroscope.

12. The computer-implemented method of claim 8, further comprising:

accessing metadata identifying a focus point value corresponding to the digital image.

13. The computer-implemented method of claim 8, wherein identifying points of interest further comprises:

submitting a query to a database of point of interest data, the query specifying the determined field of view; and

receiving, in response to the query, the plurality of identified points of interest.

14. The computer-implemented method of claim 13, further comprising:

excluding a point of interest from the plurality of identified points of interest in response to identifying a blocking structure located between the image capture location and the point of interest.

15. The computer-implemented method of claim 8, wherein determining a depth of field comprises:

accessing metadata identifying a subject distance, a focal length, and an f-stop corresponding to the digital image.

16. The computer-implemented method of claim 8, wherein determining a depth of field comprises:

accessing metadata identifying a lens used to capture the digital image.

17. The computer-implemented method of claim 8, wherein determining a field of view comprises:

accessing metadata identifying a lens used to capture the digital image; and

determining a horizontal angle of view based on the lens.

18. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

accessing metadata associated with a digital image, the metadata identifying an image capture location;

determining a depth of field corresponding to the digital image;

identifying a plurality of points of interest located within the determined depth of field;

selecting one of the plurality of identified points of interest as an image subject based, at least in part, on a proximity of each of the plurality of identified points of interest to the image capture location; and

editing the metadata associated with the digital image to include data identifying the selected point of interest.

19. The computer program product of claim 18, further operable to cause data processing apparatus to perform operations comprising:

converting the metadata identifying the image capture location into a Global Positioning System (GPS) coordinate format.

20. The computer program product of claim 18, further operable to cause data processing apparatus to perform operations comprising:

determining the depth of field based on metadata identifying a subject distance, a focal length, and an f-stop corresponding to the digital image.

21. The computer program product of claim 18, further operable to cause data processing apparatus to perform operations comprising:

submitting a request specifying the image capture location and determined depth of field to a database including point of interest data; and

receiving a response from the database including the plurality of identified points of interest.

22. The computer program product of claim 18, further operable to cause data processing apparatus to perform operations comprising:

accessing metadata associated with the digital image, the metadata identifying a compass heading; and

determining, based at least in part on the compass heading, a horizontal field of view corresponding to the digital image.

23. The computer program product of claim 22, further operable to cause data processing apparatus to perform operations comprising:

excluding points of interest located outside of the determined horizontal field of view from the plurality of identified points of interest.

24. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

accessing metadata associated with a digital image, the metadata identifying an image capture location and a compass heading;

determining a depth of field corresponding to the digital image;

determining a field of view corresponding to the digital image based on the determined depth of field and the compass heading;

identifying a plurality of points of interest located within the determined field of view;

selecting one of the plurality of identified points of interest as an image subject based, at least in part, on a proximity of each of the plurality of identified points of interest to the image capture location; and

associating the selected point of interest with the digital image.

25. The computer program product of claim 24, further operable to cause data processing apparatus to perform operations comprising:

accessing metadata identifying an orientation value corresponding to the digital image.

26. The computer program product of claim 25, further operable to cause data processing apparatus to perform operations comprising:

determining a vertical angle of view based on the orientation value; and

adjusting the determined field of view in accordance with the determined vertical angle of view.

27. The computer program product of claim 24, further operable to cause data processing apparatus to perform operations comprising:

submitting a query to a database of point of interest data, the query specifying the determined field of view; and

receiving, in response to the query, the plurality of points of interest.

28. The computer program product of claim 27, further operable to cause data processing apparatus to perform operations comprising:

excluding a point of interest from the plurality of identified points of interest in response to identifying a blocking structure located between the image capture location and the point of interest.

29. The computer program product of claim 24, further operable to cause data processing apparatus to perform operations comprising:

determining the depth of field in accordance with metadata identifying a subject distance, a focal length, and an f-stop corresponding to the digital image.

30. The computer program product of claim 24, further operable to cause data processing apparatus to perform operations comprising:

determining the depth of field in accordance with metadata identifying a lens used to capture the digital image.

31. The computer program product of claim 24, further operable to cause data processing apparatus to perform operations comprising:

accessing metadata identifying a lens used to capture the digital image;

determining a horizontal angle of view based on the lens; and

adjusting the field of view in accordance with the determined horizontal angle of view.

32. A system comprising:

an image capture device including a compass and a memory device, the memory device tangibly storing at least one digital image and corresponding metadata; and

a computing system communicatively coupled to the image capture device, the computing system including processor electronics configured to perform operations comprising;

accessing the metadata corresponding to the digital image, the metadata identifying an image capture location and a compass heading;

determining a depth of field corresponding to the digital image;

determining a field of view corresponding to the digital image based on the determined depth of field and the compass heading;

identifying a plurality of points of interest located within the determined field of view;

selecting one of the plurality of identified points of interest as an image subject based, at least in part, on a proximity of each of the plurality of identified points of interest to the image capture location; and

associating the selected point of interest with the digital image.