Generating photogenic routes from starting to destination locations

• US 9,014,979 B2
• Filed: 09/06/2013
• Issued: 04/21/2015
• Est. Priority Date: 11/07/2008
• Status: Expired due to Fees

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Intellectual Ventures Fund 83 LLC (Intellectual Ventures LLC)
• Inventors: Luo, Jiebo, Yu, Jie, Joshi, Dhiraj
• Primary Examiner(s): Badii, Behrang
• Application Number:
  US14/019,888
• Publication Number:
  US 20140012502A1
• Time in Patent Office: 592 Days
• Field of Search: 701/533, 701/537, 701/439, 701/411, 701/418, 701/438, 463/16, 1/1, 382/224, 382/238, 382/243, 382/236, 715/855, 705/26.1, 345/473
• US Class Current: 701/537
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/26 specially adapted for navigation in a road network
• CPC Class Codes: G01C 21/3453 Special cost functions, i.e. other than distance or default speed limit of road segments
• CPC Class Codes: G01C 21/3461 Preferred or disfavoured areas, e.g. dangerous zones, toll or emission zones, intersections, manoeuvre types, segments such as motorways, toll roads, ferries
• CPC Class Codes: G01C 21/3476 using point of interest [POI] information, e.g. a route passing visible POIs
• CPC Class Codes: G01C 21/3641 Personalized guidance, e.g. limited guidance on previously travelled routes
• CPC Class Codes: G01C 21/3688 Systems comprising multiple parts or multiple output devices (not client-server), e.g. detachable faceplates, key fobs or multiple output screens
• CPC Class Codes: G08G 1/096716 where the received information does not generate an automatic action on the vehicle control

Abstract

A method of computing at least one photogenic route from a starting location to a destination location, including; computing photogenic values for images in a large collection representing a geographic region that includes the starting location and the destination location; computing a photogenic index for each route segment based on computed photogenic values of images taken along the route segment; computing at least one photogenic route from the starting location to the destination location and presenting the route(s) to a user.

Claims

1. A method comprising;

accessing a plurality of digital images associated with a travel route, wherein the travel route includes a starting location and a destination location;

computing a photogenic value for each of the plurality of digital images;

obtaining a plurality of route segments, wherein each route segment is located on a path between the starting location and the destination location;

associating one or more of the plurality of digital images with a route segment based upon a location of the one or more of the plurality of digital images and a location of the route segment, wherein the plurality of route segments comprise the route segment;

computing a photogenic index for each of the plurality of route segments based on the photogenic values of the one or more of digital images associated with the route segment; and

determining, using a processor, at least one preferred photogenic route from the starting location to the destination location based upon the photogenic index of the plurality of route segments.

2. The method of claim 1, further comprising determining a scene classification for each of the plurality of digital images.

3. The method of claim 2, wherein the determining the scene classification for each of the plurality of digital images comprises:

extracting visual features from each of the plurality of digital images;

extracting text features from meta-data of each of the plurality of digital images; and

combining the visual features and the text features associated with one of the plurality of digital images.

4. The method of claim 2, further comprising determining an aggregated scene classification for each of the plurality of the route segments based upon the scene classifications of the one or more digital images associated with the route segment.

5. The method of claim 4, further comprising filtering one or more route segments from the plurality of route segments based upon the aggregated scene classifications associated with the one or more route segments.

6. The method of claim 1, wherein the photogenic value for a digital image is based on visual features extracted from the digital image.

7. The method of claim 1, further comprising sending the at least one preferred photogenic route to a user-device.

8. The method of claim 1, wherein the photogenic index for a route segment is based on aggregating photogenic values of the one or more digital images associated with the route segment.

9. The method of claim 1, wherein the associating one or more of the plurality of digital images with a route segment comprises determining the one or more of the plurality of digital images are within a vicinity of the route segment.

10. The method of claim 9, wherein the one or more of the plurality of digital images are within an elliptical area of the location of the route segment.

11. An apparatus comprising:

one or more electronic processors configured to;

access a plurality of digital images associated with a travel route, wherein the travel route includes a starting location and a destination location;

compute a photogenic value for each of the plurality of digital images;

obtain a plurality of route segments, wherein each route segment is located on a path between the starting location and the destination location;

associate one or more of the plurality of digital images with a route segment based upon a location of the one or more of the plurality of digital images and a location of the route segment, wherein the plurality of route segments comprise the route segment;

compute a photogenic index for each of the plurality of route segments based on the photogenic values of the one or more of digital images associated with the route segment; and

determine at least one preferred photogenic route from the starting location to the destination location based upon the photogenic index of the plurality of route segments.

12. The apparatus of claim 11, wherein the one or more electronic processors are further configured to determine a scene classification for each of the plurality of digital images.

13. The apparatus of claim 12, wherein the one or more electronic processors are further configured to:

extract visual features from each of the plurality of digital images;

extract text features from meta-data of each of the plurality of digital images; and

combine the visual features and the text features associated with one of the plurality of digital images to determine the scene classification.

14. The apparatus of claim 12, wherein the one or more electronic processors are further configured to determine an aggregated scene classification for each of the plurality of the route segments based upon the scene classifications of the one or more digital images associated with the route segment.

15. The apparatus of claim 14, wherein the one or more electronic processors are further configured to filter one or more route segments from the plurality of route segments based upon the aggregated scene classifications associated with the one or more route segments.

16. A non-transitory computer-readable medium having instructions stored thereon, the instructions comprising:

instructions to access a plurality of digital images associated with a travel route, wherein the travel route includes a starting location and a destination location;

instructions to compute a photogenic value for each of the plurality of digital images;

instructions to obtain a plurality of route segments, wherein each route segment is located on a path between the starting location and the destination location;

instructions to associate one or more of the plurality of digital images with a route segment based upon a location of the one or more of the plurality of digital images and a location of the route segment, wherein the plurality of route segments comprise the route segment;

instructions to compute a photogenic index for each of the plurality of route segments based on the photogenic values of the one or more of digital images associated with the route segment; and

instructions to determine at least one preferred photogenic route from the starting location to the destination location based upon the photogenic index of the plurality of route segments.

17. The computer-readable medium of claim 16, further comprising instructions to determine a scene classification for each of the plurality of digital images.

18. The computer-readable medium of claim 17, wherein instructions to determine a scene classification further comprise:

instructions to extract visual features from each of the plurality of digital images;

instructions to extract text features from meta-data of each of the plurality of digital images; and

instructions to combine the visual features and the text features associated with one of the plurality of digital images to determine the scene classification.

19. The computer-readable medium of claim 17, wherein the instructions further comprise instructions to determine an aggregated scene classification for each of the plurality of the route segments based upon the scene classifications of the one or more digital images associated with the route segment.

20. The computer-readable medium of claim 19, wherein the instructions further comprise instructions to filter one or more route segments from the plurality of route segments based upon the aggregated scene classifications associated with the one or more route segments.

21. A method comprising:

accessing a plurality of digital images associated with a travel route, wherein the travel route includes a starting location and a destination location;

computing a photogenic value for each of the plurality of digital images;

extracting visual features from each of the plurality of digital images;

extracting text features from meta-data of each of the plurality of digital images;

combining the visual features and the text features associated with one of the plurality of digital images to determine a scene classification;

obtaining a plurality of route segments, wherein each route segment is located on a path between the starting location and the destination location;

associating one or more of the plurality of digital images with a route segment based upon a location of the one or more of the plurality of digital images and a location of the route segment, wherein the plurality of route segments comprise the route segment;

computing a photogenic index for each of the plurality of route segments based on the photogenic values of the one or more of digital images associated with the route segment; and

determining, using a processor, at least one preferred photogenic route from the starting location to the destination location based upon the photogenic index of the plurality of route segments.

22. The method of claim 21, further comprising determining aggregated scene classifications for each of the plurality of the route segments based upon the scene classifications of the one or more digital images associated with the route segment.

23. The method of claim 22, further comprising filtering one or more route segments from the plurality of route segments based upon the aggregated scene classifications associated with the one or more route segments.

24. A method comprising:

sending a starting location and a destination location to a remote computing device;

receiving a map including a plurality of digital images and a plurality of route segments, wherein each route segment is located on a path between the starting location and the destination location, wherein one or more of the plurality of digital images are associated with a route segment based upon a location of the one or more of the plurality of digital images and a location of the route segment, wherein a photogenic value is computed for each of the plurality of digital images, and wherein a photogenic index is computed for each of the plurality of route segments based on the photogenic values of the one or more of digital images associated with the route segment; and

displaying the map, wherein the map includes at least one preferred photogenic route from the starting location to the destination location based upon the photogenic index of the plurality of route segments.