Automatically creating a movie from geo located content using earth

• US 8,862,995 B1
• Filed: 11/04/2011
• Issued: 10/14/2014
• Est. Priority Date: 11/04/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Barreirinhas, Quarup S., Kuhne, Stefan B., Lasmarias, Vermont T.
• Primary Examiner(s): Riegler, Patrick
• Assistant Examiner(s): KLICOS, NICHOLAS GEORGE
• Application Number:
  US13/289,270
• Time in Patent Office: 1,075 Days
• Field of Search: 715/723, 715/726, 715/730, 715/731
• US Class Current: 715/723
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/787 using geographical or spatial information, e.g. location

Abstract

Systems, methods, and computer storage mediums for rendering a geo-referenced interactive tour using media objects associated with a user. An exemplary method includes collecting the media objects from one or more selected user profiles associated with the user. Each media object is collected based on an associated time value. The collected media objects are organized into one or more trip segments based on velocity value associated with each collected media object, the velocity value indicating the velocity of travel between two media objects. At least one trip segment is rendered into the interactive tour. The trip segment is rendered to include its media objects and geo-referenced data. The geo-referenced data is determined from at least one geolocation associated with a media object included in the trip segment. The media objects and geo-referenced data are rendered according to a presentation style that is selected based on the included media objects.

Claims

1. A computer-implemented method for rendering a geo-referenced interactive tour comprising:

collecting, using one or more computing devices, different types of media objects from one or more user profiles associated with a user, each user profile including one or more media objects stored on various media sources, wherein each media object of the one or more media objects is collected when a time value associated with the media object falls within a time range and wherein the collecting includes retrieving the different types of media objects from the one or more user profiles based at least on the types of media objects available from the various media sources, wherein the collected media objects are associated with a plurality of different geolocations;

organizing, using the one or more computing devices, the collected media objects into a plurality of trip segments based on a velocity value associated with each collected media such that the collected media objects are organized into different trip segments based on velocity value ranges associated with each respective trip segment, wherein each velocity value indicates the velocity of the user'"'"'s movement between two collected media objects, wherein each velocity value is calculated based at least in part using the time values and geolocations associated with the two collected media objects, wherein each trip segment describes the user'"'"'s movement between the geolocations associated with the collected media objects included in the trip segment;

selecting, using the one or more computing devices, from a plurality of different presentation styles, a presentation style for each trip segment based on the media object type included in each trip segment; and

rendering, using the one or more computing devices, each trip segment into an interactive tour, each trip segment rendered to include its collected media objects and geo-referenced data according to the selected presentation style, wherein the geo-referenced data is determined from at least one geolocation associated with a collected media object included in the trip segment.

2. The computer-implemented method of claim 1, further comprising:

rendering, using the one or more computing devices, the interactive tour into a digital video, wherein the digital video includes a plurality of different video segments corresponding to the plurality of trip segments.

3. The computer-implemented method of claim 2, further comprising:

receiving, using the one or more computing devices, a duration value, wherein rendering the digital video further comprises rendering the digital video to a length specified by the duration value.

4. The computer-implemented method of claim 2, further comprising:

prior to rendering the digital video, determining, using the one or more computing devices, a segment duration for each trip segment based on the duration between time values associated with the included media objects, wherein the segment duration specifies the duration of time to allocate for each rendered trip segment during user interaction with the digital video.

5. The computer-implemented method of claim 2, further comprising:

distributing, using the one or more computing devices, the digital video to a user profile associated with a media source, wherein the user profile is viewable by a plurality of other users.

6. The computer-implemented method of claim 1, further comprising:

distributing, using the one or more computing devices, the interactive tour to a user profile associated with a media source, wherein the user profile is viewable by a plurality of other users.

7. The computer-implemented method of claim 1, further comprising:

labeling, using the one or more computing devices, a trip segment based on the geolocation associated with at least one media object included in the trip segment.

8. The computer-implemented method of claim 7, wherein the labeling is further based on the geolocation associated with a first media object and a last media object included in a trip segment.

9. The computer-implemented method of claim 1, wherein a trip segment is defined by a mode of transportation, the mode of transportation including one of flying, driving, walking, boating, biking, or remaining stationary, wherein the mode of transportation is determined from the velocity value associated with the included media objects.

29. The method of claim 1, wherein a presentation style is selected automatically, without user intervention.

30. The method of claim 1, wherein a presentation style is selected based on a user input.

31. The method of claim 1, wherein the interactive tour includes at least a 3-D virtual landscape navigation of a virtual path between the geolocations associated with one or more media objects included in the trip segment.

10. A system for rendering a geo-referenced interactive tour comprising:

a computing device comprising a processor and a memory;

a media object collector module, implemented on the computing device and configured to collect different types of media objects from one or more user profiles associated with a user, each user profile including one or more media objects stored on various media sources, wherein each media object of the one or more media objects is collected when a time value associated with the media object falls within a time range and wherein the collecting includes retrieving the different types of media objects from the one or more user profiles based at least on the types of media objects available from the various media sources, wherein the collected media objects are associated with a plurality of different geolocations;

a media object organizer module, implemented on the computing device and configured to organize the collected media objects into a plurality of trip segments based on a velocity value associated with each collected media such that the collected media objects are organized into different trip segments based on velocity value range associated with each respective trip segment, wherein each velocity value indicates the velocity of the user'"'"'s movement between two collected media objects, wherein each velocity value is calculated based at least in part using the time values and geolocations associated with the two collected media objects, wherein each trip segment describes the user'"'"'s movement between the geolocations associated with the collected media objects included in the trip segment; and

a segment renderer module, implemented on the computing device and configured to select, from a plurality of different presentation styles, a presentation style for each trip segment based on the media object types included in each trip segment, render each trip segment into an interactive tour, each trip segment rendered to include its collected media objects and geo-referenced data according to the selected presentation style, wherein the geo-referenced data is determined from at least one geolocation associated with a collected media object included in the trip segment.

11. The system of claim 10, wherein the segment renderer is further configured to render the interactive tour into a digital video, wherein the digital video includes a plurality of different video segments corresponding to the plurality of trip segments.

12. The system of claim 11, further comprising:

a user-interface module configured to receive a duration value, wherein rendering the digital video further comprises rendering the digital video to a length specified by the duration value.

13. The system of claim 11, wherein the segment renderer is further configured to determine a segment duration for each trip segment based on the duration between time values associated with the included media objects, wherein the segment duration specifies the duration of time to allocate for each rendered trip segment during user interaction with the digital video.

14. The system of claim 11, further comprising:

a video distributer configured to distribute the digital video to a user profile associated with a media source, wherein the user profile is viewable by a plurality of other users.

15. The system of claim 10, further comprising:

a video distributer configured to distribute the interactive tour to a user profile associated with a media source, wherein the user profile is viewable by a plurality of other users.

16. The system of claim 10, further comprising:

a segment labeller configured to label a trip segment based on the geolocation associated with at least one media object included in the trip segment.

17. The system of claim 16, wherein the segment labeller is further configured to label the trip segment based on the geolocation associated with a first media object and a last media object included in a trip segment.

18. The system of claim 10, wherein a trip segment is defined by a mode of transportation, the mode of transportation including one of flying, driving, walking, boating, biking, or remaining stationary, wherein the mode of transportation is determined from the velocity value associated with the included media objects.

32. The system of claim 10, wherein the interactive tour includes at least a 3-D virtual landscape navigation of a virtual path between the geolocations associated with one or more media objects included in the trip segment.

19. A non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by a computing device, causes the computing device to perform operations comprising:

collecting different types of media objects from one or more user profiles associated with a user, each user profile including one or more media objects stored on various media sources, wherein each media object of the one or more media objects is collected when a time value associated with the media object falls within a time range and wherein the collecting includes retrieving the different types of media objects from the one or more user profiles based at least on the types of media objects available from the various media sources, wherein the collected media objects are associated with a plurality of different geolocations;

organizing the collected media objects into a plurality of trip segments based on a velocity value associated with each collected media such that the collected media objects are organized into different trip segments based on velocity value ranges associated with each respective trip segment, wherein each velocity value indicates the velocity of the user'"'"'s movement between two collected media objects, wherein each velocity value is calculated based at least in part using the time values and a geolocation associated with the two collected media objects, wherein each trip segment describes the user'"'"'s movement between the geolocations associated with the collected media objects included in the trip segment;

selecting, from a plurality of different presentation styles, a presentation style for each trip segment based on the media object types included in each trip segment; and

rendering each trip segment into an interactive tour, the trip segment rendered to include its collected media objects and geo-referenced data according to the selected presentation style wherein the geo-referenced data is determined from at least one geolocation associated with a collected media object included in the trip segment.

20. The computer-readable storage medium of claim 19, further comprising:

rendering the interactive tour into a digital video, wherein the digital video includes a plurality of different video segments corresponding to the plurality of trip segments.

21. The computer-readable storage medium of claim 20, further comprising:

receiving a duration value, wherein rendering the digital video further comprises rendering the digital video to a length specified by the duration value.

22. The computer-readable storage medium of claim 20, further comprising:

prior to rendering the digital video, determining a segment duration for each trip segment based on the duration between time values associated with the included media objects, wherein the segment duration specifies the duration of time to allocate for each rendered trip segment during user interaction with the digital video.

23. The computer-readable storage medium of claim 20, further comprising:

distributing the digital video to a user profile associated with a media source, wherein the user profile is viewable by a plurality of other users.

24. The computer-readable storage medium of claim 19, further comprising:

distributing the interactive tour to a user profile associated with a media source, wherein the user profile is viewable by a plurality of other users.

25. The computer-readable storage medium of claim 19, further comprising:

labeling a trip segment based on the geolocation associated with at least one media object included in the trip segment.

26. The computer-readable storage medium of claim 25, wherein the labeling is further based on the geolocation associated with a first media object and a last media object included in a trip segment.

27. The computer-readable storage medium of claim 19, wherein a trip segment is defined by a mode of transportation, the mode of transportation including one of flying, driving, walking, boating, biking, or remaining stationary, wherein the mode of transportation is determined from the velocity value associated with the included media objects.

28. A computer-implemented method for generating a georeferenced digital video comprising:

collecting, using one or more computing devices, different types of media objects from one or more user profiles associated with a user, each user profile including hosting one or more media objects stored on various media sources, wherein each media object of the one or more media objects is collected when a time value associated with the media object falls within a time range and wherein the collecting includes retrieving the different types of media objects from the one or more user profiles based at least on the types of media objects available from the various media sources, wherein the collected media objects are associated with a plurality of different geolocations;

organizing, using one or more computing devices, the collected media objects into a plurality of trip segments based on a velocity value associated with each collected media such that the collected media objects are organized into different trip segments based on velocity value ranges associated with each respective trip segment, wherein each velocity value indicates the velocity of the user'"'"'s movement between two collected media objects, wherein each velocity value is calculated based at least in part using the time values and geolocations associated with the two collected media objects, wherein a trip segment describes the user'"'"'s movement between the geolocations associated with the collected media objects included in the trip segment;

selecting, using one or more computing devices, from a plurality of different presentation styles, a presentation style for each trip segment based on the media object types included in each trip segment; and

rendering, using one or more computing devices, each trip segment into a digital video, the trip segment rendered to include its collected media objects and geo-referenced data according to the selected presentation style wherein the geo-referenced data is determined from at least one geolocation associated with a collected media object included in the trip segment.