GENERATING THEME-BASED VIDEOS

• US 20180068019A1
• Filed: 09/01/2017
• Published: 03/08/2018
• Est. Priority Date: 09/05/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: NOVIKOFF, Timothy, CUI, Jingyu
• Granted Patent: US 10,642,893 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings

Abstract

Implementations relate to generating theme-based videos. In some implementations, a computer-implemented method to automatically generate a theme-based video includes obtaining image criteria for a theme from a theme definition, querying an image database to obtain a plurality of images that meet the image criteria, determining that a count of the plurality of images satisfies a threshold based on the theme definition, and generating the theme-based video that includes one or more of the plurality of images.

Claims

1. A computer-implemented method to automatically generate a theme-based video, the computer-implemented method comprising:

obtaining image criteria for a theme from a theme definition;

querying an image database to obtain a plurality of images that meet the image criteria;

determining that a count of the plurality of images satisfies a threshold based on the theme definition; and

generating the theme-based video that includes one or more of the plurality of images.

2. The computer-implemented method of claim 1, further comprising causing the theme-based video to be displayed to a user.

3. The computer-implemented method of claim 2, further comprising:

determining one or more available themes;

determining a respective engagement metric for the one or more available themes;

selecting the theme from the one or more available themes based at least in part on the respective engagement metric;

after at least a portion of the theme-based video has been displayed, receiving feedback related to the theme-based video from the user; and

adjusting the engagement metric for the theme based on the feedback for the theme-based video.

4. The computer-implemented method of claim 3, wherein receiving the feedback comprises obtaining one or more of:

a share indicator that indicates the user shared the theme-based video, a view indicator that indicates a count of views of the theme-based video, a deletion indicator that indicates that the theme-based video was deleted, and a notification response indicator that indicates that the user accessed the theme-based video from a notification.

5. The computer-implemented method of claim 1, further comprising selecting the theme based on one or more of:

user profile information of a user for the theme-based video, a number of recent images that the user has uploaded to the image database, and a current date.

6. The computer-implemented method of claim 1, further comprising:

determining a user for the theme-based video;

determining user profile information for the user; and

selecting a soundtrack for the theme-based video based at least in part on the user profile information,

wherein generating the theme-based video includes generating the theme-based video to include the soundtrack.

7. The computer-implemented method of claim 6, wherein the user profile information includes one or more of:

a user location and a user preference, and wherein selecting the soundtrack based at least in part on the user profile information comprises one or more of;

determining that the user location matches a location parameter of the soundtrack; and

determining that the user preference matches an audio parameter of the soundtrack.

8. The computer-implemented method of claim 1, further comprising:

calculating a confidence score based on the plurality of images and the theme definition, wherein the confidence score indicates a strength of match between the plurality of images and the image criteria; and

selecting a soundtrack for the theme-based video based at least in part on the confidence score.

9. The computer-implemented method of claim 1, further comprising:

determining whether the count of the plurality of images satisfies the threshold;

in response to determining that the count of the plurality of images does not satisfy the threshold, checking the image database until one or more additional images are detected in the image database; and

in response to the one or more additional images being detected in the image database, repeating the determining whether the count of the plurality of images satisfies the threshold.

10. The computer-implemented method of claim 1, wherein the plurality of images are a subset of multiple images stored on the image database, and further comprising:

causing display of one or more selection options by a user device, wherein the one or more selection options include one or more images of the multiple images stored on the image database;

receiving a selection of at least one image of the one or more images; and

determining one or more of the image criteria based on the at least one selected image.

11. The computer-implemented method of claim 10, wherein the one or more images are determined from the multiple images based on at least one of the image criteria.

12. A non-transitory computer-readable medium comprising one or more instructions stored thereon that when executed by a processor, cause the processor to perform operations comprising:

obtaining image criteria for a theme from a theme definition;

querying an image database to obtain a plurality of images that meet the image criteria;

determining that a time difference between a first timestamp associated with a first image of the plurality of images and a second timestamp associated with a second image of the plurality of images meets a threshold time difference based on the theme definition; and

based on determining that the time difference meets the threshold time difference, generating a theme-based video that includes one or more of the plurality of images.

13. The non-transitory computer-readable medium of claim 12, wherein the one or more instructions cause the processor to perform further operations comprising:

determining a user for the theme-based video;

determining user profile information for the user, wherein generating the theme-based video is based at least in part on the user profile information; and

selecting a soundtrack for the theme-based video based at least in part on the user profile information,

wherein generating the theme-based video includes generating the theme-based video to include the soundtrack.

14. The non-transitory computer-readable medium of claim 12, wherein each of the plurality of images is associated with a respective timestamp of a plurality of timestamps, and wherein the first timestamp is the earliest of the plurality of timestamps and the second timestamp is the most recent of the plurality of timestamps.

15. The non-transitory computer-readable medium of claim 12, wherein the one more instructions cause the processor to perform further operations comprising:

determining one or more available themes;

determining a respective engagement metric for the one or more available themes; and

selecting the theme from the one or more available themes based at least in part on the respective engagement metric.

16. A system comprising:

a memory; and

at least one processor configured to access the memory and configured to perform operations comprising;

obtaining a plurality of themes from a storage, each of the plurality of themes including a respective theme definition;

determining respective image criteria from the respective theme definition for each of the plurality of themes;

obtaining a plurality of images associated with a user from an image database;

determining a respective subset of the plurality of images that meet the respective image criteria for each of the plurality of themes;

selecting a particular theme of the plurality of themes for a video; and

generating the video based on the selected particular theme of the plurality of themes, wherein the video includes one or more images from the subset of the plurality of images for the particular theme.

17. The system of claim 16, wherein the at least one processor is configured to perform the operation of selecting the particular theme to include:

ranking the plurality of themes based on one or more of;

a respective engagement metric for the plurality of themes,

a respective diversity metric for the plurality of themes, and

a user profile for a user for the video; and

determining the particular theme based on the ranking.

18. The system of claim 16, wherein the at least one processor is configured to perform the operation of obtaining the plurality of themes to further comprise:

determining available themes from a themes database;

determining a respective engagement metric for each of the available themes; and

selecting the plurality of themes from the available themes based at least in part on the respective engagement metric.

19. The system of claim 16, wherein the at least one processor is configured to perform the operation of obtaining the plurality of themes to further comprise:

determining available themes from a themes database;

determining a respective diversity metric for each of the plurality of themes; and

selecting the plurality of themes from the available themes based at least in part on the respective diversity metrics, wherein the respective diversity metrics are based on one or more of;

a number of generated videos for the available themes, and historical data for the available themes.

20. The system of claim 16, wherein the at least one processor is configured to perform the operation of obtaining the plurality of themes to further comprise:

obtaining the plurality of themes based on at least one theme date associated with at least one theme of the plurality of themes, wherein the at least one theme date indicates a time at which the video is to be generated based on the at least one theme.