Systems and methods for selecting content items and generating multimedia content

• US 10,652,075 B2
• Filed: 05/15/2014
• Issued: 05/12/2020
• Est. Priority Date: 05/15/2014
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Costa, Fabio Miranda, Ewing, James Cameron, Higgins, Joshua Warren, Kwiatek, Nicholas J., Osborn, Kyre Madeleine, Salciccoli, Nathaniel Gregory, Vander Molen, Skyler J., Wu, Shu
• Primary Examiner(s): Mercado, Ariel
• Application Number:
  US14/279,144
• Publication Number:
  US 20150331842A1
• Time in Patent Office: 2,189 Days
• Field of Search: 715201
• CPC Class Codes: G06F 40/12 Use of codes for handling textual entities
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 50/00 Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism healthcare informatics G16H
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04L 65/40 Support for services or applications
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

Systems, methods, and non-transitory computer-readable media can detect a trigger event for generating multimedia content. A set of content items associated with a user account can be identified. Information associated with at least one of the set of content items or the user account can be acquired. A subset of content items can be selected out of the set of content items based on the information. In some embodiments, each content item in the subset can satisfy specified selection criteria. The multimedia content can be generated based on the subset of content items.

Claims

1. A computer-implemented method comprising:

detecting, by a computing system, a trigger event for generating a multimedia content item designed to reflect an event associated with a user account, wherein the multimedia content item includes video content;

identifying, by the computing system, a set of content items associated with the user account;

acquiring, by the computing system, the set of content items and information associated with the set of content items or the user account;

determining, by the computing system, relevance of each content item of the set of the content items relative to the user account based on the information;

ranking, by the computing system, the relevance of the set of content items based on a ranking algorithm,

wherein the ranking algorithm increases rankings for at least some content items determined by an image classification process to contain one or more faces; and

wherein the ranking algorithm ranks the set of content items containing one or more faces based on affinity coefficients between the user account and one or more persons identified by a facial recognition technique from the one or more faces;

selecting, by the computing system, a subset of content items out of the set of content items, wherein each content item in the subset satisfies one or more ranking thresholds; and

generating, by the computing system, the multimedia content item based on the subset of content items, wherein generating the multimedia content item comprises;

converting non-visual content items in the subset of content items into image representations of the non-visual content items, wherein the non-visual content items include at least one of a text, a post, a status update, or an audio item; and

placing the image representations of the non-visual content items into the video content.

2. The computer-implemented method of claim 1, further comprising:

providing the user account with access to the multimedia content item, wherein the generating the multimedia content item includes pre-rendering the multimedia content item prior to the providing the user account with the access to the multimedia content item.

3. The computer-implemented method of claim 1, wherein the generating the multimedia content item includes processing the subset of content items by one or more servers of a social networking system, and wherein an amount of the processing is based on a level of user traffic experienced by the social networking system.

4. The computer-implemented method of claim 1, further comprising:

modifying, based on one or more commands associated with the user account, the subset of content items to produce a modified set of content items;

generating, in real-time, a modified multimedia content item based on the modified set of content items; and

providing, in real-time, the modified multimedia content item generated based on the modified set of content items.

5. The computer-implemented method of claim 4, wherein the generating, in real-time, the modified multimedia content item based on the modified set of content items includes transmitting at least one instruction to a computing device associated with the user account, wherein the modified multimedia content item is renderable in real-time using HTML5 by the computing device.

6. The computer-implemented method of claim 1, wherein each content item in the subset of content items is at least one of a post, a status update, or an image, and wherein the multimedia content item includes video.

7. The computer-implemented method of claim 1, wherein the generating the multimedia content item includes providing audio content, the audio content being selected based on one or more commands provided via the user account.

8. The computer-implemented method of claim 7, further comprising:

analyzing the audio content to determine one or more beats of the audio content; and

synchronizing, within an allowable time deviation, at least a portion of the multimedia content item with the one or more beats of the audio content.

9. The computer-implemented method of claim 1, wherein the trigger event is associated with at least one of a significant event associated with the user account within a social networking system, a user command initiated via the user account, or a system command of the social networking system.

10. The computer-implemented method of claim 9, wherein the trigger event is associated with the significant event associated with the user account, and wherein the detecting of the trigger event includes analyzing at least one of a post associated with the user account, a status update associated with the user account, a comment associated with the user account, a tag associated with the user account, or an interaction associated with the user account.

11. The computer-implemented method of claim 1, wherein the selecting the subset of content items out of the set of content items includes ranking the set of content items based on a ranking algorithm, wherein the specified selection criteria include one or more ranking thresholds, and wherein each content item in the subset of content items satisfies the one or more ranking thresholds.

12. The computer-implemented method of claim 11, wherein the ranking algorithm decreases rankings for at least some content items determined by the image classification process to include at least one of memes or food.

13. The computer-implemented method of claim 11, wherein the ranking algorithm is based on social interaction analysis.

14. The computer-implemented method of claim 13, wherein the ranking algorithm increases rankings for at least some content items determined by the social interaction analysis to be associated with a current relationship associated with the user account and decreases rankings for at least some content items determined by the social interaction analysis to be associated with a terminated relationship associated with the user account.

15. The computer-implemented method of claim 1, wherein at least a first content item in the subset of content items is associated with a first time period and wherein at least a second content item in the subset of content items is associated with a second time period.

16. The computer-implemented method of claim 1, wherein at least a first content item in the subset of content items is associated with a first location and wherein at least a second content item in the subset of content items is associated with a second location.

17. The computer-implemented method of claim 1, wherein the user account is associated with at least one of a user of a social networking system, an entity associated with the social networking system, a group associated with the social networking system, a post on the social networking system, an application provided via the social networking system, or an event created through the social networking system.

18. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform;

detecting a trigger event for generating a multimedia content item designed to reflect an event associated with a user account, wherein the multimedia content item includes video content;

identifying a set of content items associated with the user account;

acquiring the set of content items and information associated with of the set of content items or the user account;

determining relevance of each content item of the set of the content items relative to the user or user account based on the information;

ranking the relevance of the set of content items based on a ranking algorithm,

wherein the ranking algorithm increases rankings for at least some content items determined by an image classification process to contain one or more faces; and

wherein the ranking algorithm ranks the set of content items containing one or more faces based on affinity coefficients between the user account and one or more persons identified by a facial recognition technique from the one or more faces;

selecting a subset of content items out of the set of content items, wherein each content item in the subset satisfies one or more ranking thresholds; and

generating the multimedia content item based on the subset of content items, wherein generating the multimedia content item comprises;

converting non-visual content items in the subset of content items into image representations of the non-visual content items, wherein the non-visual content items include at least one of a text, a post, a status update, or an audio item; and

placing the image representations of the non-visual content items into the video content.

19. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform:

detecting a trigger event for generating a multimedia content item designed to reflect an event associated with a user account, wherein the multimedia content item includes video content;

identifying a set of content items associated with the user account;

acquiring the set of content items and information associated with of the set of content items or the user account;

determining relevance of each content item of the set of the content items relative to the user or user account based on the information;

ranking the relevance of the set of content items based on a ranking algorithm,

wherein the ranking algorithm increases rankings for at least some content items determined by an image classification process to contain one or more faces; and

wherein the ranking algorithm ranks the set of content items containing one or more faces based on affinity coefficients between the user account and one or more persons identified by a facial recognition technique from the one or more faces;

selecting a subset of content items out of the set of content items, wherein each content item in the subset satisfies one or more ranking thresholds; and

generating the multimedia content item based on the subset of content items, wherein generating the multimedia content item comprises;

converting non-visual content items in the subset of content items into image representations of the non-visual content items, wherein the non-visual content items include at least one of a text, a post, a status update, or an audio item; and

placing the image representations of the non-visual content items into the video content.