Method and system for storytelling on a computing device via user editing

• US 10,353,942 B2
• Filed: 12/19/2013
• Issued: 07/16/2019
• Est. Priority Date: 12/19/2012
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Oath Inc. (Verizon Communications Inc.)
• Inventors: Imbruce, Doug, Pape, Gregory, Knutsson, Gustav Johan Rasmus
• Primary Examiner(s): Nguyen, Merilyn P
• Application Number:
  US14/135,146
• Publication Number:
  US 20140181010A1
• Time in Patent Office: 2,035 Days
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/45 Clustering; Classification
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/489 using time information
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing

Abstract

Disclosed is a method and system for enabling storytelling on a computing device. A processor analyzes a set of media items associated with the user, each media item having associated metadata. The processor identifies one or more related characteristics among the media items in the set to form a cluster of media items associated with an event associated with the user. The processor selects templates from a template database, each template configured to represent a moment in the event. The processor edits selected media items in the cluster to fit into the selected templates. The processor creates a mixed-media module comprising the templates organized into a desired sequence. The processor displays, to the user, a preview of the mixed-media module, receives edit commands for editing the module, and applies the edit commands to the module to create a final module. The processor then displays the final mixed-media module.

Claims

1. A method comprising:

analyzing, by a processor of a computing device operated by a user, a set of media items associated with the user, each media item having associated metadata, a portion of the media items in the set obtained from a first application on the computing device and a portion of the media items in the set obtained from a second application on the computing device, one of the first application and the second application comprising a social media application;

identifying, by the processor, based on analysis of the associated metadata, one or more related characteristics among the media items in the set;

forming, by the processor, a cluster of media items that includes the media items that have the related characteristics, said cluster corresponding to an event defined by the related characteristics;

selecting, by the processor and based on analysis of the media items in the cluster, a plurality of templates from a template database, each template of the plurality of templates configured to represent a moment in the event;

editing, by the processor, selected media items in the cluster to fit into the selected templates;

creating, by the processor, a mixed-media module comprising the plurality of templates organized into a desired sequence for the selected templates;

displaying, by the processor to the user, a preview of the mixed-media module;

receiving, by the processor, edit commands from the user for editing the mixed-media module, at least one edit command corresponding to a first moment of the event within said desired sequence;

applying, by the processor, the edit commands to the mixed-media module to create a final mixed-media module, said applying of the edit commands to the mixed-media module causing the first moment to be modified according to the at least one edit command such that media of the first moment is altered and the first moment in said desired sequence is renderable at a different pace than other moments of said event; and

displaying, by the processor via a software application, the final mixed-media module, said display causing the media items associated with said first moment to be rendered according to said different pace.

2. The method of claim 1, further comprising analyzing, by the processor, the associated metadata of each media item in the set.

3. The method of claim 1, further comprising obtaining, by the processor, the media items in the set.

4. The method of claim 1, further comprising analyzing, by the processor, the media items in the cluster.

5. The method of claim 1, further comprising determining, by the processor, the desired sequence for the selected templates.

6. The method of claim 1, further comprising displaying, by the processor to the user, edit functions for editing the mixed-media module.

7. The method of claim 1, wherein the receiving of the edit commands further comprises receiving a song or music.

8. The method of claim 1, wherein the receiving of the edit commands further comprises receiving one or more of a caption, a comment, and a title of the mixed-media module.

9. A computing device comprising:

a processor;

a storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising;

analyzing logic executed by the processor for analyzing a set of media items associated with a user, each media item having associated metadata, a portion of the media items in the set obtained from a first application on the computing device and a portion of the media items in the set obtained from a second application on the computing device, one of the first application and the second application comprising a social media application;

identifying logic executed by the processor for identifying, based on analysis of the associated metadata, one or more related characteristics among the media items in the set;

cluster logic executed by the processor for forming a cluster of media items that includes the media items that have the related characteristics, said cluster corresponding to an event defined by the related characteristics;

selecting logic executed by the processor for selecting, based on analysis of the media items in the cluster, a plurality of templates from a template database, each template of the plurality of templates configured to represent a moment in the event;

editing logic executed by the processor for editing selected media items in the cluster to fit into the selected templates;

creating logic executed by the processor for creating a mixed-media module comprising the plurality of templates organized into a desired sequence for the selected templates;

displaying logic executed by the processor for displaying to the user a preview of the mixed-media module;

receiving logic executed by the processor for receiving edit commands from the user for editing the mixed-media module, at least one edit command corresponding to a first moment of the event within said desired sequence;

applying logic executed by the processor for applying the edit commands to the mixed-media module to create a final mixed-media module, said applying of the edit commands to the mixed-media module causing the first moment to be modified according to the at least one edit command such that media of the first moment is altered and the first moment in said desired sequence is renderable at a different pace than other moments of said event; and

displaying logic executed by the processor for displaying, via a software application, the final mixed-media module, said display causing the media items associated with said first moment to be rendered according to said different pace.

10. The computing device of claim 9, further comprising metadata analyzing logic executed by the processor for analyzing the associated metadata of each media item in the set.

11. The computing device of claim 9, further comprising obtaining logic executed by the processor for obtaining the media items in the set.

12. The computing device of claim 9, further comprising cluster analyzing logic executed by the processor for analyzing the media items in the cluster.

13. The computing device of claim 9, further comprising determining logic executed by the processor for determining the desired sequence for the selected templates.

14. The computing device of claim 9, further comprising edit function displaying logic executed by the processor for displaying, to the user, edit functions for editing the mixed-media module.

15. The computing device of claim 9, wherein the receiving logic for receiving the edit commands further comprises receiving logic for receiving one or more of a song, music, a caption, a comment, and a title of the mixed-media module.

16. A server computer comprising:

a processor;

a storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising;

application communication logic executed by the processor for communicating a software application to a computing device operated by a user, the software application configured to;

analyze a set of media items associated with the user, each media item having associated metadata, a portion of the media items in the set obtained from a first application on the computing device and a portion of the media items in the set obtained from a second application on the computing device, one of the first application and the second application comprising a social media application;

identify, based on analysis of the associated metadata, one or more related characteristics among the media items in the set;

form a cluster of media items that includes the media items that have the related characteristics, said cluster corresponding to an event defined by the related characteristics;

select, based on analysis of the media items in the cluster, a plurality of templates from a template database, each template of the plurality of templates configured to represent a moment in the event;

edit selected media items in the cluster to fit into the selected templates;

create a mixed-media module comprising the plurality of templates organized into a desired sequence for the selected templates;

display, to the user, a preview of the mixed-media module;

receive edit commands from the user for editing the mixed-media module, at least one edit command corresponding to a first moment of the event within said desired sequence;

apply the edit commands to the mixed-media module to create a final mixed-media module, said applying of the edit commands to the mixed-media module causing the first moment to be modified according to the at least one edit command such that media of the first moment is altered and the first moment in said desired sequence is renderable at a different pace than other moments of said event; and

display the final mixed-media module, said display causing the media items associated with said first moment to be rendered according to said different pace.

17. A non-transitory computer readable storage medium tangibly storing computer program instructions capable of being executed by a computer processor, the computer program instructions defining the steps of:

communicating, by the computer processor, a software application to a computing device operated by a user, the software application configured to;

analyze a set of media items associated with the user, each media item having associated metadata, a portion of the media items in the set obtained from a first application on the computing device and a portion of the media items in the set obtained from a second application on the computing device, one of the first application and the second application comprising a social media application;

identify, based on analysis of the associated metadata, one or more related characteristics among the media items in the set;

form a cluster of media items that includes the media items that have the related characteristics, said cluster corresponding to an event defined by the related characteristics;

select, based on analysis of the media items in the cluster, a plurality of templates from a template database, each template of the plurality of templates configured to represent a moment in the event;

edit selected media items in the cluster to fit into the selected templates;

create a mixed-media module comprising the plurality of templates organized into a desired sequence for the selected templates;

display, to the user, a preview of the mixed-media module;

receive edit commands from the user for editing the mixed-media module, at least one edit command corresponding to a first moment of the event within said desired sequence;

apply the edit commands to the mixed-media module to create a final mixed-media module, said applying of the edit commands to the mixed-media module causing the first moment to be modified according to the at least one edit command such that media of the first moment is altered and the first moment in said desired sequence is renderable at a different pace than other moments of said event; and

display the final mixed-media module, said display causing the media items associated with said first moment to be rendered according to said different pace.

18. A method comprising:

communicating, by a processor, a software application to a computing device operated by a user, the software application configured to;

analyze a set of media items associated with the user, each media item having associated metadata, a portion of the media items in the set obtained from a first application on the computing device and a portion of the media items in the set obtained from a second application on the computing device, one of the first application and the second application comprising a social media application;

identify, based on analysis of the associated metadata, one or more related characteristics among the media items in the set;

form a cluster of media items that includes the media items that have the related characteristics, said cluster corresponding to an event defined by the related characteristics;

select, based on analysis of the media items in the cluster, a plurality of templates from a template database, each template of the plurality of templates configured to represent a moment in the event;

edit selected media items in the cluster to fit into the selected templates;

create a mixed-media module comprising the plurality of templates organized into a desired sequence for the selected templates;

display, to the user, a preview of the mixed-media module;

receive edit commands from the user for editing the mixed-media module, at least one edit command corresponding to a first moment of the event within said desired sequence;

apply the edit commands to the mixed-media module to create a final mixed-media module, said applying of the edit commands to the mixed-media module causing the first moment to be modified according to the at least one edit command such that media of the first moment is altered and the first moment in said desired sequence is renderable at a different pace than other moments of said event; and

display the final mixed-media module, said display causing the media items associated with said first moment to be rendered according to said different pace.

19. The method of claim 18, wherein the software application is further configured to:

analyze the associated metadata of each media item in the set;

obtain the media items in the set;

analyze the media items in the cluster;

determine the desired sequence for the selected templates; and

display, to the user, edit functions for editing the mixed-media module.