Method and system for generation of a table of content by processing multimedia content

• US 10,296,533 B2
• Filed: 07/07/2016
• Issued: 05/21/2019
• Est. Priority Date: 07/07/2016
• Status: Active Grant

• Current Assignee: Yen4Ken Inc. (VideoKen, Inc.)
• Original Assignee: Yen4Ken Inc. (VideoKen, Inc.)
• Inventors: Barhate, Sanket Sanjay, Loomba, Sahil, Gandhi, Ankit, Biswas, Arijit, Negi, Sumit, Deshmukh, Om D
• Primary Examiner(s): Alam, Shahid A
• Application Number:
  US15/203,868
• Publication Number:
  US 20180011860A1
• Time in Patent Office: 1,048 Days
• Field of Search: 707730
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/489 using time information

Abstract

The disclosed embodiments illustrate methods of generation of a table of content by processing multimedia content. The method includes identifying a set of key-phrases from the multimedia content based on one or more external data sources. The method further includes determining one or more segments of the multimedia content, based on the identified set of key-phrases, wherein a segment of the determined one or more segments comprises a subset of key-phrases from the set of key-phrases. The method further includes selecting at least a key-phrase from the subset of key-phrases of each of the corresponding one or more segments. The method further includes generating the table of content based on the selected key-phrase from each of the one or more segments, wherein the selected key-phrase from each of the one or more segments in the generated table of content is utilized to navigate through the multimedia content.

Claims

1. A method of generation of a table of content by processing multimedia content in a computing device, the method comprising:

identifying, by one or more processors in the computing device, a set of key-phrases from the multimedia content based on one or more external data sources, wherein the multimedia content is selected based on a request received from a user-computing device associated with a user;

determining, by the one or more processors in the computing device, one or more segments of the multimedia content, based on the identified set of key-phrases, wherein a segment of the determined one or more segments comprises a subset of key-phrases from the set of key-phrases;

identifying, by the one or more processors in the computing device, a plurality of keywords from the multimedia content by utilizing one or more text identification techniques;

determining by the one or more processors in the computing device, a first score for each of the identified plurality of keywords based on one or both of a visual saliency and a textual saliency associated with each of the plurality of keywords

selecting, by the one or more processors in the computing device, at least a key-phrase from the subset of key-phrases of each of the corresponding one or more segments by utilizing a sequence of topics in a directed graph, wherein the directed graph is determined based on the one or more external data sources; and

generating, by the one or more processors in the computing device, the table of content based on the selected key-phrase from each of the one or more segments, wherein the selected key-phrase from each of the one or more segments in the generated table of content is temporally sequenced and utilized to navigate through the multimedia content, wherein the generated table of content is presented to the user through a user-interface.

2. The methods of claim 1, wherein each key-phrase in the set of key-phrases comprises a corresponding set of keywords from the plurality of keywords, wherein each key-phrase of the set of key-phrases is associated with a corresponding timestamp that is indicative of an occurrence of the key-phrase in the multimedia content.

3. The method of claim 2, further comprising determining, by the one or more processors in the computing device, a second score for each key-phrase in the set of key-phrases, based on the first score of each keyword in the set of keywords in the corresponding key-phrase.

4. The method of claim 3, further comprising ranking, by the one or more processors in the computing device, each key-phrase in the subset of key-phrases associated with each of the one or more segments, based on the second score associated with each key-phrase in the subset of key-phrases.

5. The method of claim 3, where the selection of the key-phrase from the subset of key-phrases of each of the corresponding one or more segments is further based on the second score associated with each key-phrase in the subset of key-phrases.

6. The method of claim 1, wherein a segment of the one or more segments is associated with a topic of one or more topics in the multimedia content.

7. The method of claim wherein the directed graph comprises one or more nodes, wherein a node in the one or more nodes is associated with a topic of a plurality of topics in the one or more external data sources.

8. A system for by processing multimedia content in a computing device, the system comprising:

one or more processors in the computing device configured to;

identify a set of key-phrases from the multimedia content based on one or more external data sources, wherein the multimedia content is selected based on a request received from a user-computing device associated with a user;

determine one or more segments of the multimedia content, based on the identified set of key-phrases, wherein a segment of the determined one or more segments comprises a subset of key-phrases from the set of key-phrases;

identify a plurality of keywords from the multimedia content by utilizing one or more text identification techniques;

determine a first score for each of the identified plurality of keywords based on one or both of a visual saliency and a textual saliency associated with each of the plurality of keywords;

select at least a key-phrase from the subset of key-phrases of each of the corresponding one or more segments by utilizing a sequence of topics in a directed graph, wherein the directed graph is determined based on the one or more external data sources; and

generate the table of content based on the selected key-phrase from each of the one or more segments, wherein the selected key-phrase from each of the one or more segments in the generated table of content is temporally sequenced and utilized to navigate through the multimedia content, wherein the generated table of content is presented to the user through a user-interface.

9. The system of claim 8, wherein each key-phrase in the set of key-phrases comprises a corresponding set of keywords from the plurality of keywords, wherein each key-phrase of the set of key-phrases is associated with a corresponding timestamp that is indicative of an occurrence of the key-phrase in the multimedia content.

10. The system of claim 9, wherein the one or more processors in the computing device are further configured to determine a second score for each key phrase in the set of key-phrases, based on the first score of each keyword in the set of keywords in the corresponding key-phrase.

11. The system of claim 10, wherein the one or more processors in the computing device are further configured to rank each key-phrase in the subset of key-phrases associated with each of the one or more segments, based on the second score associated with each key-phrase in the subset of key-phrases.

12. The system of claim 10, where the selection of the key-phrase from the subset of key-phrases of each of the corresponding one or more segments is further based on the second score associated with each key-phrase in the subset of key-phrases.

13. The system of claim 8, wherein a segment of the one or more segments is associated with a topic of one or more topics in the multimedia content.

14. The system of claim 8, wherein the directed graph comprises one or more nodes, wherein a node in the one or more nodes is associated with a topic of a plurality of topics in the one or more external data sources.

15. A computer program product for use with a computer, the computer program product comprising a non-transitory computer readable medium, wherein the non-transitory computer readable medium stores a computer program code for generation of a table of content by processing multimedia content, Wherein the computer program code is executable by one or more processors in a computing device to:

identify a set of key-phrases from the multimedia content based on one or more external data sources, wherein the multimedia content is selected based on a request received from a user-computing device associated with a user;

determine one or more segments of the multimedia content, based on the identified set of key-phrases, wherein a segment of the determined one or more segments comprises a subset of key-phrases from the set of key-phrases;

identify a plurality of keywords from the multimedia content by utilizing one or more text identification techniques;

determine a first score for each of the identified plurality of keywords based on one or both of a visual saliency and a textual saliency associated with each of the plurality of keywords;

select at least a key-phrase from the subset of key-phrases of each of the corresponding one or more segments by utilizing a sequence of topics in a directed graph, ;

herein the directed graph is determined based on the one or more external data sources; and

generate the table of content based on the selected key-phrase from each of the one or more segments, wherein the selected key-phrase from each of the one or more segments in the generated table of content is temporally sequenced and utilized to navigate through the multimedia content, wherein the generated table of content is presented to the user through a user-interface.