Automatic Segmentation of Video

• US 20120011109A1
• Filed: 07/09/2010
• Published: 01/12/2012
• Est. Priority Date: 07/09/2010
• Status: Active Grant

• Current Assignee: Comcast Cable Communications LLC (Comcast Corporation)
• Original Assignee: Comcast Cable Communications LLC (Comcast Corporation)
• Inventors: Ambwani, Geetu, Davis, Anthony R.
• Granted Patent: US 8,423,555 B2
• Time in Patent Office: Days
• US Class Current: 707/722
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/90344 by using string matching techniques
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/278 Content descriptor database or directory service for end-user access details of content or meta data based information retrieval of video data in video databases G06F16/739
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text

Abstract

Content items may be segmented and labeled by topic to provide for the capture, analysis, indexing, retrieval and/or distribution of information within information rich media, such as audio or video, with greater functionality, accuracy and speed. The segments and other related information may be stored in a database and made accessible to users through, for example, a search service and/or an on-demand service. Automatic segmentation may include receiving a text representation, calculating relevance intervals based on the text representation, determining a nodal representation based on the relevance intervals, and determining segments of the content item based on the nodal representation.

Claims

1. A method comprising:

receiving, at a computing device, text of a content item, the text including a plurality of term strings, each term string including one or more terms;

determining a set of relevance intervals for a corresponding set of terms in the text, the relevance intervals each identifying one or more sections of the content item that are relevant to a corresponding term; and

for a first term string of the plurality of term strings, determining a first set of nodes based on the set of relevance intervals, and

using the nodes to identify one or more segment boundaries within the content item.

2. The method of claim 1, wherein each term string of the plurality of term strings is a sentence.

3. The method of claim 1, further comprising:

for a second term string of the plurality of term strings, determining a second set of nodes based on the set of relevance intervals; and

determining connections between nodes in the first set of nodes and the second set of nodes.

4. The method of claim 3, wherein a connection of the connections is a connection strength that includes a contextualized measurement of the relatedness between a first node in the first set of nodes and a second node in the second set of nodes.

5. The method of claim 3, further comprising:

filtering the connections based on at least one of the number of connection between the first set of nodes and the second set of nodes, and a cumulative value of connection strengths associated with the connections between the first set of nodes and the second set of nodes.

6. The method of claim 3, further comprising:

determining that a segment boundary occurs between the first set of nodes and the second set of nodes based on the connections.

7. The method of claim 6, further comprising:

determining a segment of the content item based on the segment boundary.

8. The method of claim 7, further comprising:

transmitting information based on the segment of the content item to a user device.

9. The method of claim 7, further comprising:

determining a topic for the segment of the content item based on at least one of the first set of nodes, the second set of nodes, and the text.

10. The method of claim 9, wherein determining the topic is further based on at least one of the frequency of occurrences of the terms of the text and a determined central node based on a term centrality measurement.

11. An apparatus comprising:

a processor; and

memory operatively coupled to the processor and storing computer readable instructions that, when executed, cause the apparatus to;

receive, at a computing device, text of a content item, the text including a plurality of term strings, each term string including one or more terms;

determine a set of relevance intervals for a corresponding set of terms in the text, of the relevance intervals identifying one or more sections of a content item that are relevant to a corresponding term;

for a first term string of the plurality of term strings, determine a first set of nodes based on the set of relevance intervals; and

use the nodes to identify one or more segment boundaries within the content item.

12. The apparatus of claim 11, wherein the instructions, when executed, further cause the apparatus to:

for a second term string of the plurality of term strings, determine a second set of nodes based on the set of relevance intervals; and

determine connections between nodes in the first set of nodes and the second set of nodes.

13. The apparatus of claim 12, wherein a connection of the connections is a connection strength that includes a contextualized measurement of the relatedness between a first node in the first set of nodes and a second node in the second set of nodes.

14. The apparatus of claim 12, wherein the computer readable instructions, when executed, further cause the apparatus to:

filter the connections based on at least one of the number of connections between the first set of nodes and the second set of nodes, and a cumulative value of connection strengths associated with the connections between the first set of nodes and the second set of nodes.

15. The apparatus of claim 12, wherein the computer readable instructions, when executed, further cause the apparatus to:

determine that a segment boundary occurs between the first set of nodes and the second set of nodes based on the connections.

16. The apparatus of claim 15, wherein the computer readable instructions, when executed, further cause the apparatus to:

determine a segment of the content item based on the segment boundary.

17. The apparatus of claim 16, wherein the computer readable instructions, when executed, further cause the apparatus to:

transmit information based on the segment of the content item to a user device.

18. The apparatus of claim 16, wherein the computer readable instructions, when executed, further cause the apparatus to:

determine a topic for the segment of the content item based on at least one of the first set of nodes, the second set of nodes, and the text.

19. The apparatus of claim 18, wherein determining the topic is further based on at least one of the frequency of occurrences of the terms of the text and a determined central node based on a term centrality measurement.

20. One or more computer readable medium storing computer readable instructions that, when executed, cause a processor to:

receive, at a computing device, text of a content item, the text including a plurality of term strings, each term string including one or more terms;

determine a set of relevance intervals for a corresponding set of terms in the text, of the relevance intervals identifying one or more sections of a content item that are relevant to a corresponding term;

for a first term string of the plurality of term strings, determine a first set of nodes based on the set of relevance intervals; and

use the nodes to identify one or more segment boundaries within the content item.