Method and system for indexing and searching timed media information based upon relevance intervals

• US 8,706,735 B2
• Filed: 07/31/2013
• Issued: 04/22/2014
• Est. Priority Date: 07/06/2000
• Status: Expired due to Fees

• Current Assignee: Comcast Cable Communications Management LLC (Comcast Corporation)
• Original Assignee: StreamSage Inc (Comcast Corporation)
• Inventors: Morton, Michael Scott, Unger, Noam Carl, Rubinoff, Robert, Davis, Anthony Ruiz, Aveni-Deforge, Kyle, Simon, Sibley Verbeck
• Primary Examiner(s): LEWIS, CHERYL RENEA
• Application Number:
  US13/955,582
• Publication Number:
  US 20130318121A1
• Time in Patent Office: 265 Days
• Field of Search: 707/725, 707/746, 707/805, 707/821, 707/822
• US Class Current: 707/746
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/447 Temporal browsing, e.g. timeline
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06F 40/253 Grammatical analysis; Style critique
• CPC Class Codes: G06F 40/263 Language identification
• CPC Class Codes: Y10S 707/913 Multimedia
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

A method and system for indexing, searching, and retrieving information from timed media files based upon relevance intervals. The method and system for indexing, searching, and retrieving this information is based upon relevance intervals so that a portion of a timed media file is returned, which is selected specifically to be relevant to the given information representations, thereby eliminating the need for a manual determination of the relevance and avoiding missing relevant portions. The timed media includes streaming audio, streaming video, timed HTML, animations such as vector-based graphics, slide shows, other timed media, and combinations thereof.

Claims

1. A method, comprising:

determining, by at least one computer, based on a timed media file, data representing at least a word or phrase; and

using, by the at least one computer, the data to determine a first portion of the timed media file based on the word or phrase.

2. The method of claim 1, further comprising determining a plurality of occurrences of the word or phrase in the timed media file, wherein said using comprises using the data to determine the first portion such that the plurality of occurrences are within beginning and end points of the first portion.

3. The method of claim 1, further comprising:

using, by the at least one computer, the data to determine a plurality of occurrences of the word or phrase in the timed media file; and

determining, by the at least one computer, a first subset and a different second subset of the plurality of occurrences,

wherein said using comprises using the data to determine the first portion such that the first subset of the plurality of occurrences, and not the second subset of the plurality of occurrences, are within beginning and end points of the first portion.

4. The method of claim 3, further comprising using, by the at least one computer, the data to determine a second portion of the timed media file having a beginning point and an end point such that the second subset of the plurality of occurrences, and not the first subset of the plurality of occurrences, are within the beginning and end points of the second portion.

5. The method of claim 1, wherein said using the data to determine the first portion comprises determining the first portion to have at least a minimum length.

6. The method of claim 1, wherein the data represents at least a plurality of words or phrases, the method further comprising using, by the at least one computer, the data to determine a plurality of portions of the timed media file, one for each of the plurality of words or phrases, wherein the plurality of portions overlap each another within the timed media file.

7. The method of claim 1, wherein the data represents at least a plurality of words or phrases, the method further comprising:

using, by the at least one computer, the data to determine a plurality of portions of the timed media file, one for each of the plurality of words or phrases, wherein at least some of the plurality of portions are not contiguous with any others of the plurality of portions within the timed media file; and

generating, by the at least one computer, another timed media file comprising the plurality of portions, such that each of the plurality of portions is contiguous with another of the plurality of portions within the another timed media file.

8. The method of claim 1, wherein the timed media file comprises video, and said determining the data comprises determining the data using optical character recognition.

9. The method of claim 1, wherein the timed media file comprises audio, and said determining the data comprises determining the data using speech recognition.

10. The method of claim 1, wherein the timed media file comprises metadata, and said determining the data comprises determining data based on at least the metadata.

11. A method, comprising:

receiving, by at least one computer, a query;

determining, by the at least one computer, based on the query, a beginning point and an end point of each of a plurality of portions of first timed media data, wherein at least some of the portions are not contiguous with any others of the plurality of portions within the first timed media data; and

generating, by the at least one computer, second timed media data comprising the plurality of portions, such that each of the portions is contiguous with another of the plurality of portions within the second timed media data.

12. The method of claim 11, wherein said determining comprises determining the portions such that at least some of the portions overlap each other within the first timed media data.

13. The method of claim 11, wherein the timed media data comprises video, and said determining comprises determining at least some of the plurality of portions using optical character recognition.

14. The method of claim 11, wherein the timed media data comprises audio, and said determining comprises determining at least some of the plurality of portions using speech recognition.

15. The method of claim 11, wherein the timed media data comprises metadata, and said determining comprises determining at least some of the plurality of portions based on at least the metadata.

16. A method, comprising:

receiving, by at least one computer, a search term;

determining, by the at least one computer, based on the search term, a beginning point and an end point of each of a plurality of portions of first audio and video data, wherein at least some of the portions are not contiguous with any others of the portions within the first audio and video data; and

generating, by the at least one computer, second data comprising the plurality of portions, such that each of the portions is contiguous with another of the portions within the second data.

17. The method of claim 16, wherein said determining comprises determining the portions such that at least some of the portions overlap each other within the first audio and video data.

18. The method of claim 16, wherein said determining comprises determining at least some of the plurality of portions using optical character recognition.

19. The method of claim 16, wherein determining comprises determining at least some of the plurality of portions using speech recognition.

20. The method of claim 16, wherein the audio and video data further comprises metadata, and said determining comprises determining at least some of the plurality of portions based on at least the metadata.