USER-DIRECTED NAVIGATION OF MULTIMEDIA SEARCH RESULTS

• US 20160188577A1
• Filed: 02/18/2016
• Published: 06/30/2016
• Est. Priority Date: 11/09/2005
• Status: Abandoned Application

• Current Assignee: Cxense ASA
• Original Assignee: Cxense ASA
• Inventors: Houh, Henry, Stern, Jeffrey Nathan
• Application Number:
  US15/047,372
• Publication Number:
  US 20160188577A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/489 using time information
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data

Abstract

A method and apparatus for timed tagging of content is featured. The method and apparatus can include the steps of, or structure for, obtaining at least one keyword tag associated with discrete media content; generating a timed segment index of discrete media content, the timed segment index identifying content segments of the discrete media content and corresponding timing boundaries of the content segments; searching the timed segment index for a match to the at least one keyword tag, the match corresponding to at least one of the content segments identified in the segment index; and generating a timed tag index that includes the at least one keyword tag and the timing boundaries corresponding to the least one content segment of the discrete media content containing the match.

Claims

1. A computer-implemented method for creating timing metadata for streaming media files, the method comprising:

receiving the streaming media file;

applying at least two processing routines to the streaming media file, the at least two processing routines defining timing boundaries for a number of content segments within the streaming media file, the content segments including at least two of;

timed words segments, timed audio segments, timed video segments, timed non-speech audio segments and timed marker segments;

generating timing metadata, the timing metadata including descriptive parameters for each of the at least two of;

timed words segments, timed audio segments, timed video segments, timed non-speech audio segments and timed marker segments; and

storing the timing metadata in an index accessible by search-driven applications.

2. The computer-implemented method of claim 1 wherein the descriptive parameters for each of the timed word segments includes a segment identifier, text of an individual word, and timing information defining the boundaries of the timed word segment.

3. The computer-implemented method of claim 1 wherein descriptive parameters for each of the timed audio speech segments includes a segment identifier, an audio speech segment type, and timing information defining the boundaries of timed audio speech segment.

4. The computer-implemented method of claim 1 wherein descriptive parameters for each of the timed video segments includes a segment identifier, a video segment type, and timing information defining the boundaries of the timed video segment.

5. The computer-implemented method of claim 1 wherein descriptive parameters for each of the timed non-speech audio segments includes a segment identifier, a non-speech audio segment type and timing information defining the boundaries of the timed non-speech audio segment.

6. The computer-implemented method of claim 1 wherein descriptive parameters for each of the timed marker segments includes a segment identifier, a marker segment type and timing information defining the boundaries of the timed marker segment.

7. The computer-implemented method of claim 1 wherein the at least two processing routines include at least two of:

speech recognition, natural language processors, video frame analyzers, non-speech analyzers, market extractors and embedded metadata processors.

8. The computer-implemented method of claim 1 wherein the processing routines are audio/video processing routines.

9. The computer-implemented method of claim 1 wherein streaming media files are audio/video podcasts.

10. The computer-implemented method of claim 1 further comprising the steps of:

extracting descriptor metadata from text and embedded metatags of a content descriptor of the streaming media files; and

combining the descriptor metadata with the timing metadata; and

storing the combined metadata in an index accessible by search-driven applications.

11. A system for creating timing metadata for streaming media files, the system comprising:

(a) a computer server programmed to;

(i) receive the streaming media file;

(ii) apply at least two processing routines to the streaming media file, the least two processing routines defining timing boundaries for a number of content segments within the streaming media file, the content segments including at least two of;

timed words segments, timed audio segments, timed video segments, timed non-speech audio segments and timed marker segments;

(iii) generate timing metadata, the timing metadata including descriptive parameters for each of the at least two of;

timed words segments, timed audio segments, timed video segments, timed non-speech audio segments and timed marker segments; and

(iv) store the timing metadata in an index accessible by search-driven applications; and

(b) at least one client device, the at least one client device being coupled to the computer server and capable of searching the index and capable of using the timing metadata to commence playback of the streaming media file at a desired content segment.

12. The system of claim 11 wherein the descriptive parameters for each of the timed word segments includes a segment identifier, text of an individual word, and timing information defining the boundaries of the timed word segment.

13. The system of claim 11 wherein descriptive parameters for each of the timed audio speech segments includes a segment identifier, an audio speech segment type, and timing information defining the boundaries of the timed audio speech segment.

14. The system of claim 11 wherein descriptive parameters for each of the timed video segments includes a segment identifier, a video segment type, and timing information defining the boundaries of the timed video segment.

15. The system of claim 11 wherein descriptive parameters for each of the timed non-speech audio segments includes a segment identifier, a non-speech audio segment type and timing information defining the boundaries of the timed non-speech audio segment.

16. The system of claim 11 wherein descriptive parameters for each of the timed marker segments includes a segment identifier, a marker segment type and timing information defining the boundaries of the timed marker segment.

17. The system of claim 11 wherein the at least two processing routines include at least two of:

speech recognition, natural language processors, video frame analyzers, non-speech analyzers, market extractors and embedded metadata processors.

18. The system of claim 11 wherein the processing routines are audio/video processing routines.

19. The system of claim 11 wherein streaming media files are audio/video podcasts.

20. The system of claim 11 wherein the computer server is further programmed to:

extract descriptor metadata from text and embedded metatags of a content descriptor of the streaming media files; and

combine the descriptor metadata with the timing metadata; and

store the combined metadata in an index accessible by search-driven applications.