Navigating recorded multimedia content using keywords or phrases

• US 20070027844A1
• Filed: 07/28/2005
• Published: 02/01/2007
• Est. Priority Date: 07/28/2005
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Toub, Stephen, Del Conte, Derek
• Application Number:
  US11/191,400
• Publication Number:
  US 20070027844A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/322 used signal is digitally coded

Abstract

Example embodiments allow a user to search for keywords or phrases within a recorded multimedia content (e.g., songs, video, recorded meetings, etc.), and then jump to those positions in the video or audio where the keyword or phrase occurs. A transcription index file is generated that includes searchable text with time codes corresponding to portions of the multimedia content where dialog, monolog, lyrics, or other words occur. Accordingly, a user can search the transcription index file, receive snippets of the dialog, monolog, lyrics, or other words, and/or navigate to those portions of the multimedia content corresponding to the times where the keywords or phrases appear. In addition, the present invention also provides metadata of the transcription index file that will allow a user to locate a multimedia file that contains the keywords or phrases even when a user has numerous multimedia files.

Claims

1. In a multimedia computing system, a method of navigating through recorded multimedia content by searching for keywords or phrases within the multimedia content, the method comprising acts of:

receiving user input of one or more keywords when requesting a search of multimedia content that includes the one or more keywords within dialog, monolog, lyrics, or other words for the multimedia content;

accessing a transcription index file, which includes searchable text data with corresponding time codes for one or more time periods within the dialog, monolog, lyrics, or other words for the multimedia content; and

using a search engine to automatically scan the transcription index file and return results that include a portion of the dialog, monolog, lyrics, or other words that correspond to the one or more keywords.

2. The method of claim 1, wherein the multimedia content for the portion of dialog, monolog, lyrics, or other words returned is automatically played in accordance with the corresponding time code.

3. The method of claim 1, wherein the results returned include a list of snippets for the dialog, monolog, lyrics, or other words that include the one or more keywords, and wherein each snippet within the list includes a link to those portions of multimedia content that correspond to the time codes for such snippet.

4. The method of claim 1, wherein the transcription index file was generated based on one or more of a closed caption data stream, sound stream, video stream, or a downloaded file.

5. The method of claim 4, wherein the transcription index file is generated based on the closed caption data stream, and wherein the generation comprises acts of:

buffering an amount of text from among a plurality of commands within the closed caption data stream;

receiving a closed caption command associated with rendering the amount of text on a display; and

upon receiving the closed caption command;

extracting the amount of text for insertion into the transcription index file, and

assigning a time code to the amount of text within transcription index file corresponding to when the command to render the amount of text was received.

6. The method of claim 4, wherein the transcription index file is generated on-the-fly while the multimedia content is being consumed based on either the closed caption data stream, sound stream, or video stream.

7. The method of claim 1, wherein the results returned include a plurality of snippets of the multimedia content that include the one or more keywords, and wherein the plurality of snippets are recorded into a separate multimedia file with a corresponding transcription index file corresponding to the dialog, monolog, lyrics, or other words within multimedia content of the plurality of snippets.

8. In a multimedia computing system, a method of searching for recorded multimedia content by utilizing searchable metadata that was transcribed from dialog, monolog, lyrics, or other words within the multimedia content, the method comprising acts of:

receiving one or more keywords as user input when requesting a search for multimedia content from among a plurality of multimedia files, wherein each of the plurality of multimedia files includes multimedia content used for consumption at a playing device;

accessing metadata for each of the plurality of multimedia files, the metadata for each of the plurality of multimedia files including searchable text of the dialog, monolog, lyrics, or other words for the multimedia content within each of the plurality of multimedia files; and

using a search engine to automatically scan the metadata for each of the plurality of multimedia files; and

returning the multimedia content from among the plurality of multimedia files that includes the one or more keywords for rendering at least a portion of the multimedia content at the playing device.

9. The method of claim 8, wherein a plurality of multimedia content from the plurality of multimedia files is returned that includes the one or more keywords, and wherein user input selects the multimedia content from among the plurality of multimedia content for consumption at the playing device.

10. The method of claim 8, wherein the multimedia content is further navigated through by performing a method comprising acts of:

accessing a transcription index file for the multimedia content, which includes searchable text data with corresponding time codes for one or more time periods within the dialog, monolog, lyrics, or other words for the multimedia content; and

using a search engine to automatically scan the transcription index file and return results that include a portion of the dialog, monolog, lyrics, or other words that correspond to the one or more keywords.

11. The method of claim 10, wherein the multimedia content for the portion of dialog, monolog, lyrics, or other words returned is automatically played in accordance with the corresponding time code.

12. The method of claim 10, wherein the results returned include a list of snippets for the dialog, monolog, lyrics, or other words that include the one or more keywords, and wherein each snippet within the list includes a link to those portions of multimedia content that correspond to the time codes for such snippet.

13. The method of claim 10, wherein the transcription index file was generated based on one or more of a closed caption data stream, sound stream, video stream, or a downloaded file.

14. The method of claim 13, wherein the transcription index file is generated based on the closed caption data stream, and wherein the generation comprises acts of:

buffering an amount of text from among a plurality of commands within the closed caption data stream;

receiving a closed caption command associated with rendering the amount of text on a display; and

upon receiving the closed caption command;

extracting the amount of text for insertion into the transcription index file, and

assigning a time code to the amount of text within transcription index file corresponding to when the command to render the amount of text was received.

15. The method of claim 13, wherein the transcription index file is generated on-the-fly while the multimedia content is being consume based on one or more of the closed caption data stream, sound stream, or video stream.

16. In a multimedia computing system, a computer program product for implementing a method of navigating through recorded multimedia content by searching for keywords or phrases within the multimedia content, the computer program product comprising one or more computer readable media having stored thereon computer executable instructions that, when executed by a processor, can cause the multimedia computing system to perform the following:

receive user input of one or more keywords when requesting a search of multimedia content that includes the one or more keywords within dialog, monolog, lyrics, or other words for the multimedia content;

access a transcription index file, which includes searchable text data with corresponding time codes for one or more time periods within the dialog, monolog, lyrics, or other words for the multimedia content; and

use a search engine to automatically scan the transcription index file and return results that include a portion of the dialog, monolog, lyrics, or other words that correspond to the one or more keywords.

17. The computer program product of claim 16, wherein the results returned include a list of snippets for the dialog, monolog, lyrics, or other words that include the one or more keywords, and wherein each snippet within the list includes a link to those portions of multimedia content that correspond to the time codes for such snippet.

18. The computer program product of claim 16, wherein the transcription index file was generated based on one or more of a closed caption data stream, sound stream, video stream, or a downloaded file.

19. The computer program product of claim 18, wherein the transcription index file is generated based on the closed caption data stream, and wherein the computer program product further comprises computer executable instructions that can cause the multimedia computing system to perform the following for generating the transcription index file:

buffer an amount of text from among a plurality of commands within the closed caption data stream;

receive a closed caption command associated with rendering the amount of text on a display; and

upon receiving the closed caption command;

extract the amount of text for insertion into the transcription index file, and

assign a time code to the amount of text within transcription index file corresponding to when the command to render the amount of text was received.

20. The computer program product of claim 18, wherein the transcription index file is generated on-the-fly while the multimedia content is being consumed based on one or more of the closed caption data stream, sound stream, or video stream.