User-directed navigation of multimedia search results

• US 20070106646A1
• Filed: 03/31/2006
• Published: 05/10/2007
• Est. Priority Date: 11/09/2005
• Status: Abandoned Application

• Current Assignee: Ramp Holdings, Inc. (Massachusetts)
• Original Assignee: BBNT Solutions LLC (Rtx Corporation)
• Inventors: Houh, Henry, Stern, Jeffrey, Spina, Robert, Jiang, Jian
• Application Number:
  US11/395,732
• Publication Number:
  US 20070106646A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data

Abstract

According to one aspect, a computerized method and apparatus for generating and presenting search snippets that enable user-directed navigation of the underlying audio/video content. The method involves obtaining metadata associated with discrete media content that satisfies a search query. The metadata identifies a number of content segments and corresponding timing information derived from the underlying media content using one or more automated media processing techniques. Using the timing information identified in the metadata, a search result or “snippet” can be generated that enables a user to arbitrarily select and commence playback of the underlying media content at any of the individual content segments.

Claims

1. A computerized method of generating search results for media content, comprising:

obtaining metadata associated with a discrete media content that satisfies a search query, the metadata identifying content segments and corresponding timing information derived from the discrete media content using one or more automated media processing techniques; and

generating a search result that enables a user to arbitrarily select and commence playback of the discrete media content at any of the content segments using the corresponding timing information identified in the metadata.

2. The computerized method of claim 1 further comprising:

obtaining the metadata associated with the discrete media content that satisfies the search query, the corresponding timing information including offsets corresponding to each of the content segments within the discrete media content, and the metadata further including a transcription for each of the content segments;

generating the search result that includes transcriptions of one or more of the content segments identified in the metadata, each of the transcriptions being mapped to an offset of a corresponding content segment; and

adapting the search result to enable the user to arbitrarily select any of the one or more content segments for playback through user selection of one of the transcriptions provided in the search result and to cause playback of the discrete media content at an offset of a corresponding content segment mapped to the selected one of the transcriptions.

3. The method of claim 2 wherein the transcription for each of the content segments is derived from the discrete media content using one or more automated media processing techniques or obtained from closed caption data associated with the discrete media content.

4. The computerized method of claim 2 further comprising:

generating the search result to further include a user actuated display element that uses the timing information to enable the user to navigate from an offset of one content segment to an offset of another content segment within the discrete media content in response to user actuation of the element.

5. The computerized method of claim 1 further comprising:

generating the search result to include the user actuated display element that uses the timing information to enables a user to navigate from an offset of one content segment to an offset of another content segment within the discrete media content in response to user actuation of the element.

6. The computerized method of claim 5 further comprising:

obtaining the metadata associated with the discrete media content that satisfies the search query, the corresponding timing information including offsets corresponding to each of the content segments within the discrete media content; and

adapting the user actuated display element to respond to user actuation of the element by causing playback of the discrete media content commencing at one of the content segments having an offset that is prior to or subsequent to the offset of a content segment in presently playback.

7. The computerized method of claim 1 wherein one or more of the content segments identified in the metadata include word segments, audio speech segments, video segments, non-speech audio segments, or marker segments.

8. The computerized method of claim 1 wherein one or more of the content segments identified in the metadata include audio corresponding to an individual word, audio corresponding to a phrase, audio corresponding to a sentence, audio corresponding to a paragraph, audio corresponding to a story, audio corresponding to a topic, audio within a range of volume levels, audio of an identified speaker, audio during a speaker turn, audio associated with a speaker emotion, audio of non-speech sounds, audio separated by sound gaps, audio separated by markers embedded within the media content or audio corresponding to a named entity.

9. The computerized method of claim 1 wherein one or more of the content segments identified in the metadata include video of individual scenes, watermarks, recognized objects, recognized faces, overlay text or video separated by markers embedded within the media content.

10. The computerized method of claim 2, wherein the metadata associates a confidence level with the transcription for each of the identified content segments, and the method further comprises:

generating the search result that includes transcriptions of one or more of the content segments identified in the metadata, such that each transcription having a confidence level that fails to satisfy a predefined threshold is displayed with one or more predefined symbols.

11. The computerized method of claim 2, wherein the metadata associates a confidence level with the transcription for each of the identified content segments, and the method further comprises:

ranking the search result based on a confidence level associated with the corresponding content segment.

12. The method of claim 1 further comprising downloading the search result to a client for presentation, further processing or storage.

13. A computerized method of presenting search results for media content, comprising:

presenting a search result that enables a user to arbitrarily select and commence playback of the discrete media content at any of the content segments of the discrete media content using timing offsets derived from the discrete media content using one or more automated media processing techniques.

14. The computerized method of claim 13, further comprising:

presenting the search result including transcriptions of one or more of the content segments of the discrete media content, each of the transcriptions being mapped to a timing offset of a corresponding content segment;

receiving a user selection of one of the transcriptions presented in the search result; and

causing playback of the discrete media content at a timing offset of the corresponding content segment mapped to the selected one of the transcriptions.

15. The computerized method of claim 13 wherein each of the transcriptions is derived from the discrete media content using one or more automated media processing techniques or obtained from closed caption data associated with the discrete media content.

16. The computerized method of claim 14 further comprising:

presenting the search result which further includes a user actuated display element that enables the user to navigate from an offset of one content segment to another content segment within the discrete media content in response to user actuation of the element.

17. The computerized method of claim 13 further comprising:

presenting the search result which includes a user actuated display element that enables the user to navigate from an offset of one content segment to another content segment within the discrete media content in response to user actuation of the element.

18. The computerized method of claim 17 further comprising:

obtaining timing offsets corresponding to each of the content segments within the discrete media content;

in response to an indication of user actuation of the display element, determining a playback offset associated with the discrete media content in playback;

comparing the playback offset with the timing offsets corresponding to each of the content segments to determine which of the content segments is presently in playback; and

causing playback of the discrete media content to continue at an offset that is prior to or subsequent to the offset of the content segment presently in playback.

19. The computerized method of claim 13 wherein one or more of the content segments identified in the metadata include word segments, audio speech segments, video segments, non-speech audio segments, or marker segments.

20. The computerized method of claim 13 wherein one or more of the content segments identified in the metadata include audio corresponding to an individual word, audio corresponding to a phrase, audio corresponding to a sentence, audio corresponding to a paragraph, audio corresponding to a story, audio corresponding to a topic, audio within a range of volume levels, audio of an identified speaker, audio during a speaker turn, audio associated with a speaker emotion, audio of non-speech sounds, audio separated by sound gaps, audio separated by markers embedded within the media content or audio corresponding to a named entity.

21. The computerized method of claim 13 wherein one or more of the content segments identified in the metadata include video of individual scenes, watermarks, recognized objects, recognized faces, overlay text or video separated by markers embedded within the media content.

22. The computerized method of claim 14, wherein each of the transcriptions is associated with a confidence level, and the method further comprises:

presenting the search result including the transcriptions of the one or more of the content segments of the discrete media content, such that any transcription that is associated with a confidence level that fails to satisfy a predefined threshold is displayed with one or more predefined symbols.

23. An apparatus for generating search results for media content, comprising:

means for obtaining metadata associated with a discrete media content that satisfies a search query, the metadata identifying content segments and corresponding timing information derived from the discrete media content using one or more automated media processing techniques; and

means for generating a search result that enables a user to arbitrarily select and commence playback of the discrete media content at any of the content segments using the corresponding timing information identified in the metadata.

24. An apparatus for presenting search results for media content, comprising:

means for presenting a search result that enables a user to arbitrarily select and commence playback of the discrete media content at any of the content segments of the discrete media content using timing offsets derived from the discrete media content using one or more automated media processing techniques.