Closed caption navigation

• US 20040177317A1
• Filed: 03/07/2003
• Published: 09/09/2004
• Est. Priority Date: 03/07/2003
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Bradstreet, John
• Application Number:
  US10/384,087
• Publication Number:
  US 20040177317A1
• Time in Patent Office: Days
• US Class Current: 715/500.1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/483 using metadata automatically derived from the content

Abstract

A transcription file enables navigation through multimedia content and dictates the manner in which the multimedia content is rendered. The transcription file is derived from multimedia content received by a computing system that is scanned for closed caption strings and other content that is used for creating tokens that are linked to one or more corresponding multimedia elements. The transcription file and tokens can be displayed as a combination of images and text by a user interface. The selection of a displayed token from the interface initiates the rendering of the multimedia content, commencing with the rendering of the one or more multimedia elements that are linked to the selected token. The interface is also configured for word processing and editing the transcription file, for enabling a user to modify the manner in which the multimedia content is rendered.

Claims

1. In a computing system that includes a processor configured to process multimedia content and that is connected with one or more multimedia rendering devices that are configured to render the multimedia content, a method for enabling a user to navigate through multimedia content with a transcription file that includes one or more tokens corresponding to one or more elements of the multimedia content, the method comprising:

an act of receiving multimedia content, the multimedia content including multimedia elements;

a step for obtaining a transcription file that reflects an intended presentation of the multimedia content, the transcription file including one or more tokens that can be used to navigate through the multimedia content, each token including a link corresponding to one or more multimedia elements and a timestamp that corresponds to the one or more multimedia elements; and

an act of displaying the transcription file, such that one or more of the tokens can be selected to initiate rendering of the multimedia content, the rendering of the multimedia content commencing with rendering of the one or more multimedia elements that correspond to a selected token.

2. A method as recited in claim 1, wherein the multimedia content includes broadcast multimedia content.

3. A method as recited in claim 1, wherein at least one of the one or more tokens includes an image.

4. A method as recited in claim 1, wherein at least one of the one or more tokens includes one or more word.

5. A method as recited in claim 4, wherein the one or more word is derived from closed caption text.

6. A method as recited in claim 4, wherein the one or more word is derived from voice recognition performed on the multimedia content.

7. A method as recited in claim 1, wherein the step for obtaining a transcription file includes:

an act of identifying elements of the multimedia content that can be used to create the one or more tokens; and

an act of linking the one or more tokens to the corresponding one or more multimedia elements by timestamp, the transcription file reflecting an intended presentation of the multimedia content.

8. A method as recited in claim 1, wherein the step for obtaining a transcription file further includes an act of determining a hierarchal organization of the tokens, such that at least one token includes one or more sub-tokens, the one or more sub-tokens identifying and linking to one or more multimedia element of the multimedia content.

9. A method as recited in claim 1, wherein the act of displaying the transcription file includes simultaneously displaying the transcription file while the multimedia content is rendered.

10. A method as recited in claim 9, wherein the act of displaying the transcription file further includes displaying an indicator in the transcription corresponding to the current playback position of the multimedia content.

11. A method as recited in claim 1, wherein the computing system obtains the transcription file from a third party that is remote from the computing system.

12. A method as recited in claim 11, wherein the third party edits the transcription file.

13. In a computing system that includes a processor configured to process multimedia content and that is connected with one or more multimedia rendering devices that are configured to render the multimedia content, a method for enabling a user to navigate through the multimedia content with a transcription file that includes one or more tokens corresponding to one or more elements of the multimedia content, the method comprising:

an act of receiving multimedia content, the multimedia content including multimedia elements;

an act of creating a transcription file that reflects an intended presentation of the multimedia content, the transcription file linking each token to the one or more multimedia elements it identifies, such that the one or more tokens can be used to navigate through the multimedia content; and

an act of displaying the transcription file, such that one or more of the tokens can be selected to initiate rendering of the multimedia content, the rendering of the multimedia content commencing with rendering of one or more multimedia elements that correspond to a selected one of the one or more tokens.

14. A method as recited in claim 13, further including an act of displaying a current playback position of the multimedia content in the transcription file when the multimedia content is rendered.

15. A method as recited in claim 13, further including an act of determining a hierarchal organization of tokens, each token identifying one or more multimedia elements by timestamp, such that at least one token includes one or more sub-tokens, the one or more sub-tokens identifying and linking to one or more multimedia element of the multimedia content.

16. A method as recited in claim 15, wherein the hierarchal organization of tokens enables a user to determine which of the one or more tokens and sub-tokens is available for selection from the transcription file to initiate rendering of the multimedia content.

17. A method as recited in claim 13, wherein the multimedia content includes broadcast multimedia content.

18. A method as recited in claim 13, wherein at least one of the one or more tokens includes an image.

19. A method as recited in claim 18, wherein the image includes an image derived from image processing performed on the multimedia content.

20. A method as recited in claim 13, wherein at least one of the one or more tokens includes one or more word.

21. A method as recited in claim 20, wherein the one or more words is derived from closed caption or subtitle text corresponding to the multimedia content.

22. A method as recited in claim 20, wherein the one or more words is derived from voice recognition performed on the multimedia content.

23. A method as recited in claim 13 wherein the one or more of the tokens is derived from a stream transmitted with in the multimedia content

24. A method as recited in claim 23, wherein the tokens includes at least one of a time, a weather alert, a financial report, a sporting report, and a news report.

25. A method as recited in claim 13, wherein the one or more tokens is derived from a content recognition systems.

26. A method as recited in claim 13, wherein the one or more tokens includes an animation.

27. A method as recited in claim 13, wherein the act of displaying the transcription file, includes displaying the transcription file with an interface that enables editing of the transcription file.

28. A method as recited in claim 27, where a playback position of the multimedia content is indicated in the transcription file

29. A method as recited in claim 27, wherein editing of the transcription file includes one or more of moving, copying, amending and deleting a portion of the transcription file.

30. A method, as recited in claim 29, wherein the multimedia content is displayed in an order reflected by the edited transcription file.

31. A method as recited in claim 29, wherein editing of the transcription file includes editing one or more token.

32. A method as recited in claim 31, wherein the transcription file is edited by a third party that is remotely located from the computing system.

33. A computer program product for use in a computing system that includes a processor configured to process multimedia content and that is connected with one or more multimedia rendering devices that are configured to render the multimedia content, the computer program product comprising:

one or more computer-readable media having computer-executable instructions stored thereon for implementing a method for enabling a user to navigate through the multimedia content with a transcription file that includes one or more tokens corresponding to one or more elements of the multimedia content, the method including;

an act of receiving multimedia content, the multimedia content including multimedia elements;

an act of creating a transcription file that reflects an intended presentation of the multimedia content, the transcription file linking each token to the one or more multimedia elements it identifies, such that the one or more tokens can be used to navigate through the multimedia content; and

an act of displaying the transcription file, such that one or more of the tokens can be selected to initiate rendering of the multimedia content, the rendering of the multimedia content commencing with rendering of one or more multimedia elements that correspond to a selected one of the one or more tokens.

34. A computer program product as recited in claim 33, wherein the act of displaying the transcription file, includes displaying the transcription file with an interface that enables editing of the transcription file.

35. A computer program product as recited in claim 34, wherein editing of the transcription file includes one or more of moving, copying, amending and deleting a portion of the transcription file.

36. A computer program product as recited in claim 35, wherein the multimedia content is rendered in an order that is reflected by the edited transcription file.

37. A computer program product as recited in claim 33, wherein the method further includes an act of determining a hierarchal organization of tokens, each token identifying one or more multimedia elements by timestamp, such that at least one token includes one or more sub-tokens, the one or more sub-tokens identifying and linking to one or more multimedia element of the multimedia content.

38. A method as recited in claim 33, wherein the multimedia content includes broadcast multimedia content.

39. A method as recited in claim 33, wherein at least one of the one or more tokens includes an image.

40. A method as recited in claim 33, wherein at least one of the one or more tokens includes one or more word.

41. A method as recited in claim 40, wherein the one or more word is derived from closed caption text corresponding to the multimedia content.

42. A method as recited in claim 40, wherein the one or more word is derived from voice recognition performed on the multimedia content.

43. In a computing system that includes a processor configured to process multimedia content and that is connected with one or more multimedia rendering devices that are configured to render the multimedia content, a method for enabling a user to navigate through the multimedia content with a customizable transcription file that includes one or more tokens corresponding to one or more elements of the multimedia content, the method comprising:

an act of receiving multimedia content, the multimedia content including multimedia elements that are assigned corresponding timestamps;

an act of creating a customizable transcription file of tokens that reflect an intended presentation of the multimedia content, each token linking and identifying one or more multimedia elements by timestamp, such that the one or more tokens can be used to navigate through the multimedia content; and

an act of displaying the customizable transcription file in such a manner as to enable editing, such that a user can edit the customizable transcription file to alter the intended presentation of the multimedia content.

44. A method as recited in claim 43, wherein the act of displaying the transcription file enables the one or more tokens to be selected by a user to initiate rendering of the one or more multimedia segments identified by the selected one or more tokens.

45. A method as recited in claim 43, further including an act of receiving user input editing the transcription file.

46. A method as recited in claim 43, wherein the editing of the transcription file includes one or more of moving, copying, amending and deleting a portion of the transcription file.

47. A method as recited in claim 46, wherein the multimedia file is rendered in a sequence controlled by the transcription file as edited.

48. A method as recited in claim 46, wherein said portion of the transcription file includes a token.

49. A method as recited in claim 43, wherein editing the transcription file includes adding new matter to the transcription.

50. In a computing system that includes a processor configured to process multimedia content and that is connected with one or more multimedia rendering devices that are configured to render the multimedia content, a method for enabling a user to navigate through the multimedia content with a transcription file that includes one or more tokens corresponding to one or more elements of the multimedia content, the method comprising:

an act of receiving multimedia content, the multimedia content including multimedia elements;

an act of determining a hierarchal organization of tokens, each token identifying one or more multimedia elements by timestamp;

an act of preprocessing the tokens to obtain a desired display format of the tokens;

an act of creating a transcription file that reflects an intended presentation of the multimedia content, the transcription file linking each token to the one or more multimedia elements it identifies, such that the one or more tokens can be used to navigate through the multimedia content; and

an act of displaying the transcription file, such that one or more of the tokens can be selected to initiate rendering of the multimedia content, the rendering of the multimedia content commencing with rendering of one or more multimedia elements that correspond to a selected one of the one or more tokens,

the transcription file further being displayed in such a manner as to enable editing, such that a user can edit the transcription file to alter the intended presentation of the multimedia content.

51. A method as recited in claim 50, wherein the multimedia content includes broadcast multimedia content.

52. A method as recited in claim 50, wherein at least one of the one or more tokens includes an image.

53. A method as recited in claim 50, wherein at least one of the one or more tokens includes one or more word.

54. A method as recited in claim 53, wherein the one or more word is derived from closed caption text corresponding to the multimedia content.

55. A method as recited in claim 54, wherein the one or more word is derived from voice recognition performed on the multimedia content.

56. A method as recited in claim 55, further including an act of receiving user input selecting a token from the displayed transcription file to initiate rendering of the multimedia content.

57. A method as recited in claim 56, further including an act of receiving user input editing the transcription file prior to the act of receiving user input selecting the token to initiate rendering of the multimedia content.