System and method for linking page content with a media file and displaying the links

• US 7,774,799 B1
• Filed: 03/26/2003
• Issued: 08/10/2010
• Est. Priority Date: 03/26/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Veselova, Olga, Cardon, Jeffry N., Sellers, Timothy D., Kim, Myungsub, Yalovsky, Mark, Clarke, Simon
• Primary Examiner(s): Ho; Andy
• Application Number:
  US10/397,103
• Time in Patent Office: 2,694 Days
• Field of Search: 719/329, 715/805
• US Class Current: 719/329
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F

Abstract

A method and system link page content with a media file and display these links during playback of the media file. In other words, the present invention can link notes stored in an electronic document with media such as audio stored in an audio file. As media is played back from the media file, the present invention can display visual indicators adjacent to or over page content so that a user can see how page content relates to the media file. According to one exemplary aspect of the present invention, page content can be highlighted when the page content has a relationship with the media that is being played. That is, page content can be highlighted at different times as the recorded live information from a media file such as audio from an audio file is being played back.

Claims

1. A method for linking page content with a media file comprising:

recording media in the media file;

receiving page content associated with the media in an electronic document;

receiving a time stamp and a global unique identifier corresponding to the media during recording of the media file;

generating a media link comprising the time stamp and the global unique identifier; and

storing the media link adjacent to the page content in the electronic document wherein when the page content in the electronic document is selected, the media corresponding to the media link is synchronized with the page content selected for playback;

identifying a position of an insertion point within the page content in the electronic document;

determining whether the insertion point is linked to the media file or another media file;

appending media input at the insertion point to any media file linked to the insertion point in response to determining that the insertion point is linked to the media file or another media file;

in response to determining that the insertion point is not linked to any media file, determining whether a current page selected is linked to the media file or another media file; and

in response to determining that the current page selected is linked to the media file or another media file, appending media input at the insertion point to any media file linked to the current page;

wherein the insertion point corresponds to a position within the electronic document where additional data can be added.

2. The method of claim 1, wherein recording media on a media file further comprises recording audio to an audio file.

3. The method of claim 1, wherein recording media on a media file further comprises recording one of video to a video file or audio/video to an audio/visual file.

4. The method of claim 1, wherein receiving page content associated with the media in an electronic document further comprises receiving at least one of electronic ink, typed text, a drawing made with electronic ink, or information pasted from an electronic clip board.

5. The method of claim 1, further comprising displaying at least one visual indicator in the electronic document adjacent to, over, or circumscribing a portion of the page content to signify that a media link has been generated for the portion of the page content.

6. The method of claim 5, further comprising:

playing the media wherein displaying the visual indicator comprises;

highlighting the portion of the page content as a portion of the media associated with the portion of the page content is played; and

un-highlighting the portion of the page content as the media is played away from the portion of the media associated with the portion of the page content.

7. The method of claim 6, further comprising:

displaying a media tool bar comprising a timeline with a position indicator wherein a location of the position indicator on the timeline corresponds to a relative position within the media file of the portion of the page content highlighted comprising the insertion point.

8. The method of claim 5, further comprising:

receiving a selection of the visual indicator; and

in response to receiving the selection, playing a portion of the media linked to the portion of the page content associated with the visual indicator.

9. The method of claim 1, further comprising:

receiving a selection of a portion of the page content in the electronic document;

synchronizing the media with the portion of the page content selected; and

playing the media beginning at a portion of the media synchronized with the portion of the page content selected in response to receiving the selection.

10. A method for linking a media file with page content on a page of an electronic document and displaying links visually, comprising:

receiving input to display links between page content and the media file;

playing the media file;

identifying a position of an insertion point within the page content in the electronic document;

determining whether the insertion point is linked to the media file or another media file;

appending media input at the insertion point to any media file linked to the insertion point in response to determining that the insertion point is linked to the media file or another media file;

in response to determining that the insertion point is not linked to any media file, determining whether a current page selected is linked to the media file or another media file; and

in response to determining that the current page selected is linked to the media file or another media file, appending media input at the insertion point to any media file linked to the current page;

wherein the insertion point corresponds to a position within the electronic document where additional data can be added; and

displaying visual indicators on the page at least one of adjacent to, over, or enclosing portions of the page content for predetermined periods of time during playback of the media file therein illustrating how the portions of the page content relate to portions of the media file.

11. The method of claim 10, wherein displaying visual indicators on the page at least one of adjacent to, over, or enclosing portions of the page content further comprises displaying visual indicators on the page at least one of adjacent to, over, or enclosing portions of the page content that have been assigned a media link.

12. The method of claim 11, wherein the media link comprises at least one of a time stamp or a global unique identifier corresponding to the media file.

13. The method of claim 10, wherein playing a media file further comprises playing at least one of an audio, visual, or an audio/visual file.

14. The method of claim 10, wherein displaying visual indicators further comprises highlighting page content at predetermined intervals.

15. The method of claim 10, further comprising navigating through pages of the electronic document as the media file is being played.

16. The method of claim 10, further comprising building an index of media links.

17. A computer system for linking page content with a media file and for displaying links to the media file, comprising:

a processing unit;

a memory storage device;

a display device coupled to the processing unit for displaying data; and

a program stored in the memory storage device for providing instructions to the processing unit,

the processing unit responsive to the instructions of the program, operable for;

recording media;

receiving page content on a page in an electronic document;

generating a media link that associates the page content and the media, the media link comprising a time stamp;

playing the media;

identifying a position of an insertion point within the page content in the electronic document;

determining whether the insertion point is linked to the media file or another media file;

appending media input at the insertion point to any media file linked to the insertion point in response to determining that the insertion point is linked to the media file or another media file;

in response to determining that the insertion point is not linked to any media file, determining whether a current page selected is linked to the media file or another media file; and

in response to determining that the current page selected is linked to the media file or another media file, appending media input at the insertion point to any media file linked to the current page;

wherein the insertion point corresponds to a position within the electronic document where additional data can be added; and

displaying one or more visual indicators on the page adjacent to page content at intervals during playback of the media each visual indicator representing a media link between the page content and the media.

18. The system of claim 17, wherein the program stored in the memory storage device for providing instructions to the processing unit comprises a document editing module.

19. The system of claim 17, wherein the processing unit is further operable for building an index of media links associated with page content prior to displaying the visual indicators wherein the index is used to determine which portions of the page content is highlighted at specific times during playback of the media.