Synchronous digital annotations of media data stream

• US 20070067707A1
• Filed: 09/16/2005
• Published: 03/22/2007
• Est. Priority Date: 09/16/2005
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Travis, James, Wasson, Michael
• Application Number:
  US11/229,095
• Publication Number:
  US 20070067707A1
• Time in Patent Office: Days
• US Class Current: 715/203
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel

Abstract

Synchronous digital ink and audio annotations of media data stream. A media data stream is rendered. The media data stream includes media data organized in one or more segments. Annotating data is received from a user for annotating the media data. A time is identified when the annotating data is received. The identified time is relative to a time corresponding to the one or more segments of the media data as the media data stream is being rendered. An annotating data stream is organized to include the annotating data synchronized with the media data stream based on the identified time. A new file is created that includes the original media data stream and the annotating data stream, or the annotating data stream is added to the original file and saved to a storage area.

Claims

1. A computer-implemented method for annotating media data, said computerized method comprising:

rendering a media data stream, said media data stream including media data being rendered in one or more segments;

receiving annotating data from a user for annotating the media data;

identifying a time period when the annotating data is received, said identified time period being relative to a time corresponding to the one or more segments of the media data as the media data stream is being rendered; and

organizing an annotating data stream including the annotating data synchronized with the media data stream based on the identified time period.

2. The computerized method of claim 1 further comprising capturing one or more segments of the annotating data and organizing the captured segments in a data structure, said captured segments of the annotating data matching the one or more segments of the media data stream as a function of the time as the media data stream is rendered.

3. The computerized method of claim 2 further comprising removing the captured segments in the data structure.

4. The computerized method of claim 1 wherein receiving annotating data comprises receiving data representing one or more of the following:

digital ink strokes, audio data stream, and video data stream, and wherein rendering the media data stream comprises rendering media data including at least one or more of the following;

an audio file, a video file, an audio data stream, and a video data stream.

5. The computerized method of claim 1 further comprising rendering the organized annotating data stream with the media data stream synchronously, and further comprising generating an annotated media file including the organized annotating data stream and the media data stream.

6. The computerized method of claim 1 further comprising generating an output file including the organized annotating data stream and the media data stream.

7. The computerized method of claim 1 wherein one or more computer-readable media have computer-executable instructions for performing the computerized method recited in claim 1.

8. A system for rendering digitally annotated media stream, said system comprising:

an interface for receiving the annotated media stream, said annotated media stream including an annotating data stream and a media data stream;

a processor for executing computer-executable instructions for;

identifying the annotating data stream, said annotating data stream including one or more segments each having a time stamp associated therewith;

rendering the media data stream, said media data stream including media data being rendered in one or more segments;

rendering the one or more segments of the annotating data stream and the one or more segments of the media data stream synchronously by associating each of the time stamps of the annotating data stream with each of the segments of the media data stream as the media data stream is rendered; and

a user interface for providing the rendered annotating data stream and the rendered media data stream to a user.

9. The system of claim 8 further comprising a memory for storing the annotating data stream in a data structure and the media data stream as the processor renders the annotating data stream and the media data stream, said data structure includes one or more data fields having data associated with one or more of the following:

delta frames, key frames, digital ink segments, source digital ink segment, size of original digital ink segment, placement of original digital ink segment, and timestamp.

10. The system of claim 8 further comprising a plug-in component for rendering the annotating data stream with the media data stream synchronously.

11. The system of claim 8 wherein the annotating data stream comprises data representing one or more of the following types:

digital ink strokes, audio data stream, and video data stream.

12. The system of claim 11 wherein the processor is further configured to identify the types of the annotating data stream, and wherein the processor is further configured to generate an annotated media file including the organized annotating data stream and the media data stream.

13. The system of claim 12 wherein the user interface includes one or more of the following to provide the annotating data stream according to the types:

a media player application program, a whiteboard application program, a microphone, or a communication source.

14. The system of claim 8 wherein the media data stream comprises at least one or more of the following:

an audio file, a video file, an audio data stream, and a video data stream.

15. A computer-readable storage medium having computer-executable components for annotating a media data stream, said computer-executable components comprising:

an interface component for capturing annotating data from a user for annotating the media data stream;

a memory for storing the media data stream, said media data stream including media data organized in one or more segments;

a rendering component for rendering the media data stream;

an annotation component for identifying a time period when the annotating data is captured, said identified time period being relative to another time period corresponding to the one or more segments of the media data as the media data stream is being rendered;

wherein the annotation component organizes an annotating data stream including the annotating data synchronized with the media data stream based on the identified time period, and wherein the interface component provides the annotating data stream to the user.

16. The computer-readable storage medium of claim 15 wherein:

the rendering component further renders the annotating data stream and the media data stream synchronously and further generates an annotated media file including the organized annotating data stream and the media data stream, and

the interface component is further configured to provide the annotating data stream and the media data stream to the user.

17. The computer-readable storage medium of claim 15 further comprising a plug-in component for rendering the annotating data stream with the media data stream synchronously.

18. The computer-readable storage medium of claim 15 wherein the memory stores the annotating data in a data structure, said data structure includes one or more data fields having data associated with one or more of the following:

delta frames, key frames, digital ink segments, source digital ink segment, size of original digital ink segment, placement of original digital ink segment, and timestamp, and wherein the annotating data comprises data representing one or more of the following;

digital ink strokes, audio data stream, and video data stream, and wherein the media data stream comprises at least one or more of the following;

an audio file, a video file, an audio data stream, and a video data stream.

19. The computer-readable storage medium of claim 15 wherein the interface component further captures one or more segments of the annotating data to be stored in a data structure, said one or more captured segments of the annotating data matching the one or more segments of the media data stream as a function of the time as the media data stream is rendered.

20. The computer-readable storage medium of claim 15 wherein the interface component includes a media player application program, a whiteboard application program, a microphone, or a communication source.