Interactive playlist generation using annotations

• US 7,631,015 B2
• Filed: 09/14/2006
• Issued: 12/08/2009
• Est. Priority Date: 03/14/1997
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Gupta, Anoop, Bargeron, David M.
• Primary Examiner(s): Trujillo; James
• Assistant Examiner(s): Moser; Bruce M
• Application Number:
  US11/522,160
• Publication Number:
  US 20070011206A1
• Time in Patent Office: 1,181 Days
• Field of Search: 707/104.1, 707/102, 715/230, 715/200
• US Class Current: 1/1
• CPC Class Codes: G06F 16/4387 by the use of playlists
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: Y10S 707/914 Video
• CPC Class Codes: Y10S 707/916 Audio
• CPC Class Codes: Y10S 707/917 Text
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A plurality of user-selected annotations are used to define a playlist of media segments corresponding to the annotations. The user-selected annotations and their corresponding media segments are then provided to the user in a seamless manner. A user interface allows the user to alter the playlist and the order of annotations in the playlist. The user interface identifies each annotation by a short subject line.

Claims

1. One or more computer-readable storage media containing a computer program for annotating a media stream, the media stream having segments with a first order of presentation defined when the media stream is recorded, wherein the program performs steps comprising:

creating annotations interactively with a user, wherein the annotations correspond to identified segments of the media stream, wherein the media stream corresponds to a single presentation including one video stream and wherein each identified segment of the media stream includes a segment of the one video stream and has a begin time and an end time relative to the media stream;

graphically ordering the annotations in a user'"'"'s desired order of presentation in response to input from the user; and

in response to a user instruction,

sequentially presenting the annotations corresponding to the identified segments in the desired order of presentation, and

sequentially presenting the segments of the media stream in an order of presentation defined by the desired order of presentation of the annotations corresponding to the identified segments of the media stream so that the media stream segments are presented in an order of presentation that is different from the first order of presentation

wherein the annotations and their corresponding identified segments are displayed concurrently and wherein different users can specify different desired orders of presentation by ordering the annotations.

2. One or more computer-readable media as recited in claim 1, wherein the annotations comprise textual annotations.

3. One or more computer-readable media as recited in claim 1, wherein the segments comprises audio/visual video segments.

4. One or more computer-readable media as recited in claim 1, the steps further comprising storing the annotations and their desired order of presentation.

5. One or more computer-readable media as recited in claim 1, the steps further comprising:

storing the annotations and their desired order of presentation; and

in response to a user request,

retrieving the stored annotations and their desired order of presentation,

displaying the retrieved annotations in their desired order of presentation, and

retrieving and presenting the media stream segments identified by the retrieved annotations, in sequential order in accordance with the desired order of presentation of the retrieved annotations.

6. A method performed by a computer system having a processor and a memory, the method comprising:

receiving an indication of a plurality of annotations selected by a user, wherein each of the plurality of annotations corresponds to a segment of a single media stream, wherein each segment of the single media stream has a begin time and an end time relative to the single media stream;

presenting a plurality of annotation identifiers to the user, the plurality of annotation identifiers having an ordering;

allowing the ordering of the plurality of annotation identifiers to be changed by the user;

seamlessly providing one or more of,

the plurality of annotations, and

at least a portion of the segment of the media stream corresponding to each of the plurality of annotations;

wherein the seamlessly providing comprises seamlessly providing the plurality of annotations and the portion of the segment of the media stream corresponding to each of the plurality of annotations in an order defined by the changed ordering of the plurality of annotation identifiers

wherein the receiving, presenting, and providing are performed by the processor executing instructions stored in the memory.

7. A method as recited in claim 6, further comprising:

allowing the user to change the ordering of the plurality of annotation identifiers in a drag and drop manner.

8. A method as recited in claim 6 wherein the ordering of the plurality of annotation identifiers is changed by the user prior to providing the one or more of the plurality of annotations and the portion of the media stream corresponding to each of the plurality of annotations.

9. The method of claim 6 wherein the single media stream has a begin time corresponding to the begin time of the segment of the single media stream with the earliest begin time and wherein the single media stream has an end time corresponding to the end time of the segment of the single media stream with the latest end time.

10. A method performed by a computer system having a processor and a memory, the method comprising:

graphically ordering annotations in a first desired order of presentation in response to user input from a first user, wherein the annotations correspond to identified segments of a media stream wherein the media stream is created by recording a single multimedia presentation and wherein the media stream includes a single video stream and a single audio stream wherein the single video stream and the single audio stream are synchronized;

graphically ordering annotations in a second desired order of presentation in response to user input from a second user, wherein the annotations correspond to identified segments of the media stream, each identified segment including a segment of the single video stream and a segment of the single audio stream wherein the segment of the single video stream and the segment of the single audio stream are synchronized;

in response to a single user instruction, sequentially presenting to the first user the annotations concurrently with their corresponding identified media stream segments in the first desired order of presentation; and

in response to a single user instruction, sequentially presenting to the second user the annotations concurrently with their corresponding identified media stream segments in the second desired order of presentation

wherein the media stream has a chronological order of presentation and wherein the first desired order of presentation and the second desired order of presentation are each different from the chronological order of presentation and each other

wherein the ordering and presenting are performed by the processor executing instructions stored in the memory.

11. A method as recited in claim 10, wherein:

the annotations are textual annotations;

the media streams are audio/visual video streams; and

the presenting comprises displaying the textual annotations in one display area while displaying the corresponding segments of the audio/visual streams in another display area.

12. A method as recited in claim 10, further comprising storing the annotations and the desired order of presentation.

13. A method as recited in claim 12, further comprising:

in response to a user request,

retrieving the stored annotations and a desired order of presentation,

displaying the retrieved annotations in the retrieved desired order of presentation, and

retrieving and presenting the media stream segments identified by the retrieved annotations, in sequential order in accordance with the retrieved desired order of presentation.

14. A computing system having a processor and a memory, the computing system comprising:

an annotation creating component for creating annotations interactively with a user, wherein the annotations correspond to identified segments of one or more media streams having a p re-defined order of presentation wherein each of the identified segments has a begin time and an end time relative to the media stream associated with that segment;

an annotation ordering component for graphically ordering the annotations in a desired order of presentation in response to user input, wherein the desired order of presentation differs from the pre-defined order of presentation; and

a presentation component for, in response to a single user instruction, sequentially presenting the annotations concurrently with their corresponding identified media stream segments in the desired order of presentation

wherein the components are stored in the memory for execution by the processor.

15. A system as recited in claim 14, wherein:

the annotations are textual annotations;

the media streams are audio/visual video streams; and

the presenting comprises displaying the textual annotations in one display area while displaying the corresponding segments of the audio/visual streams in another display area.

16. A system as recited in claim 14, further comprising storing the annotations and the desired order of presentation.

17. A system as recited in claim 14, further comprising:

a component that stores the annotations and their desired order of presentation; and

in response to a user request,

retrieves the stored annotations and the desired order of presentation,

displays the retrieved annotations in the desired order of presentation, and

retrieves and presents the media stream segments identified by the retrieved annotations, in sequential order in accordance with the desired order of presentation of the retrieved annotations.

18. A method performed by a computer system having a processor and a memory for presenting segments of a media stream to a user, the method comprising:

providing a media stream that includes video and audio portions;

providing textual annotations for the media stream, each annotation corresponding to a segment of the media stream and having a begin time and an end time wherein the begin time and end time for an annotation are automatically derived by processing an audio portion of the media stream;

receiving a query input by a user, the query including a word;

identifying annotations matching the received query;

providing a display page for displaying the identified annotations to the user;

receiving a selection made by the user of a displayed annotation; and

providing for presenting to the user the segment of the media stream corresponding to the selected annotation

wherein the providing, receiving, and identifying are performed by the processor executing instructions stored in the memory.

19. The method of claim 18 wherein automatically deriving a begin time and end time for the annotation includes detecting sentences within the audio stream.

20. The method of claim 18 wherein presenting to the user the one or more segments of the media stream includes streaming the segments to a user via a web browser.