ANNOTATING TEMPORALLY-DIMENSIONED MULTIMEDIA CONTENT

• US 20020059342A1
• Filed: 10/23/1997
• Published: 05/16/2002
• Est. Priority Date: 10/23/1997
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: VXtreme, Inc. (Microsoft Corporation)
• Inventors: GUPTA, ANOOP, CANNON, ANTHONY WILLIAM
• Granted Patent: US 6,546,405 B2
• Time in Patent Office: Days
• US Class Current: 715/512
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/489 using time information
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes

Abstract

A human viewing temporally-dimensioned content of a multimedia document through use of a computer can add substantive content to temporally-dimensioned content of the multimedia document to thereby annotate, comment upon, and augment the multimedia document. Thus, a multimedia document becomes a basis for collaborative work. The substantive content added by the viewing user is in the form of a temporal annotation which identifies a particular relative time in temporally-dimensioned content of the multimedia document and which includes user-authored content provided by the viewing user. Display of the multimedia document includes presentation of the temporal annotations created by the user. A graphical user interface enables the user to select a temporal annotation from a list and immediately proceed to presentation of the multimedia document such that temporally-dimensioned content is presented at the particular relative time represented by the selected temporal annotation. In addition, as temporally-dimensioned content of the multimedia document is displayed, temporal annotations are. represented in the display of the multimedia document as the particular relative time represented by each temporal annotation is reached. Thus, the user-authored content becomes part of the display of the multimedia document in a temporal context.

Claims

1. A method for displaying a multimedia document stored in a memory of a computer system, the method comprising the steps of:

retrieving the multimedia document from the memory of the computer system;

determining, from an identifier of the multimedia document, that one or more temporal annotations are associated with the multimedia document;

retrieving the one or more temporal annotations; and

incorporating display of the one or more temporal annotations in the display of the multimedia document.

2. The method of claim 1 wherein the identifier of the multimedia document is a globally unique identifier within a computer network to which the computer system is connected.

3. The method of claim 1 wherein the identifier of the multimedia document is a universal resource name within a computer network to which the computer system is connected.

4. The method of claim 1 wherein the identifier of the multimedia document is a universal resource locator (URL) within a computer network to which the computer system is connected.

5. The method of claim 1 wherein the identifier of the multimedia document is a realtime transport protocol (RTP) address.

6. The method of claim 1 wherein the step of determining comprises the steps of:

deriving, from the identifier, a location of a database stored in a second memory of a second computer system; and

determining that the database includes the one or more temporal annotations.

7. The method of claim 6 wherein the second and first-mentioned computer systems are the same computer system;

and

further wherein the second and first-mentioned memories are the same memory.

8. The method of claim 1 wherein the step of determining comprises the steps of:

retrieving, from a first database, a record which represents an association of the identifier with a location of a second database stored in a second memory of a second computer system; and

determining that the second database includes the one or more temporal annotations.

9. The method of claim 8 wherein the second and first-mentioned computer systems are the same computer system;

and

further wherein the second and first-mentioned memories are the same memory.

10. A method for managing temporal annotations of a multimedia document, the method comprising the steps of:

receiving a post request which specifies (i) identification data representing an identifier of the multimedia document, (ii) content data representing substantive content of a temporal annotation, and (iii) relative time data representing a relative time within the multimedia document with which the temporal annotation is associated;

forming a temporal annotation entry which includes the content data and the relative time data; and

storing the temporal annotation entry in a pre-existing temporal annotation database such that the temporal annotation entry is associated with the multimedia document.

11. The method of claim 10 wherein the post request further includes author data which identifies a user as the author of the content data, the method further comprising the step of:

including the author data in the temporal annotation entry.

12. The method of claim 10 further comprising the steps of:

forming temporal annotation identifier data which identifies the temporal annotation entry; and

including the temporal annotation identifier data in the temporal annotation entry.

13. The method of claim 10 further comprising the steps of:

determining a creation time of the temporal annotation entry; and

including creation time stamp data representing the creation time in the temporal annotation entry.

14. The method of claim 13 wherein the step of determining a creation time comprises the step of:

parsing creation time data representing the creation time from the post request.

15. The method of claim 10 further comprising the steps of:

receiving a retrieve request which specifies the identifier of the multimedia document;

retrieving the temporal annotation entry from the pre-existing temporal annotation database; and

returning, in response to the retrieve request, the content data and the relative time data.

17. The method of claim 16 wherein the filtering criteria include identifiers of one or more selected authors of the one or more temporal annotations.

18. The method of claim 16 wherein the filtering criteria include specification of a period of time during which the selected temporal annotations are created.

19. The method of claim 18 wherein the period of time is specified as a range of dates.

20. The method of claim 16 wherein the step of filtering comprises the step of:

in the step of requesting, specifying the filtering criteria; and

in the step of receiving, receiving only the selected temporal annotations.

16. A method for selectively incorporating display of temporal annotations in a display of a multimedia document, the method comprising the steps of:

requesting one or more temporal annotations which are related to the multimedia document from a temporal annotation server;

receiving the one or more temporal annotations from the temporal annotation server;

displaying the multimedia document to a user;

filtering the one or more temporal annotations according to filtering criteria selected by the user to select one or more selected ones of the one or more temporal annotations; and

incorporating display of the selected temporal annotations with the display of the multimedia document.

21. A computer readable medium useful in association with a computer which includes a processor and a memory, the computer readable medium including computer instructions which are configured to cause the computer to display a multimedia document stored in a memory of a computer system by performing the steps of:

retrieving the multimedia document from the memory of the computer system;

determining, from an identifier of the multimedia document, that one or more temporal annotations are associated with the multimedia document;

retrieving the one or more temporal annotations; and

incorporating display of the one or more temporal annotations in the display of the multimedia document.

22. The computer readable medium of claim 21 wherein the identifier of the multimedia document is a globally unique identifier within a computer network to which the computer system is connected.

23. The computer readable medium of claim 21 wherein the identifier of the multimedia document is a universal resource name within a computer network to which the computer system is connected.

24. The computer readable medium of claim 21 wherein the identifier of the multimedia document is a universal resource locator (URL) within a computer network to which the computer system is connected.

25. The computer readable medium of claim 21 wherein the identifier of the multimedia document is a realtime transport protocol (RTP) address.

26. The computer readable medium of claim 21 wherein the step of determining comprises the steps of:

deriving, from the identifier, a location of a database stored in a second memory of a second computer system; and

determining that the database includes the one or more temporal annotations.

27. The computer readable medium of claim 28 wherein the second and first-mentioned computer systems are the same computer system;

and

further wherein the second and first-mentioned memories are the same memory.

28. The computer readable medium of claim 21 wherein the step of determining comprises the steps of:

retrieving, from a first database, a record which represents an association of the identifier with a location of a second database stored in a second memory of a second computer system; and

determining that the second database includes the one or more temporal annotations.

29. The computer readable medium of claim 28 wherein the second and first-mentioned computer systems are the same computer system;

and

further wherein the second and first-mentioned memories are the same memory.

30. A computer readable medium useful in association with a computer which includes a processor and a memory, the computer readable medium including computer instructions which are configured to cause the computer to manage temporal annotations of a multimedia document by performing the steps of:

receiving a post request which specifies (i) identification data representing an identifier of the multimedia document, (ii) content data representing substantive content of a temporal annotation, and (iii) relative time data representing a relative time within the multimedia document with which the temporal annotation is associated;

forming a temporal annotation entry which includes the content data and the relative time data; and

storing the temporal annotation entry in a pre-existing temporal annotation database such that the temporal annotation entry is associated with the multimedia document.

31. The computer readable medium of claim 30 wherein the post request further includes author data which identifies a user as the author of the content data, and wherein the computer instructions are further configured to cause the computer to perform the additional step of:

including the author data in the temporal annotation entry.

32. The computer readable medium of claim 30 wherein the computer instructions are further configured to cause the computer to perform the additional steps of:

forming temporal annotation identifier data which identifies the temporal annotation entry; and

including the temporal annotation identifier data in the temporal annotation entry.

33. The computer readable medium of claim 30 wherein the computer instructions are further configured to cause the computer to perform the additional steps of:

determining a creation time of the temporal annotation entry; and

including creation time stamp data representing the creation time in the temporal annotation entry.

34. The computer readable medium of claim 33 wherein the step of determining a creation time comprises the step of:

parsing creation time data representing the creation time from the post request.

35. The computer readable medium of claim 32 wherein the computer instructions are further configured to cause the computer to perform the additional steps of:

receiving a retrieve request which specifies the identifier of the multimedia document;

retrieving the temporal annotation entry from the pre-existing temporal annotation database; and

returning, in response to the retrieve request, the content data and the relative time data.

37. The computer readable medium of claim 36 wherein the filtering criteria include identifiers of one or more selected authors of the one or more temporal annotations.

38. The computer readable medium of claim 36 wherein the filtering criteria include specification of a period of time during which the selected temporal annotations are created.

39. The computer readable medium of claim 38 wherein the period of time is specified as a range of dates.

40. The computer readable medium of claim 36 wherein the step of filtering comprises the step of:

in the step of requesting, specifying the filtering criteria; and

in the step of receiving, receiving only the selected temporal annotations.

36. A computer readable medium useful in association with a computer which includes a processor and a memory, the computer readable medium including computer instructions which are configured to cause the computer to selectively incorporate display of temporal annotations in a display of a multimedia document by performing the steps of:

requesting one or more temporal annotations which are related to the multimedia document from a temporal annotation server;

receiving the one or more temporal annotations from the temporal annotation server;

displaying the multimedia document to a user;

filtering the one or more temporal annotations according to filtering criteria selected by the user to select one or more selected ones of the one or more temporal annotations; and

incorporating display of the selected temporal annotations with the display of the multimedia document.

41. A computer system comprising:

a processor;

a memory operatively coupled to the processor; and

a temporal annotation manager which executes in the processor from the memory and which, when executed by the processor, causes the computer to display a multimedia document by performing the steps of;

retrieving the multimedia document from the memory;

determining, from an identifier of the multimedia document, that one or more temporal annotations are associated with the multimedia document;

retrieving the one or more temporal annotations; and

incorporating display of the one or more temporal annotations in the display of the multimedia document.

42. The computer system of claim 41 wherein the identifier of the multimedia document is a globally unique identifier within a computer network to which the computer system is connected.

43. The computer system of claim 41 wherein the identifier of the multimedia document is a universal resource name within a computer network to which the computer system is connected.

44. The computer system of claim 41 wherein the identifier of the multimedia document is a universal resource locator (URL) within a computer network to which the computer system is connected.

45. The computer system of claim 41 wherein the identifier of the multimedia document is a realtime transport protocol (RTP) address.

46. The computer system of claim 41 wherein the step of determining comprises the steps of:

deriving, from the identifier, a location of a database stored in a second memory of a second computer system; and

determining that the database includes the one or more temporal annotations.

47. The computer system of claim 46 wherein the second and first-mentioned computer systems are the same computer system;

and

further wherein the second and first-mentioned memories are the same memory.

48. The computer system of claim 41 wherein the step of determining comprises the steps of:

retrieving, from a first database, a record which represents an association of the identifier with a location of a second database stored in a second memory of a second computer system; and

determining that the second database includes the one or more temporal annotations.

49. The computer system of claim 48 wherein the second and first-mentioned computer systems are the same computer system;

and

further wherein the second and first-mentioned memories are the same memory.

50. A computer system comprising:

a processor;

a memory operatively coupled to the processor; and

a temporal annotation manager which executes in the processor from the memory and which, when executed by the processor, causes the computer to manage temporal annotations of a multimedia document by performing the steps of;

receiving a post request which specifies (i) identification data representing an identifier of the multimedia document, (ii) content data representing substantive content of a temporal annotation, and (iii) relative time data representing a relative time within the multimedia document with which the temporal annotation is associated;

forming a temporal annotation entry which includes the content data and the relative time data; and

storing the temporal annotation entry in a pre-existing temporal annotation database such that the temporal annotation entry is associated with the multimedia document.

51. The computer system of claim 50 wherein the post request further includes author data which identifies a user as the author of the content data, and wherein the temporal annotation manager causes the computer to perform the additional step of:

including the author data in the temporal annotation entry.

52. The computer system of claim 50 wherein the temporal annotation manager causes the computer to perform the additional steps of:

forming temporal annotation identifier data which identifies the temporal annotation entry; and

including the temporal annotation identifier data in the temporal annotation entry.

53. The computer system of claim 50 wherein the temporal annotation manager causes the computer to perform the additional steps of:

determining a creation time of the temporal annotation entry; and

including creation time stamp data representing the creation time in the temporal annotation entry.

54. The computer system of claim 53 wherein the step of determining a creation time comprises the step of:

parsing creation time data representing the creation time from the post request.

55. The computer system of claim 50 wherein the temporal annotation manager causes the computer to perform the additional steps of:

receiving a retrieve request which specifies the identifier of the multimedia document;

retrieving the temporal annotation entry from the pre-existing temporal annotation database; and

returning, in response to the retrieve request, the content data and the relative time data.

57. The computer system of claim 56 wherein the filtering criteria include identifiers of one or more selected authors of the one or more temporal annotations.

58. The computer system of claim 56 wherein the filtering criteria include specification of a period of time during which the selected temporal annotations are created.

59. The computer system of claim 58 wherein the period of time is specified as a range of dates.

60. The computer system of claim 56 wherein the step of filtering comprises the step of:

in the step of requesting, specifying the filtering criteria; and

in the step of receiving, receiving only the selected temporal annotations.

56. A computer system comprising:

a processor;

a memory operatively coupled to the processor; and

a multimedia document player which executes in the processor from the memory and which, when executed by the processor, causes the computer to selectively incorporate display of temporal annotations in a display of a multimedia document by performing the steps of;

requesting one or more temporal annotations which are related to the multimedia document from a temporal annotation server;

receiving the one or more temporal annotations from the temporal annotation server;

displaying the multimedia document to a user;

filtering the one or more temporal annotations according to filtering criteria selected by the user to select one or more selected ones of the one or more temporal annotations; and

incorporating display of the selected temporal annotations with the display of the multimedia document.