Systems and methods for filtering and/or viewing collaborative indexes of recorded media

• US 20040021685A1
• Filed: 07/30/2002
• Published: 02/05/2004
• Est. Priority Date: 07/30/2002
• Status: Active Grant

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: Denoue, Laurent, Chiu, Patrick, Fuse, Tohru, Wilcox, Lynn D., McDonald, David W.
• Granted Patent: US 7,257,774 B2
• Time in Patent Office: Days
• US Class Current: 345/721
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Systems and methods for filtering and viewing collaborative indexes of annotations of multimedia or video streams can include obtaining a multimedia or video stream, obtaining user indexes of annotations of the multimedia or video stream, merging the indexes, associating portions of the multimedia or video stream with the annotations, determining high-value annotations and displaying the high value annotations. Systems and methods for providing useful visualizations of the indexes of annotations and high value annotations are also provided.

Claims

1. A method for filtering and viewing a collaborative index of annotations of a multimedia or video stream, comprising:

obtaining at least one multimedia or video stream;

obtaining at least one index of annotations of the multimedia or video stream;

associating the annotations with portions of the multimedia or video stream;

determining high value annotations; and

displaying the high value annotations.

2. The method of claim 1, wherein obtaining the at least one multimedia or video stream comprises obtaining at least two multimedia or video streams.

3. The method of claim 2, further comprising merging the at least two indexes to create a collaborative index as the obtained at least one index of annotations.

4. The method of claim 1, wherein obtaining the at least one multimedia or video stream comprises using an audiovisual recording device to record an event.

5. The method of claim 1, wherein obtaining the at least one multimedia or video stream comprises obtaining an audiovisual stream of a previously recorded event.

6. The method of claim 1, wherein obtaining the at least one index of annotations of the multimedia or video stream comprises obtaining annotations relating to a multimedia or video stream using at least one recording device.

7. The method of claim 6, wherein the at least one recording device includes at least one of a laptop computer, a pen-based notebook computer, a personal digital assistant, a key tag and a wireless telephone.

8. The method of claim 1, wherein obtaining the at least one index of annotations of the multimedia or video stream and obtaining the at least one multimedia or video stream occur simultaneously.

9. The method of claim 1, wherein obtaining the at least one index of annotations of the multimedia or video stream and obtaining the at least one multimedia or video stream occur asynchronously.

10. The method of claim 1, wherein determining high value annotations comprises determining a confidence score for an annotation made at a particular time.

11. The method of claim 10, wherein determining a confidence score comprises evaluating annotations made at or near the particular time.

12. The method of claim 11, wherein evaluating annotations made at or near the particular time comprises weighting the annotations made at or near the particular time.

13. The method of claim 12, wherein weighting the annotations made at or near the particular time comprises valuing the annotations based upon a proximity of each of the annotations to the particular time.

14. The method of claim 12, wherein weighting the annotations made at or near the particular time comprises valuing the annotations based upon a content of each of the annotations.

15. The method of claim 12, wherein weighting the annotations made at or near the particular time comprises valuing the annotations based upon an identity of a user who made the annotations.

16. The method of claim 15, wherein valuing the annotations based upon the identity of a user comprises determining a similarity between annotations made by the user and annotations made by at least one other user.

17. The method of claim 1, wherein displaying the high value annotations comprises presenting a user interface usable to view the high value annotations.

18. A system for filtering and viewing a collaborative index of annotations of a multimedia or video stream, comprising:

an input device;

a display device;

a video or multimedia/annotation index associating circuit or routine;

an index merging circuit or routine;

a high value annotation determining circuit or routine; and

a displaying circuit or routine.

19. The system of claim 18, wherein the input device can be-used to provide at least one multimedia or video stream to a memory.

20. The system of claim 18, wherein the input device can be used to submit at least one index of annotations to a memory.

21. The system of claim 18, wherein the input device includes at least one of a laptop computer, a pen-based notebook computer, a personal digital assistant, a key tag and a wireless telephone.

22. The system of claim 18, wherein the index merging circuit or routine is usable to compile at least two indexes of annotations into a collaborative index.

23. The system of claim 18, wherein the video or multimedia/annotation index associating circuit or routine associates at least one index of annotations with at least one multimedia or video stream.

24. The system of claim 18, wherein the high value annotation determining circuit or routine determines a confidence score for an annotation made at a particular time.

25. The system of claim 24, wherein the high value annotation determining circuit or routine determines a confidence score by evaluating annotations made at or near the particular time.

26. The system of claim 25, wherein the high value annotation determining circuit or routine weights the annotations made at or near the particular time.

27. The system of claim 26, wherein the high value annotation determining circuit or routine weights the annotations based upon a proximity of each of the annotations to the particular time.

28. The system of claim 26, wherein the high value annotation determining circuit or routine weights the annotations based upon a content of each of the annotations.

29. The system of claim 26, wherein the high value annotation determining circuit or routine weights the annotations based upon an identity of a user who made the annotations.

30. The system of claim 29, wherein the high value annotation determining circuit or routine weights the annotations based upon the identity of the user by determining a similarity between annotations made by the user and annotations made by at least one other user.

31. The system of claim 18, wherein the displaying circuit or routine creates or modifies a user interface usable to display the high value annotations on the displaying device.

32. A user interface usable to view a collaborative index of annotations of a multimedia or video stream, comprising:

an annotation display usable to display selectable annotation icons;

a time stamp display portion usable to display a time and a user associated with a selected annotation icon; and

a text display portion usable to display text associated with the selected annotation icon.

33. A user interface usable to view a collaborative index of annotations of a multimedia or video stream, comprising:

an annotation display usable to display selectable annotation icons;

a video display usable to display at least a portion of a multimedia or video associated with a selected annotation icon;

a time display portion usable to display a time associated with an image displayed on the video display portion; and

a threshold selector usable to select a threshold that controls which annotation icons are displayed in the annotation display based upon confidence scores associated with the annotation icons.

34. A user interface usable to view a collaborative index of annotations of a multimedia or video stream, comprising:

an annotation display usable to display selectable annotation icons;

a video display usable to display at least a portion of a multimedia or video stream associated with a selected annotation icon;

a grouping browser usable to select annotation icons and associated portions of the multimedia or video stream; and

a text display portion usable to display text associated with the selected annotation icon.

35. The user interface of claim 34, further comprising a confidence display portion usable to display confidence icons representing confidence scores associated with particular temporal portions of the multimedia or video stream.

36. A user interface usable to view a collaborative index of annotations of a multimedia or video stream, comprising:

a confidence display portion usable to display confidence icons representing confidence scores associated with particular temporal portions of a multimedia or video stream;

a video display portion usable to display at least a portion of a multimedia or video stream associated with a selected confidence icon; and

a multi-video display portion usable to display multiple portions of the multimedia or video stream associated with the selected confidence icon.