Multimedia visualization and integration environment

• US 7,596,755 B2
• Filed: 02/21/2002
• Issued: 09/29/2009
• Est. Priority Date: 12/22/1997
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey
• Primary Examiner(s): Lo; Weilun
• Assistant Examiner(s): TRAN, MYLINH T
• Application Number:
  US10/081,129
• Publication Number:
  US 20040090462A1
• Time in Patent Office: 2,777 Days
• Field of Search: 715/764, 715/701, 715/702, 715/716, 715/787, 715/723, 715/835, 715/719, 715/724, 715/725, 725/61, 725/51, 725/52
• US Class Current: 715/723
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06F 16/34 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

Embodiments of the present invention provide techniques for retrieving and displaying multimedia information. According to an embodiment of the present invention, a graphical user interface (GUI) is provided that displays multimedia information that may be stored in a multimedia document. According to the teachings of the present invention, the GUI enables a user to navigate through multimedia information stored in a multimedia document. The GUI provides both a focused and a contextual view of the contents of the multimedia document.

Claims

1. A method of displaying multimedia information stored in a multimedia document on a display, the method comprising:

displaying a graphical user interface (GUI) on the display;

displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document;

displaying, in the first area of the GUI, a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area;

displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document;

displaying, in the second area of the GUI, a second lens positionable over a plurality of portions of the second visual representation displayed within the second area of the GUI, the second lens covering a first portion of the second visual representation within the second area; and

displaying, in a third area of the GUI, a third visual representation of the multimedia information stored in the multimedia document based on the second lens covering the first portion of the second visual representation within the second area, the third visual representation including a third representation of the information of the first type and a third representation of the information of the second type,

wherein displaying the first visual representation of the multimedia information stored in the multimedia document in the first area of the GUI comprises;

displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and

displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type,

wherein displaying the second visual representation of the multimedia information stored in the multimedia document in the second area of the GUI comprises;

displaying, in a first sub-area of the second area of the GUI, the portion of the first representation of the information of the first type covered by the first lens as the second representation of the information of the first type; and

displaying, in a second sub-area of the second area of the GUI, the portion of the first representation of the information of the second type covered by the first lens as the second representation of the information of the second type,

wherein displaying the third visual representation of the multimedia information stored in the multimedia document in the third area of the GUI comprises;

displaying, in a first sub-area of the third area of the GUI, the portion of the second representation of the information of the first type covered by the second lens as the third representation of the information of the first type; and

displaying, in a second sub-area of the third area of the GUI, the portion of the second representation of the information of the second type covered by the second lens as the third representation of the information of the first type.

2. The method of claim 1 wherein displaying the first visual representation of the multimedia information stored in the multimedia document comprises:

displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and

displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type.

3. The method of claim 1 wherein displaying the second visual representation of the multimedia information stored in the multimedia document comprises:

displaying, in a first sub-area of the second area of the GUI, the second representation of the information of the first type as a portion of the first representation of the information of the first type covered by the first lens; and

displaying, in a second sub-area of the second area of the GUI, the second representation of the information of the first type as a portion of the first representation of the information of the second type covered by the first lens.

4. The method of claim 1 wherein displaying the second visual representation of the multimedia information stored in the multimedia document comprises:

determining a first time and a second time associated with the first lens;

displaying, in the second area of the GUI, a representation of the information of the first type occurring between the first time and the second time associated with the first lens as the second representation of the information of the first type; and

displaying, in the second area of the GUI, a representation of the information of the second type occurring between the first time and the second time associated with the first lens as the second representation of the information of the second type.

5. The method of claim 1 further comprising:

receiving user input moving the first lens over the first visual representation displayed within the first area to cover a second portion of the first visual representation within the first area; and

responsive to the user input, automatically changing the second visual representation displayed in the second area of the GUI such that the second visual representation of the multimedia information stored in the multimedia document displayed in the second area of the GUI corresponds to the second portion of the first visual representation of the multimedia information stored in the multimedia document covered by the first lens.

6. The method of claim 1 wherein displaying, in the third area of the GUI, the third visual representation of the multimedia information stored in the multimedia document comprises:

determining a first time and a second time associated with the second lens;

displaying, in the third area of the GUI, a representation of the information of the first type occurring between the first time and the second time associated with the second lens as the third representation of the information of the first type; and

displaying, in the third area of the GUI, a representation of the information of the second type occurring between the first time and the second time associated with the second lens as the third representation of the information of the second type.

7. The method of claim 1 further comprising:

receiving user input moving the second lens over the second visual representation displayed within the second area to cover a second portion of the second visual representation within the second area; and

responsive to the user input, automatically changing the third visual representation displayed in the third area of the GUI such that the third visual representation of the multimedia information stored in the multimedia document displayed in the third area of the GUI corresponds to the second portion of the second visual representation of the multimedia information stored in the multimedia document covered by the second lens.

8. The method of claim 1 further comprising:

receiving user input moving the first lens over the first visual representation displayed within the first area to cover a second portion of the first visual representation within first area; and

responsive to the user input, automatically;

changing the second visual representation displayed in the second area of the GUI such that the second visual representation of the multimedia information stored in the multimedia document displayed in the second area of the GUI corresponds to the second portion of the first visual representation of the multimedia information stored in the multimedia document covered by the first lens; and

changing the third visual representation displayed in the third area of the GUI such that the third visual representation of the multimedia information stored in the multimedia document displayed in the third area of the GUI corresponds to the second visual representation of the multimedia information stored by the multimedia document within the second area.

9. The method of claim 1 further comprising:

displaying a sub-lens covering a portion of the first visual representation displayed within the first area of the GUI corresponding to the first portion of the second visual representation within the second area of the GUI covered by the second lens.

10. The method of claim 9 further comprising:

receiving user input moving the second lens over the second visual representation displayed within the second area to cover a second portion of the second visual representation within the second area; and

responsive to the user input, automatically changing position of the sub-lens to cover a portion of the first visual representation displayed within the first area of the GUI corresponding to the second portion of the second visual representation within the second area covered by the second lens.

11. The method of claim 1 wherein:

the information of the first type corresponds to video information; and

the first representation of the information of the first type comprises one or more video keyframes extracted from the video information.

12. The method of claim 11 wherein:

the information of the second type corresponds to audio information; and

the first representation of the information of the second type comprises text information obtained from transcribing the audio information.

13. The method of claim 11 wherein:

the information of the second type corresponds to closed-caption (CC) text information; and

the first representation of the information of the second type comprises text information included in the CC text information.

14. The method of claim 1 further comprising:

receiving input indicating selection of a portion of the multimedia information occurring between a first time and a second time; and

performing a first operation on the portion of the multimedia information occurring between a first time and a second time.

15. A method of displaying multimedia information stored in a multimedia document on a display, the method comprising:

displaying a graphical user interface (GUI) on the display;

displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document;

displaying, in the first area of the GUI, a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area;

displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document;

receiving information indicating a user-specified concept of interest; and

analyzing the multimedia information stored in the multimedia document to identify one or more locations in the multimedia information that are relevant to the user-specified concept of interest;

wherein displaying, in the first area of the GUI, the first visual representation of the multimedia information stored in the multimedia document comprises annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest; and

wherein displaying, in the second area of the GUI, the second visual representation of the multimedia information stored in the multimedia document comprises annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest and that are located in the first portion of the first visual representation covered by the first lens within the first area.

16. A computer program product stored on a computer-readable storage medium for displaying multimedia information stored in a multimedia document on a display, the computer program product comprising:

code for displaying a graphical user interface (GUI) on the display;

code for displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document;

code for displaying a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area;

code for displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document;

code for displaying, in the second area of the GUI, a second lens positionable over a plurality of portions of the second visual representation displayed within the second area of the GUI, the second lens covering a first portion of the second visual representation within the second area; and

code for displaying, in a third area of the GUI, a third visual representation of the multimedia information stored in the multimedia document based on the second lens covering the first portion of the second visual representation within the second area, the third visual representation comprising a third representation of the information of the first type and a third representation of the information of the second type,

wherein the code for displaying the first visual representation of the multimedia information stored in the multimedia document in the first area of the GUI comprises;

code for displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and

code for displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type,

wherein the code for displaying the second visual representation of the multimedia information stored in the multimedia document in the second area of the GUI comprises;

code for displaying, in a first sub-area of the second area of the GUI, the portion of the first representation of the information of the first type covered by the first lens; and

code for displaying, in a second sub-area of the second area of the GUI, the portion of the first representation of the information of the second type covered by the first lens,

wherein the code for displaying the third visual representation of the multimedia information stored in the multimedia document in the third area of the GUI comprises;

code for displaying, in a first sub-area of the third area of the GUI, the portion of the second representation of the information of the first type covered by the second lens as the third representation of the information of the first type; and

code for displaying, in a second sub-area of the third area of the GUI, the portion of the second representation of the information of the second type covered by the second lens as the third representation of the information of the second type.

17. The computer program product of claim 16 wherein the code for displaying the first visual representation of the multimedia information stored in the multimedia document comprises:

code for displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and

code for displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type.

18. The computer program product of claim 16 wherein the code for displaying the second visual representation of the multimedia information stored in the multimedia document comprises:

code for displaying, in a first sub-area of the second area of the GUI, the second representation of the information of the first type as a portion of the first representation of the information of the first type covered by the first lens; and

code for displaying, in a second sub-area of the second area of the GUI, the second representation of the information of the second type as a portion of the first representation of the information of the second type covered by the first lens.

19. The computer program product of claim 16 wherein the code for displaying the second visual representation of the multimedia information stored in the multimedia document comprises:

code for determining a first time and a second time associated with the first lens;

code for displaying, in the second area of the GUI, a representation of information of the first type occurring between the first time and the second time associated with the first lens as the second representation of the information of the first type; and

code for displaying, in the second area of the GUI, a representation of information of the second type occurring between the first time and the second time associated with the first lens as the second representation of the information of the second type.

20. The computer program product of claim 16 further comprising:

code for receiving user input moving the first lens over the first visual representation within the first area to cover a second portion of the first visual representation within the first area; and

code for responsive to the user input, automatically changing the second visual representation displayed in the second area of the GUI such that the second visual representation of the multimedia information stored in the multimedia document displayed in the second area of the GUI corresponds to the second portion of the first visual representation of the multimedia information stored in the multimedia document covered by the first lens.

21. The computer program product of claim 16 wherein the code for displaying, in the third area of the GUI, the third visual representation of the multimedia information stored in the multimedia document comprises:

code for determining a first time and a second time associated with the second lens;

code for displaying, in the third area of the GUI, a representation of the information of the first type occurring between the first time and the second time associated with the second lens as the third representation of the information of the first type; and

code for displaying, in the third area of the GUI, a representation of the information of the second type occurring between the first time and the second time associated with the second lens as the third representation of the information of the second type.

22. The computer program product of claim 16 further comprising:

code for receiving user input moving the second lens over the second visual representation displayed within the second area to cover a second portion of the second visual representation within the second area; and

responsive to the user input, code for automatically changing the third visual representation displayed in the third area of the GUI such that the third visual representation of the multimedia information stored in the multimedia document displayed in the third area of the GUI corresponds to the second portion of the second visual representation of the multimedia information stored in the multimedia document covered by the second lens.

23. The computer program product of claim 16 further comprising:

code for receiving user input moving the first lens over the first visual representation displayed within the first area to cover a second portion of the first visual representation within the first area; and

responsive to the user input, code for automatically;

changing the second visual representation displayed in the second area of the GUI such that the second visual representation of the multimedia information stored in the multimedia document displayed in the second area of the GUI corresponds to the second portion of the first visual representation of the multimedia information stored in the multimedia document covered by the first lens; and

changing the third visual representation displayed in the third area of the GUI such that the third visual representation of the multimedia information stored in the multimedia document displayed in the third area of the GUI corresponds to the second visual representation of the multimedia information stored by the multimedia document within the second area.

24. The computer program product of claim 16 further comprising:

code for displaying a sub-lens covering a portion of the first visual representation displayed within the first area of the GUI corresponding to the first portion of the second visual representation within the second area of the GUI covered by the second lens.

25. The computer program product of claim 24 further comprising:

code for receiving user input moving the second lens over the second visual representation displayed within the second area to cover a second portion of the second visual representation within the second area; and

responsive to the user input, code for automatically changing position of the sub-lens to cover a portion of the first visual representation displayed within the first area of the GUI corresponding to the second visual representation within the second area covered by the second lens.

26. The computer program product of claim 16 wherein:

the information of the first type corresponds to video information; and

the first representation of the information of the first type comprises one or more video keyframes extracted from the video information.

27. The computer program product of claim 26 wherein:

the information of the second type corresponds to audio information; and

the first representation of information of the second type comprises text information obtained from transcribing the audio information.

28. The computer program product of claim 26 wherein:

the information of the second type corresponds to closed-caption (CC) text information; and

the first representation of information of the second type comprises text information included in the CC text information.

29. The computer program product of claim 16 further comprising:

code for receiving input indicating selection of a portion of the multimedia information occurring between a first time and a second time; and

code for performing a first operation on the portion of the multimedia information occurring between a first time and a second time.

30. A computer program product stored on a computer-readable storage medium for displaying multimedia information stored in a multimedia document on a display, the computer program product comprising:

code for displaying a graphical user interface (GUI) on the display;

code for displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document;

code for displaying a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area;

code for displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document;

code for receiving information indicating a user-specified concept of interest; and

code for analyzing the multimedia information stored in the multimedia document to identify one or more locations in the multimedia information that are relevant to the user-specified concept of interest;

wherein the code for displaying, in the first area of the GUI, the first visual representation of the multimedia information stored in the multimedia document comprises code for annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest; and

wherein the code for displaying, in the second area of the GUI, the second visual representation of the multimedia information stored in the multimedia document comprises code for annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest and that are located in the first portion of the first visual representation covered by the first lens within the first area.

31. A system for displaying multimedia information stored in a multimedia document, the system comprising:

a display;

a processor; and

a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising;

a code module for displaying a graphical user interface (GUI) on the display;

a code module for displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document;

a code module for displaying, in the first area of the GUI, a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area;

a code module for displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document;

a code module for displaying, in the second area of the GUI, a second lens positionable over a plurality of portions of the second visual representation displayed within the second area of the GUI, the second lens covering a first portion of the second visual representation within the second area; and

a code module for displaying, in a third area of the GUI, a third visual representation of the multimedia information stored in the multimedia document based on the second lens covering the first portion of the second visual representation within the second area, the third visual representation including a third representation of the information of the first type and a third representation of the information of the second type,

wherein the code module for displaying the first visual representation of the multimedia information stored in the multimedia document in the first area of the GUI comprises;

a code module for displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and

a code module for displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type,

wherein the code module for displaying the second visual representation of the multimedia information stored in the multimedia document in the second area of the GUI comprises;

a code module for displaying, in a first sub-area of the second area of the GUI, the portion of the first representation of the information of the first type covered by the first lens as the second representation of the information of the first type; and

a code module for displaying, in a second sub-area of the second area of the GUI, the portion of the first representation of the information of the second type covered by the first lens as the second representation of the information of the second type,

wherein the code module for displaying the third visual representation of the multimedia information stored in the multimedia document in the third area of the GUI comprises;

a code module for displaying, in a first sub-area of the third area of the GUI, the portion of the second representation of the information of the first type covered by the second lens as the third representation of the information of the first type; and

a code module for displaying, in a second sub-area of the third area of the GUI, the portion of the second representation of the information of the second type covered by the second lens as the third representation of the information of the first type.

32. The system of claim 31 wherein the code module for displaying the first visual representation of the multimedia information stored in the multimedia document comprises:

a code module for displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and

a code module for displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type.

33. The system of claim 31 wherein the code module for displaying the second visual representation of the multimedia information stored in the multimedia document comprises:

a code module for, in a first sub-area of the second area of the GUI, the second representation of the information of the first type as a portion of the first representation of the information of the first type covered by the first lens; and

a code module for displaying, in a second sub-area of the second area of the GUI, the second representation of the information of the first type as a portion of the first representation of the information of the second type covered by the first lens.

34. The system of claim 31 wherein the code module for displaying the second visual representation of the multimedia information stored in the multimedia document comprises:

a code module for determining a first time and a second time associated with the first lens;

a code module for displaying, in the second area of the GUI, a representation of the information of the first type occurring between the first time and the second time associated with the first lens as the second representation of the information of the first type; and

a code module for displaying, in the second area of the GUI, a representation of the information of the second type occurring between the first time and the second time associated with the first lens as the second representation of the information of the second type.

35. The system of claim 31 wherein the plurality of code modules further comprises:

a code module for receiving user input moving the first lens over the first visual representation displayed within the first area to cover a second portion of the first visual representation within the first area; and

responsive to the user input, a code module for automatically changing the second visual representation displayed in the second area of the GUI such that the second visual representation of the multimedia information stored in the multimedia document displayed in the second area of the GUI corresponds to the second portion of the first visual representation of the multimedia information stored in the multimedia document covered by the first lens.

36. The system of claim 31 wherein the code module for displaying, in the third area of the GUI, the third visual representation of the multimedia information stored in the multimedia document comprises:

a code module for determining a first time and a second time associated with the second lens;

a code module for displaying, in the third area of the GUI, a representation of the information of the first type occurring between the first time and the second time associated with the second lens as the third representation of the information of the first type; and

a code module for displaying, in the third area of the GUI, a representation of the information of the second type occurring between the first time and the second time associated with the second lens as the third representation of the information of the second type.

37. The system of claim 31 wherein the plurality of code modules further comprises:

a code module for receiving user input moving the second lens over the second visual representation displayed within the second area to cover a second portion of the second visual representation within the second area; and

responsive to the user input, a code module for automatically changing the third visual representation displayed in the third area of the GUI such that the third visual representation of the multimedia information stored in the multimedia document displayed in the third area of the GUI corresponds to the second portion of the second visual representation of the multimedia information stored in the multimedia document covered by the second lens.

38. The system of claim 31 wherein the plurality of code modules further comprises:

a code module for receiving user input moving the first lens over the first visual representation displayed within the first area to cover a second portion of the first visual representation within first area; and

responsive to the user input, a code module for automatically;

changing the second visual representation displayed in the second area of the GUI such that the second visual representation of the multimedia information stored in the multimedia document displayed in the second area of the GUI corresponds to the second portion of the first visual representation of the multimedia information stored in the multimedia document covered by the first lens; and

changing the third visual representation displayed in the third area of the GUI such that the third visual representation of the multimedia information stored in the multimedia document displayed in the third area of the GUI corresponds to the second visual representation of the multimedia information stored by the multimedia document within the second area.

39. The system of claim 31 wherein the plurality of code modules further comprises:

a code module for displaying a sub-lens covering a portion of the first visual representation displayed within the first area of the GUI corresponding to the first portion of the second visual representation within the second area of the GUI covered by the second lens.

40. The system of claim 39 wherein the plurality of code modules further comprises:

a code module for receiving user input moving the second lens over the second visual representation displayed within the second area to cover a second portion of the second visual representation within the second area; and

responsive to the user input, a code module for automatically changing position of the sub-lens to cover a portion of the first visual representation displayed within the first area of the GUI corresponding to the second portion of the second visual representation within the second area covered by the second lens.

41. The system of claim 31 wherein:

the information of the first type corresponds to video information; and

the first representation of the information of the first type comprises one or more video keyframes extracted from the video information.

42. The system of claim 41 wherein:

the information of the second type corresponds to audio information; and

the first representation of the information of the second type comprises text information obtained from transcribing the audio information.

43. The system of claim 41 wherein:

the information of the second type corresponds to closed-caption (CC) text information; and

the first representation of the information of the second type comprises text information included in the CC text information.

44. The system of claim 31 wherein the plurality of code modules further comprises:

a code module for receiving input indicating selection of a portion of the multimedia information occurring between a first time and a second time; and

a code module for performing a first operation on the portion of the multimedia information occurring between a first time and a second time.

45. A system for displaying multimedia information stored in a multimedia document, the system comprising:

a display;

a processor; and

a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising;

a code module for displaying a graphical user interface (GUI) on the display;

a code module for displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document;

a code module for displaying, in the first area of the GUI, a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area;

a code module for displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document;

a code module for receiving information indicating a user-specified concept of interest; and

a code module for analyzing the multimedia information stored in the multimedia document to identify one or more locations in the multimedia information that are relevant to the user-specified concept of interest;

wherein the code module for displaying, in the first area of the GUI, the first visual representation of the multimedia information stored in the multimedia document comprises annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest; and

wherein the code module for displaying, in the second area of the GUI, the second visual representation of the multimedia information stored in the multimedia document comprises annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest and that are located in the first portion of the first visual representation covered by the first lens within the first area.