Multimedia visualization and integration environment
First Claim
1. A method of displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising information of a plurality of types including information of a first type and information of a second type, the method comprising:
- displaying a graphical user interface (GUI) on the display;
displaying, in a first area of the GUI, a representation of the multimedia information stored by the multimedia document, the displayed representation of the multimedia information comprising a representation of information of the first type and a representation of information of the second type;
displaying a first lens covering a first portion of the first area; and
displaying, in a second area of the GUI, a representation of multimedia information displayed in the first portion of the first area, the representation of multimedia information displayed in the second area comprising a portion of the representation of information of the first type covered by the first lens and a portion of the representation of information of the second type covered by the first lens.
2 Assignments
0 Petitions
Accused Products
Abstract
Embodiments of the present invention provide techniques for retrieving and displaying multimedia information. According to an embodiment of the present invention, a graphical user interface (GUI) is provided that displays multimedia information that may be stored in a multimedia document. According to the teachings of the present invention, the GUI enables a user to navigate through multimedia information stored in a multimedia document. The GUI provides both a focused and a contextual view of the contents of the multimedia document.
221 Citations
111 Claims
-
1. A method of displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising information of a plurality of types including information of a first type and information of a second type, the method comprising:
-
displaying a graphical user interface (GUI) on the display;
displaying, in a first area of the GUI, a representation of the multimedia information stored by the multimedia document, the displayed representation of the multimedia information comprising a representation of information of the first type and a representation of information of the second type;
displaying a first lens covering a first portion of the first area; and
displaying, in a second area of the GUI, a representation of multimedia information displayed in the first portion of the first area, the representation of multimedia information displayed in the second area comprising a portion of the representation of information of the first type covered by the first lens and a portion of the representation of information of the second type covered by the first lens. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A method of displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising information of a first type and information of a second type, the method comprising:
-
displaying a graphical user interface (GUI) on the display;
displaying, in a first area of the GUI, a representation of the multimedia information stored by the multimedia document occurring between a start time (ts) and an end time (te) associated with the multimedia document, the displayed representation of the multimedia information comprising a representation of information of the first type occurring between ts and te and a representation of information of the second type occurring between ts and te, where (te>
ts);
displaying a first lens emphasizing a portion of the first area of the GUI, the portion of the first area emphasized by the first lens comprising a representation of multimedia information occurring between a first time (t1) and a second time (t2), where (ts≦
t1<
t2≦
te); and
displaying, in a second area of the GUI, the representation of multimedia information occurring between t1 and t2, the representation of multimedia information displayed in the second area comprising a representation of information of the first type occurring between t1 and t2 and a representation of information of the second type occurring between t1 and t2. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25, 26, 27)
-
-
28. A method of displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising video information and information of a first type, the method comprising:
-
displaying a graphical user interface (GUI) on the display;
displaying, in a first section of a first area of the GUI, a first set of one or more video keyframes extracted from the video information occurring between a start time (ts) and an end time (te) associated with the multimedia document, where (te>
ts);
displaying, in a second section of the first area of the GUI, text information corresponding to the information of the first type occurring between ts and te;
displaying a first lens emphasizing a portion of the first section of the first area occurring between a first time (t1) and a second time (t2) and a portion of the second section of the first area occurring between t1 and t2, the emphasized portion of the first section of the first area comprising a second set of one or more video keyframes extracted from the video information occurring between t1 and t2, the emphasized portion of the second section of the first area comprising text information corresponding to information of the first type occurring between t1 and t2, wherein the second set of one or more keyframes is a subset of the first set of one or more keyframes and (ts≦
t1<
t2≦
te);
displaying the second set of one or more keyframes in a first section of a second area of the GUI; and
displaying text information corresponding to the information of the first type occurring between t1 and t2 in a second section of the second area of the GUI. - View Dependent Claims (29, 30, 31, 32, 33, 34, 35, 36)
-
-
37. A system for displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising information of a plurality of types including information of a first type and information of a second type, the system comprising:
-
means for displaying a graphical user interface (GUI) on the display;
means for displaying, in a first area of the GUI, a representation of the multimedia information stored by the multimedia document, the displayed representation of the multimedia information comprising a representation of information of the first type and a representation of information of the second type;
means for displaying a first lens covering a first portion of the first area; and
means for displaying, in a second area of the GUI, a representation of multimedia information displayed in the first portion of the first area, the representation of multimedia information displayed in the second area comprising a portion of the representation of information of the first type covered by the first lens and a portion of the representation of information of the second type covered by the first lens.
-
-
38. A system for displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising information of a first type and information of a second type, the system comprising:
-
means for displaying a graphical user interface (GUI) on the display;
means for displaying, in a first area of the GUI, a representation of the multimedia information stored by the multimedia document occurring between a start time (ts) and an end time (te) associated with the multimedia document, the displayed representation of the multimedia information comprising a representation of information of the first type occurring between ts and te and a representation of information of the second type occurring between ts and te, where (te>
ts);
means for displaying a first lens emphasizing a portion of the first area of the GUI, the portion of the first area emphasized by the first lens comprising a representation of multimedia information occurring between a first time (t1) and a second time (t2), where (ts≦
t1<
t2≦
te); and
means for displaying, in a second area of the GUI, the representation of multimedia information occurring between t1 and t2, the representation of multimedia information displayed in the second area comprising a representation of information of the first type occurring between t1 and t2 and a representation of information of the second type occurring between t1 and t2.
-
-
39. A system for of displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising video information and information of a first type, the system comprising:
-
means for displaying a graphical user interface (GUI) on the display;
means for displaying, in a first section of a first area of the GUI, a first set of one or more video keyframes extracted from the video information occurring between a start time (ts) and an end time (te) associated with the multimedia document, where (te>
ts);
means for displaying, in a second section of the first area of the GUI, text information corresponding to the information of the first type occurring between ts and te;
means for displaying a first lens emphasizing a portion of the first section of the first area occurring between a first time (t1) and a second time (t2) and a portion of the second section of the first area occurring between t1 and t2, the emphasized portion of the first section of the first area comprising a second set of one or more video keyframes extracted from the video information occurring between t1 and t2, the emphasized portion of the second section of the first area comprising text information corresponding to information of the first type occurring between t1 and t2, wherein the second set of one or more keyframes is a subset of the first set of one or more keyframes and (ts≦
t1<
t2≦
te);
means for displaying the second set of one or more keyframes in a first section of a second area of the GUI; and
means for displaying text information corresponding to the information of the first type occurring between t1 and t2 in a second section of the second area of the GUI.
-
-
40. A computer program product stored on a computer-readable storage medium for displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising information of a plurality of types including information of a first type and information of a second type, the computer program product comprising:
-
code for displaying a graphical user interface (GUI) on the display;
code for displaying, in a first area of the GUI, a representation of the multimedia information stored by the multimedia document, the displayed representation of the multimedia information comprising a representation of information of the first type and a representation of information of the second type;
code for displaying a first lens covering a first portion of the first area; and
code for displaying, in a second area of the GUI, a representation of multimedia information displayed in the first portion of the first area, the representation of multimedia information displayed in the second area comprising a portion of the representation of information of the first type covered by the first lens and a portion of the representation of information of the second type covered by the first lens. - View Dependent Claims (41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56)
-
-
57. A computer program product stored on a computer-readable storage medium for displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising information of a first type and information of a second type, the computer program product comprising:
-
code for displaying a graphical user interface (GUI) on the display;
code for displaying, in a first area of the GUI, a representation of the multimedia information stored by the multimedia document occurring between a start time (ts) and an end time (te) associated with the multimedia document, the displayed representation of the multimedia information comprising a representation of information of the first type occurring between ts and te and a representation of information of the second type occurring between ts and te, where (te>
ts);
code for displaying a first lens emphasizing a portion of the first area of the GUI, the portion of the first area emphasized by the first lens comprising a representation of multimedia information occurring between a first time (t1) and a second time (t2), where (ts≦
t1<
t2≦
te); and
code for displaying, in a second area of the GUI, the representation of multimedia information occurring between t1 and t2, the representation of multimedia information displayed in the second area comprising a representation of information of the first type occurring between t1 and t2 and a representation of information of the second type occurring between t1 and t2. - View Dependent Claims (58, 59, 60, 61, 62, 63, 64, 65, 66)
-
-
67. A computer program product stored on a computer-readable storage medium for displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising video information and information of a first type, the computer program product comprising:
-
code for displaying a graphical user interface (GUI) on the display;
code for displaying, in a first section of a first area of the GUI, a first set of one or more video keyframes extracted from the video information occurring between a start time (ts) and an end time (te) associated with the multimedia document, where (te>
ts);
code for displaying, in a second section of the first area of the GUI, text information corresponding to the information of the first type occurring between ts and te;
code for displaying a first lens emphasizing a portion of the first section of the first area occurring between a first time (t1) and a second time (t2) and a portion of the second section of the first area occurring between t1 and t2, the emphasized portion of the first section of the first area comprising a second set of one or more video keyframes extracted from the video information occurring between t1 and t2, the emphasized portion of the second section of the first area comprising text information corresponding to information of the first type occurring between t1 and t2, wherein the second set of one or more keyframes is a subset of the first set of one or more keyframes and (ts≦
t1<
t2≦
te);
code for displaying the second set of one or more keyframes in a first section of a second area of the GUI; and
code for displaying text information corresponding to the information of the first type occurring between t1 and t2 in a second section of the second area of the GUI. - View Dependent Claims (68, 69, 70, 71, 72, 73, 74, 75)
-
-
76. A system for displaying multimedia information stored in a multimedia document, the multimedia information comprising information of a plurality of types including information of a first type and information of a second type, the system comprising:
-
a display;
a processor; and
a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising;
a code module for displaying a graphical user interface (GUI) on the display;
a code module for displaying, in a first area of the GUI, a representation of the multimedia information stored by the multimedia document, the displayed representation of the multimedia information comprising a representation of information of the first type and a representation of information of the second type;
a code module for displaying a first lens covering a first portion of the first area; and
a code module for displaying, in a second area of the GUI, a representation of multimedia information displayed in the first portion of the first area, the representation of multimedia information displayed in the second area comprising a portion of the representation of information of the first type covered by the first lens and a portion of the representation of information of the second type covered by the first lens. - View Dependent Claims (77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92)
-
-
93. A system for displaying multimedia information stored in a multimedia document, the multimedia information comprising information of a first type and information of a second type, the system comprising:
-
a display;
a processor; and
a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising;
a code module for displaying a graphical user interface (GUI) on the display;
a code module for displaying, in a first area of the GUI, a representation of the multimedia information stored by the multimedia document occurring between a start time (ts) and an end time (te) associated with the multimedia document, the displayed representation of the multimedia information comprising a representation of information of the first type occurring between ts and te and a representation of information of the second type occurring between ts and te, where (te>
ts);
a code module for displaying a first lens emphasizing a portion of the first area of the GUI, the portion of the first area emphasized by the first lens comprising a representation of multimedia information occurring between a first time (t1) and a second time (t2), where (ts≦
t1<
t2≦
te); and
a code module for displaying, in a second area of the GUI, the representation of multimedia information occurring between t1 and t2, the representation of multimedia information displayed in the second area comprising a representation of information of the first type occurring between t1 and t2 and a representation of information of the second type occurring between t1 and t2. - View Dependent Claims (94, 95, 96, 97, 98, 99, 100, 101, 102)
-
-
103. A system of displaying multimedia information stored in a multimedia document on a display, the multimedia information comprising video information and information of a first type, the system comprising:
-
a display;
a processor; and
a memory coupled to the processor, the memory configured to store a computer program;
wherein the processor is operative with the computer program to;
display a graphical user interface (GUI) on the display;
display, in a first section of a first area of the GUI, a first set of one or more video keyframes extracted from the video information occurring between a start time (ts) and an end time (te) associated with the multimedia document, where (te>
ts);
display, in a second section of the first area of the GUI, text information corresponding to the information of the first type occurring between ts and te;
display a first lens emphasizing a portion of the first section of the first area occurring between a first time (t1) and a second time (t2) and a portion of the second section of the first area occurring between t1 and t2, the emphasized portion of the first section of the first area comprising a second set of one or more video keyframes extracted from the video information occurring between t1 and t2, the emphasized portion of the second section of the first area comprising text information corresponding to information of the first type occurring between t1 and t2, wherein the second set of one or more keyframes is a subset of the first set of one or more keyframes and (ts≦
t1<
t2≦
te);
display the second set of one or more keyframes in a first section of a second area of the GUI; and
display text information corresponding to the information of the first type occurring between t1 and t2 in a second section of the second area of the GUI. - View Dependent Claims (104, 105, 106, 107, 108, 109, 110, 111)
-
Specification