Multimedia visualization and integration environment
First Claim
Patent Images
1. A method of displaying multimedia information stored in a multimedia document on a display, the method comprising:
- displaying a graphical user interface (GUI) on the display;
displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document;
displaying, in the first area of the GUI, a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area;
displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document;
displaying, in the second area of the GUI, a second lens positionable over a plurality of portions of the second visual representation displayed within the second area of the GUI, the second lens covering a first portion of the second visual representation within the second area; and
displaying, in a third area of the GUI, a third visual representation of the multimedia information stored in the multimedia document based on the second lens covering the first portion of the second visual representation within the second area, the third visual representation including a third representation of the information of the first type and a third representation of the information of the second type,wherein displaying the first visual representation of the multimedia information stored in the multimedia document in the first area of the GUI comprises;
displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and
displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type,wherein displaying the second visual representation of the multimedia information stored in the multimedia document in the second area of the GUI comprises;
displaying, in a first sub-area of the second area of the GUI, the portion of the first representation of the information of the first type covered by the first lens as the second representation of the information of the first type; and
displaying, in a second sub-area of the second area of the GUI, the portion of the first representation of the information of the second type covered by the first lens as the second representation of the information of the second type,wherein displaying the third visual representation of the multimedia information stored in the multimedia document in the third area of the GUI comprises;
displaying, in a first sub-area of the third area of the GUI, the portion of the second representation of the information of the first type covered by the second lens as the third representation of the information of the first type; and
displaying, in a second sub-area of the third area of the GUI, the portion of the second representation of the information of the second type covered by the second lens as the third representation of the information of the first type.
2 Assignments
0 Petitions
Accused Products
Abstract
Embodiments of the present invention provide techniques for retrieving and displaying multimedia information. According to an embodiment of the present invention, a graphical user interface (GUI) is provided that displays multimedia information that may be stored in a multimedia document. According to the teachings of the present invention, the GUI enables a user to navigate through multimedia information stored in a multimedia document. The GUI provides both a focused and a contextual view of the contents of the multimedia document.
-
Citations
45 Claims
-
1. A method of displaying multimedia information stored in a multimedia document on a display, the method comprising:
-
displaying a graphical user interface (GUI) on the display; displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document; displaying, in the first area of the GUI, a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area; displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document; displaying, in the second area of the GUI, a second lens positionable over a plurality of portions of the second visual representation displayed within the second area of the GUI, the second lens covering a first portion of the second visual representation within the second area; and displaying, in a third area of the GUI, a third visual representation of the multimedia information stored in the multimedia document based on the second lens covering the first portion of the second visual representation within the second area, the third visual representation including a third representation of the information of the first type and a third representation of the information of the second type, wherein displaying the first visual representation of the multimedia information stored in the multimedia document in the first area of the GUI comprises; displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type, wherein displaying the second visual representation of the multimedia information stored in the multimedia document in the second area of the GUI comprises; displaying, in a first sub-area of the second area of the GUI, the portion of the first representation of the information of the first type covered by the first lens as the second representation of the information of the first type; and displaying, in a second sub-area of the second area of the GUI, the portion of the first representation of the information of the second type covered by the first lens as the second representation of the information of the second type, wherein displaying the third visual representation of the multimedia information stored in the multimedia document in the third area of the GUI comprises; displaying, in a first sub-area of the third area of the GUI, the portion of the second representation of the information of the first type covered by the second lens as the third representation of the information of the first type; and displaying, in a second sub-area of the third area of the GUI, the portion of the second representation of the information of the second type covered by the second lens as the third representation of the information of the first type. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A method of displaying multimedia information stored in a multimedia document on a display, the method comprising:
-
displaying a graphical user interface (GUI) on the display; displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document; displaying, in the first area of the GUI, a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area; displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document; receiving information indicating a user-specified concept of interest; and analyzing the multimedia information stored in the multimedia document to identify one or more locations in the multimedia information that are relevant to the user-specified concept of interest; wherein displaying, in the first area of the GUI, the first visual representation of the multimedia information stored in the multimedia document comprises annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest; and wherein displaying, in the second area of the GUI, the second visual representation of the multimedia information stored in the multimedia document comprises annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest and that are located in the first portion of the first visual representation covered by the first lens within the first area.
-
-
16. A computer program product stored on a computer-readable storage medium for displaying multimedia information stored in a multimedia document on a display, the computer program product comprising:
-
code for displaying a graphical user interface (GUI) on the display; code for displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document; code for displaying a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area; code for displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document; code for displaying, in the second area of the GUI, a second lens positionable over a plurality of portions of the second visual representation displayed within the second area of the GUI, the second lens covering a first portion of the second visual representation within the second area; and code for displaying, in a third area of the GUI, a third visual representation of the multimedia information stored in the multimedia document based on the second lens covering the first portion of the second visual representation within the second area, the third visual representation comprising a third representation of the information of the first type and a third representation of the information of the second type, wherein the code for displaying the first visual representation of the multimedia information stored in the multimedia document in the first area of the GUI comprises; code for displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and code for displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type, wherein the code for displaying the second visual representation of the multimedia information stored in the multimedia document in the second area of the GUI comprises; code for displaying, in a first sub-area of the second area of the GUI, the portion of the first representation of the information of the first type covered by the first lens; and code for displaying, in a second sub-area of the second area of the GUI, the portion of the first representation of the information of the second type covered by the first lens, wherein the code for displaying the third visual representation of the multimedia information stored in the multimedia document in the third area of the GUI comprises; code for displaying, in a first sub-area of the third area of the GUI, the portion of the second representation of the information of the first type covered by the second lens as the third representation of the information of the first type; and code for displaying, in a second sub-area of the third area of the GUI, the portion of the second representation of the information of the second type covered by the second lens as the third representation of the information of the second type. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29)
-
-
30. A computer program product stored on a computer-readable storage medium for displaying multimedia information stored in a multimedia document on a display, the computer program product comprising:
-
code for displaying a graphical user interface (GUI) on the display; code for displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document; code for displaying a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area; code for displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document; code for receiving information indicating a user-specified concept of interest; and code for analyzing the multimedia information stored in the multimedia document to identify one or more locations in the multimedia information that are relevant to the user-specified concept of interest; wherein the code for displaying, in the first area of the GUI, the first visual representation of the multimedia information stored in the multimedia document comprises code for annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest; and wherein the code for displaying, in the second area of the GUI, the second visual representation of the multimedia information stored in the multimedia document comprises code for annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest and that are located in the first portion of the first visual representation covered by the first lens within the first area.
-
-
31. A system for displaying multimedia information stored in a multimedia document, the system comprising:
-
a display; a processor; and a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising; a code module for displaying a graphical user interface (GUI) on the display; a code module for displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document; a code module for displaying, in the first area of the GUI, a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area; a code module for displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document; a code module for displaying, in the second area of the GUI, a second lens positionable over a plurality of portions of the second visual representation displayed within the second area of the GUI, the second lens covering a first portion of the second visual representation within the second area; and a code module for displaying, in a third area of the GUI, a third visual representation of the multimedia information stored in the multimedia document based on the second lens covering the first portion of the second visual representation within the second area, the third visual representation including a third representation of the information of the first type and a third representation of the information of the second type, wherein the code module for displaying the first visual representation of the multimedia information stored in the multimedia document in the first area of the GUI comprises; a code module for displaying a first thumbnail image in the first area of the GUI, the first thumbnail image comprising the first representation of the information of the first type; and a code module for displaying a second thumbnail image in the first area of the GUI, the second thumbnail image comprising the first representation of the information of the second type, wherein the code module for displaying the second visual representation of the multimedia information stored in the multimedia document in the second area of the GUI comprises; a code module for displaying, in a first sub-area of the second area of the GUI, the portion of the first representation of the information of the first type covered by the first lens as the second representation of the information of the first type; and a code module for displaying, in a second sub-area of the second area of the GUI, the portion of the first representation of the information of the second type covered by the first lens as the second representation of the information of the second type, wherein the code module for displaying the third visual representation of the multimedia information stored in the multimedia document in the third area of the GUI comprises; a code module for displaying, in a first sub-area of the third area of the GUI, the portion of the second representation of the information of the first type covered by the second lens as the third representation of the information of the first type; and a code module for displaying, in a second sub-area of the third area of the GUI, the portion of the second representation of the information of the second type covered by the second lens as the third representation of the information of the first type. - View Dependent Claims (32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44)
-
-
45. A system for displaying multimedia information stored in a multimedia document, the system comprising:
-
a display; a processor; and a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising; a code module for displaying a graphical user interface (GUI) on the display; a code module for displaying, in a first area of the GUI, a first visual representation of the multimedia information stored in the multimedia document, the first visual representation including a first representation of information of a first type stored in the multimedia document and a first representation of information of a second type stored in the multimedia document; a code module for displaying, in the first area of the GUI, a first lens positionable over a plurality of portions of the first visual representation displayed within the first area of the GUI, the first lens covering a first portion of the first visual representation within the first area; a code module for displaying, in a second area of the GUI, a second visual representation of the multimedia information stored in the multimedia document based on the first lens covering the first portion of the first visual representation within the first area, the second visual representation including a second representation of the information of the first type stored in the multimedia document and a second representation of the information of the second type stored in the multimedia document; a code module for receiving information indicating a user-specified concept of interest; and a code module for analyzing the multimedia information stored in the multimedia document to identify one or more locations in the multimedia information that are relevant to the user-specified concept of interest; wherein the code module for displaying, in the first area of the GUI, the first visual representation of the multimedia information stored in the multimedia document comprises annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest; and wherein the code module for displaying, in the second area of the GUI, the second visual representation of the multimedia information stored in the multimedia document comprises annotating the one or more locations in the multimedia information that are relevant to the user-specified concept of interest and that are located in the first portion of the first visual representation covered by the first lens within the first area.
-
Specification