Techniques for displaying information stored in multiple multimedia documents

• US 8,635,531 B2
• Filed: 06/18/2003
• Issued: 01/21/2014
• Est. Priority Date: 02/21/2002
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Hull, Jonathan J., Wolff, Gregory J.
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): DUONG, HIEN LUONGVAN
• Application Number:
  US10/465,022
• Publication Number:
  US 20040095376A1
• Time in Patent Office: 3,870 Days
• Field of Search: 715/764, 715/701, 715/702, 715/716, 715/787, 715/723, 715/835, 715/719, 715/724, 725/61, 725/51, 725/52
• US Class Current: 715/716
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/70 of video data

Abstract

Techniques for providing a graphical user interface (GUI) that displays a representation of stored information that may include information of one or more types. The displayed representation may include representations of information of the one or more types. The GUI enables a user to navigate and skim through the stored information and to analyze the contents of the stored information. The stored information may include information captured along the same timeline or along different timelines.

Claims

1. A computer-implemented method of displaying information, the method comprising:

displaying a first representation in a first area of a display device comprising a plurality of first text information and a plurality of first video keyframes representative of first stored information;

displaying a first lens positionable over the first representation in the first area;

displaying a second representation in a second area of the display device comprising a plurality of second text information and a plurality of second video keyframes representative of second stored information;

displaying a second lens positionable over the second representation in the second area;

displaying a third representation in a third area of the display device comprising one or more third video keyframes representative of the first stored information;

displaying a fourth representation in a fourth area of the display device comprising one or more fourth video keyframes representative of the second stored information;

in response to a change in location of the first lens, updating the third representation in the third area based on the changed location of the first lens;

in response to a change in location of the second lens, updating the fourth representation in the fourth area based on the changed location of the second lens; and

receiving a first criterion from a user after displaying the first representation and the second representation,

wherein a first plurality of the first video keyframes which contain the first criterion are highlighted,

wherein a first plurality of the second video keyframes which contain the first criterion are highlighted,

wherein one or more portions of the first text information which contain the first criterion are highlighted, and

wherein one or more portions of the second text information which contain the first criterion are highlighted.

2. The method of claim 1 wherein:

the first criterion comprises a word.

3. The method of claim 1 wherein:

the first criterion comprises a topic of interest.

4. The method of claim 1 wherein:

the first text information is obtained from transcribing audio information included in the first stored information; and

the second text information is obtained from transcribing audio information included in the second stored information.

5. The method of claim 1 further comprising:

playing back video information of the third representation in the third area; and

playing back video information of the fourth representation in the fourth area.

6. The method of claim 1 further comprising:

receiving a signal indicating selection of a first portion of the first video keyframes or the second video keyframes that are highlighted; and

displaying a fifth representation of contents of the selected first portion.

7. The method of claim 6 wherein the fifth representation of the contents of the selected first portion is a web page generated based upon the contents of the selected first portion.

8. An apparatus for displaying information, the apparatus comprising:

a processor; and

a display;

wherein the processor is configured to;

display, in a first area of the display, a first representation of first stored information, the first representation comprising a plurality of first text information and a plurality of first video keyframes;

display, in the first area, a first lens positionable over the first representation;

display, in a second area of the display, a second representation of second stored information, the second representation comprising a plurality of second text information and a plurality of second video keyframes;

display, in the second area, a second lens positionable over the second representation;

display, in a third area of the display, a third representation of the first stored information, the third representation comprising one or more third video keyframes;

display, in a fourth area of the display, a fourth representation of the second stored information, the fourth representation comprising one or more fourth video keyframes;

in response to a change in location of the first lens, update, in the third area, the third representation based on the changed location of the first lens;

in response to a change in location of the second lens, update, in the fourth area, the fourth representation based on the changed location of the second lens; and

receive a first criterion from a user after displaying the first representation and the second representation,

wherein a first plurality of the first video keyframes which contain the first criterion are highlighted,

wherein a first plurality of the second video keyframes which contain the first criterion are highlighted,

wherein one or more portions of the first text information which contain the first criterion are highlighted, and

wherein one or more portions of the second text information which contain the first criterion are highlighted.

9. The apparatus of claim 8 wherein the first criterion comprises a word.

10. The apparatus of claim 9 wherein the processor is configured to:

cause playback of video information of the third representation in the third area; and

cause playback of video information of the fourth representation in the fourth area.

11. The apparatus of claim 9 wherein the processor is configured to:

receive a signal indicating selection of a first portion of the first video keyframes or the second video keyframes that are highlighted; and

display, on the display, a fifth representation of contents of the selected first portion.

12. The apparatus of claim 11 wherein the fifth representation of the contents of the selected first portion is a web page generated based upon the contents of the selected first portion.

13. The apparatus of claim 8 wherein the first criterion comprises a topic of interest.

14. The apparatus of claim 8 wherein:

the first text information is obtained from transcribing audio information included in the first stored information; and

the second text information is obtained from transcribing audio information included in the second stored information.

15. A non-transitory computer-readable storage medium for storing computer code for displaying information comprising:

code for displaying a first representation in a first area of a display device comprising a plurality of first text information and a plurality of first video keyframes representative of first stored information;

code for displaying a first lens positionable over the first representation in the first area;

code for displaying a second representation in a second area of the display device comprising a plurality of second text information and a plurality of second video keyframes representative of second stored information;

code for displaying a second lens positionable over the second representation in the second area;

code for displaying a third representation in a third area of the display device comprising one or more third video keyframes representative of the first stored information;

code for displaying a fourth representation in a fourth area of the display device comprising one or more fourth video keyframes representative of the second stored information;

in response to a change in location of the first lens, code for updating the third representation in the third area based on the changed location of the first lens;

in response to a change in location of the second lens, code for updating the fourth representation in the fourth area based on the changed location of the second lens; and

code for receiving a first criterion from a user, wherein the first criterion is received after displaying the first representation and the second representation,

wherein a first plurality of the first video keyframes which contain the first criterion are highlighted,

wherein a first plurality of the second video keyframes which contain the first criterion are highlighted,

wherein one or more portions of the first text information which contain the first criterion are highlighted, and

wherein one or more portions of the second text information which contain the first criterion are highlighted.

16. The non-transitory computer-readable storage medium of claim 15 wherein the first criterion comprises a word.

17. The non-transitory computer-readable storage medium of claim 15 wherein the first criterion comprises a topic of interest.

18. An apparatus for displaying information, the apparatus comprising:

means for displaying a first representation in a first area of a display device comprising a plurality of first text information and a plurality of first video keyframes representative of first stored information;

means for displaying a first lens positionable over the first representation in the first area;

means for displaying a second representation in a second area of the display device comprising a plurality of second text information and a plurality of second video keyframes representative of second stored information;

means for displaying a second lens positionable over the second representation in the second area;

means for displaying a third representation in a third area of the display device comprising one or more third video keyframes representative of the first stored information;

means for displaying a fourth representation in a fourth area of the display device comprising one or more fourth video keyframes representative of the second stored information;

in response to a change in location of the first lens, means for updating the third representation in the third area based on the changed location of the first lens;

in response to a change in location of the second lens, means for updating the fourth representation in the fourth area based on the changed location of the second lens; and

means for receiving a first criterion from a user, wherein the first criterion is received after displaying the first representation and the second representation,

wherein a first plurality of the first video keyframes which contain the first criterion are highlighted,

wherein a first plurality of the second video keyframes which contain the first criterion are highlighted,

wherein one or more portions of the first text information which contain the first criterion are highlighted, and

wherein one or more portions of the second text information which contain the first criterion are highlighted.