Techniques for displaying information stored in multiple multimedia documents

• US 20040095376A1
• Filed: 06/18/2003
• Published: 05/20/2004
• Est. Priority Date: 02/21/2002
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Wolff, Gregory J., Hull, Jonathan J.
• Granted Patent: US 8,635,531 B2
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/70 of video data

Abstract

Techniques for providing a graphical user interface (GUI) that displays a representation of stored information that may include information of one or more types. The displayed representation may include representations of information of the one or more types. The GUI enables a user to navigate and skim through the stored information and to analyze the contents of the stored information. The stored information may include information captured along the same timeline or along different timelines.

Claims

1. A computer-implemented method of displaying information, the method comprising:

displaying a first representation of first stored information, the first stored information comprising information of a first type and information of a second type, the first representation comprising a representation of information of the first type included in the first stored information and a representation of the information of the second type included in the first stored information; and

highlighting one or more portions of the first representation, the highlighted one or more portions of the first representation corresponding to portions of the first representation that include a first criterion.

2. The method of claim 1 further comprising:

displaying a second representation of second stored information, the second stored information comprising information of a first type and information of a second type, the second representation comprising a representation of information of the first type included in the second stored information and a representation of information of the second type included in the second stored information; and

highlighting one or more portions of the second representation, the highlighted one or more portions of the first representation corresponding to portions of the second representation that include the first criterion.

3. The method of claim 2 wherein:

the first criterion comprises a word;

highlighting one or more portions of the first representation comprises highlighting one or more portions of the first representation that contain the word; and

highlighting one or more portions of the second representation comprises highlighting one or more portions of the second representation that contain the word.

4. The method of claim 2 wherein:

the first criterion comprises a topic of interest;

highlighting one or more portions of the first representation comprises highlighting one or more portions of the first representation that are relevant to the topic of interest; and

highlighting one or more portions of the second representation comprises highlighting one or more portions of the second representation that are relevant to the topic of interest.

5. The method of claim 2 wherein:

the information of the first type included in the first stored information is audio information;

the information of the second type included in the first stored information is video information;

the information of the first type included in the second stored information is audio information; and

the information of the second type included in the second stored information is video information.

6. The method of claim 5 wherein:

the representation of information of the first type included in the first representation comprises text information obtained from transcribing the audio information included in the first stored information;

the representation of information of the second type included in the first representation comprises one or more video keyframes extracted from the video information included in the first stored information;

the representation of information of the first type included in the second representation comprises text information obtained from transcribing the audio information included in the second stored information; and

the representation of information of the second type included in the second representation comprises one or more video keyframes extracted from the video information included in the second stored information.

7. The method of claim 6 wherein:

highlighting one or more portions of the first representation comprises highlighting one or more lines from the text information included in the first representation that include the first criterion; and

highlighting one or more portions of the second representation comprises highlighting one or more lines from the text information included in the second representation that include the first criterion.

8. The method of claim 6 wherein:

highlighting one or more portions of the first representation comprises highlighting one or more video keyframes from the video keyframes included in the first representation that include the first criterion; and

highlighting one or more portions of the second representation comprises highlighting one or more video keyframes from the video keyframes included in the second representation that include the first criterion.

9. The method of claim 5 further comprising playing back the video information included in the first stored information and the video information included in the second stored information.

10. The method of claim 2 further comprising:

receiving a signal indicating selection of a first portion from the one or more highlighted portions of the first representation or the second representation; and

displaying a representation of the contents of the first selected portion.

11. The method of claim 10 wherein the representation of the contents of the first selected portion is a web page generated based upon the contents of the first selected portion.

12. The method of claim 2 further comprising:

displaying a representation for each portion in the one or more highlighted portions of the first representation and the second representation, wherein the representation for a portion is generated based upon the contents of the portion.

13. The method of claim 2 further comprising playing back the first type of information included in the first stored information and the first type of information stored in the second stored information.

14. A computer-implemented method of displaying multimedia information, the method comprising:

displaying a first thumbnail comprising a representation of information of a first type included in a first recorded information;

displaying a second thumbnail comprising a representation of information of a second type included in the first recorded information;

displaying a third thumbnail comprising a representation of information of a first type included in a second recorded information; and

displaying a fourth thumbnail comprising a representation of information of a second type included in the second recorded information.

15. The method of claim 14 further comprising:

receiving information identifying a set of one or more words; and

highlighting one or more portions of the first thumbnail and the third thumbnail that comprise at least one word from the set of words.

16. The method of claim 15 further comprising:

highlighting one or more portions of the second thumbnail and the fourth thumbnail that comprise at least one word from the set of words.

17. The method of claim 16 further comprising:

receiving information indicating selection of a first portion from the one or more highlighted portions of the second or the fourth thumbnail, the first portion corresponding to a portion of information of the second type included in the first recorded information or the second recorded information; and

outputting the information of the second type corresponding to the first portion.

18. The method of claim 14 further comprising:

receiving information identifying a set of one or more topics of interest; and

highlighting one or more portions of the first thumbnail and the third thumbnail that comprise content relevant to at least one topics of interest from the set of topics of interest.

19. The method of claim 18 further comprising:

highlighting one or more portions of the second thumbnail and the fourth thumbnail that comprise content relevant to at least one topics of interest from the set of topics of interest.

20. The method of claim 14 wherein:

the information of the first type included in the first recorded information is audio information;

the information of the second type included in the first recorded information is video information;

the information of the first type included in the second recorded information is audio information;

the information of the second type included in the second recorded information is video information;

the first thumbnail comprises text information obtained from the audio information included in the first recorded information;

the second thumbnail comprises one or more video keyframes extracted from the video information included in the first recorded information;

the third thumbnail comprises text information obtained from the audio information included in the second recorded information; and

the fourth thumbnail comprises one or more video keyframes extracted from the video information included in the second recorded information.

21. The method of claim 14 wherein:

the information of the first type included in the first recorded information is closed-caption text information;

the information of the second type included in the first recorded information is video information;

the information of the first type included in the second recorded information is closed-caption text information;

the information of the second type included in the second recorded information is video information;

the first thumbnail comprises text information obtained from the closed caption text information included in the first recorded information;

the second thumbnail comprises one or more video keyframes extracted from the video information included in the first recorded information;

the third thumbnail comprises text information obtained from the closed-caption text information included in the second recorded information; and

the fourth thumbnail comprises one or more video keyframes extracted from the video information included in the second recorded information.

22. A method of displaying information included in a first recorded information and a second recorded information, the first recorded information comprising audio information and video information, the second recorded information comprising audio and video information, the method comprising:

displaying a first representation of information included in the first recorded information, the first representation comprising a first thumbnail and a second thumbnail, the first thumbnail comprising text information obtained from the audio information included in the first recorded information, the second thumbnail comprising one or more keyframes extracted from the video information included in the first recorded information; and

displaying a second representation of information included in the second recorded information, the second representation comprising a third thumbnail and a fourth thumbnail, the third thumbnail comprising text information obtained from the audio information included in the second recorded information, the fourth thumbnail comprising one or more keyframes extracted from the video information included in the second recorded information.

23. The method of claim 22 further comprising:

receiving information identifying a user criterion; and

highlighting one or more portions of the first representation and the second representation that include the user criterion, wherein a highlighted portion of the first representation covers a section of the first thumbnail and the second thumbnail and a highlighted portion of the second representation covers a section of the third thumbnail and the fourth thumbnail.

24. The method of claim 23 wherein highlighting the one or more portions of the first representation and the second representation comprises:

identifying locations in the first representation and the second representation that include the user criterion; and

determining the one or more portions of the first representation and the second representation to be highlighted based upon the identified locations.

25. The method of claim 23 wherein the user criterion is a set of one or more words or phrases.

26. The method of claim 23 wherein the user criterion is a set of one or more topics of interest.

27. The method of claim 23 further comprising:

displaying a document for each highlighted portion of the first representation and the second representation, wherein the document for a portion comprises text information from the section of the first or the third thumbnail covered by the portion and one or more keyframes from the section of the second or the fourth thumbnail covered by the portion.

28. The method of claim 23 further comprising:

receiving information indicating selection of a first highlighted portion from the one or more highlighted portions of the first representation;

displaying a document for first highlighted portion, wherein the document for the first highlighted portion comprises text information from the section of the first thumbnail covered by the first highlighted portion and one or more keyframes from the section of the second thumbnail covered by the first highlighted portion.

29. The method of claim 23 further comprising:

receiving information indicating selection of a first highlighted portion from the one or more highlighted portions of the first representation; and

outputting video information from the first recorded information corresponding to the first highlighted portion.

30. A computer-implemented method of displaying information, the method comprising:

displaying a representation of stored information;

receiving information indicative of one or more portions of the stored information that have been output; and

highlighting one or more portions of the representation of the stored information corresponding to the one or more portions of the stored information that have been output.

31. The method of claim 30 wherein the stored information is video information.

32. The method of claim 30 wherein the stored information is audio information.

33. A computer-implemented method of displaying information, the method comprising:

displaying a representation of stored information;

receiving information indicative of one or more portions of the stored information that have been output; and

highlighting one or more portions of the representation of the stored information corresponding to the one or more portions of the stored information that have not been output.

34. An apparatus for displaying information, the apparatus comprising:

a processor; and

a display;

wherein the processor is configured to;

display, on the display, a first representation of first stored information, the first stored information comprising information of a first type and information of a second type, the first representation comprising a representation of information of the first type included in the first stored information and a representation of the information of the second type included in the first stored information; and

highlight one or more portions of the first representation displayed on the display, the highlighted one or more portions of the first representation corresponding to portions of the first representation that include a first criterion.

35. The apparatus of claim 34 wherein the processor is further configured to:

display a second representation of second stored information on the display, the second stored information comprising information of a first type and information of a second type, the second representation comprising a representation of information of the first type included in the second stored information and a representation of information of the second type included in the second stored information; and

highlight one or more portions of the second representation, the highlighted one or more portions of the first representation corresponding to portions of the second representation that include the first criterion.

36. The apparatus of claim 35 wherein:

the first criterion comprises a word;

the processor is configured to highlight one or more portions of the first representation that contain the word; and

the processor is configured to highlight one or more portions of the second representation that contain the word.

37. The apparatus of claim 35 wherein:

the first criterion comprises a topic of interest;

the processor is configured to highlight one or more portions of the first representation that are relevant to the topic of interest; and

the processor is configured to highlight one or more portions of the second representation that are relevant to the topic of interest.

38. The apparatus of claim 35 wherein:

the information of the first type included in the first stored information is audio information;

the information of the second type included in the first stored information is video information;

the information of the first type included in the second stored information is audio information; and

the information of the second type included in the second stored information is video information.

39. The apparatus of claim 38 wherein:

the representation of information of the first type included in the first representation comprises text information obtained from transcribing the audio information included in the first stored information;

the representation of information of the second type included in the first representation comprises one or more video keyframes extracted from the video information included in the first stored information;

the representation of information of the first type included in the second representation comprises text information obtained from transcribing the audio information included in the second stored information; and

the representation of information of the second type included in the second representation comprises one or more video keyframes extracted from the video information included in the second stored information.

40. The apparatus of claim 39 wherein:

the processor is configured to highlight one or more lines from the text information included in the first representation that include the first criterion; and

the processor is configured to highlight one or more lines from the text information included in the second representation that include the first criterion.

41. The apparatus of claim 39 wherein:

the processor is configured to highlight one or more video keyframes from the video keyframes included in the first representation that include the first criterion; and

the processor is configured to highlight one or more video keyframes from the video keyframes included in the second representation that include the first criterion.

42. The apparatus of claim 38 wherein the processor is configured to cause playback of the video information included in the first stored information and the video information included in the second stored information.

43. The apparatus of claim 35 wherein the processor is configured to:

receive a signal indicating selection of a first portion from the one or more highlighted portions of the first representation or the second representation; and

display, on the display, a representation of the contents of the first selected portion.

44. The apparatus of claim 43 wherein the representation of the contents of the first selected portion is a web page generated based upon the contents of the first selected portion.

45. The apparatus of claim 35 wherein the processor is configured to display, on the display, a representation for each portion in the one or more highlighted portions of the first representation and the second representation, wherein the representation for a portion is generated based upon the contents of the portion.

46. The apparatus of claim 35 wherein the processor is configured to cause playback the first type of information included in the first stored information and the first type of information stored in the second stored information.

47. An apparatus for displaying multimedia information, the apparatus comprising:

a processor; and

a display; and

wherein the processor is configured to;

display, on the display, a first thumbnail comprising a representation of information of a first type included in a first recorded information;

display, on the display, a second thumbnail comprising a representation of information of a second type included in the first recorded information;

display, on the display, a third thumbnail comprising a representation of information of a first type included in a second recorded information; and

display, on the display, a fourth thumbnail comprising a representation of information of a second type included in the second recorded information.

48. The apparatus of claim 47 wherein the processor is configured to:

receive information identifying a set of one or more words; and

highlight one or more portions of the first thumbnail and the third thumbnail that comprise at least one word from the set of words.

49. The apparatus of claim 48 wherein the processor is configured to highlight one or more portions of the second thumbnail and the fourth thumbnail that comprise at least one word from the set of words.

50. The apparatus of claim 49 wherein the processor is configured to:

receive information indicating selection of a first portion from the one or more highlighted portions of the second or the fourth thumbnail, the first portion corresponding to a portion of information of the second type included in the first recorded information or the second recorded information; and

cause the information of the second type corresponding to the first portion to be output.

51. The apparatus of claim 47 wherein the processor is configured to:

receive information identifying a set of one or more topics of interest; and

highlight one or more portions of the first thumbnail and the third thumbnail that comprise content relevant to at least one topics of interest from the set of topics of interest.

52. The apparatus of claim 51 wherein the processor is configured to highlight one or more portions of the second thumbnail and the fourth thumbnail that comprise content relevant to at least one topics of interest from the set of topics of interest.

53. The apparatus of claim 47 wherein:

the information of the first type included in the first recorded information is audio information;

the information of the second type included in the first recorded information is video information;

the information of the first type included in the second recorded information is audio information;

the information of the second type included in the second recorded information is video information;

the first thumbnail comprises text information obtained from the audio information included in the first recorded information;

the second thumbnail comprises one or more video keyframes extracted from the video information included in the first recorded information;

the third thumbnail comprises text information obtained from the audio information included in the second recorded information; and

the fourth thumbnail comprises one or more video keyframes extracted from the video information included in the second recorded information.

54. The apparatus of claim 47 wherein:

the information of the first type included in the first recorded information is closed-caption text information;

the information of the second type included in the first recorded information is video information;

the information of the first type included in the second recorded information is closed-caption text information;

the information of the second type included in the second recorded information is video information;

the first thumbnail comprises text information obtained from the closed-caption text information included in the first recorded information;

the second thumbnail comprises one or more video keyframes extracted from the video information included in the first recorded information;

the third thumbnail comprises text information obtained from the closed-caption text information included in the second recorded information; and

the fourth thumbnail comprises one or more video keyframes extracted from the video information included in the second recorded information.

55. An apparatus for displaying information included in a first recorded information and a second recorded information, the first recorded information comprising audio information and video information, the second recorded information comprising audio and video information, the apparatus comprising:

a display; and

a processor;

wherein the processor is configured to;

display, on the display, a first representation of information included in the first recorded information, the first representation comprising a first thumbnail and a second thumbnail, the first thumbnail comprising text information obtained from the audio information included in the first recorded information, the second thumbnail comprising one or more keyframes extracted from the video information included in the first recorded information; and

display, on the display, a second representation of information included in the second recorded information, the second representation comprising a third thumbnail and a fourth thumbnail, the third thumbnail comprising text information obtained from the audio information included in the second recorded information, the fourth thumbnail comprising one or more keyframes extracted from the video information included in the second recorded information.

56. The apparatus of claim 55 wherein the processor is configured to:

receive information identifying a user criterion; and

highlight one or more portions of the first representation and the second representation that include the user criterion, wherein a highlighted portion of the first representation covers a section of the first thumbnail and the second thumbnail and a highlighted portion of the second representation covers a section of the third thumbnail and the fourth thumbnail.

57. The apparatus of claim 56 wherein the processor is configured to:

identify locations in the first representation and the second representation that include the user criterion; and

determine the one or more portions of the first representation and the second representation to be highlighted based upon the identified locations.

58. The apparatus of claim 56 wherein the user criterion is a set of one or more words or phrases.

59. The apparatus of claim 56 wherein the user criterion is a set of one or more topics of interest.

60. The apparatus of claim 56 wherein the processor is configured to display, on the display, a document for each highlighted portion of the first representation and the second representation, wherein the document for a portion comprises text information from the section of the first or the third thumbnail covered by the portion and one or more keyframes from the section of the second or the fourth thumbnail covered by the portion.

61. The apparatus of claim 56 the processor is configured to:

receive information indicating selection of a first highlighted portion from the one or more highlighted portions of the first representation; and

display, on the display, a document for first highlighted portion, wherein the document for the first highlighted portion comprises text information from the section of the first thumbnail covered by the first highlighted portion and one or more keyframes from the section of the second thumbnail covered by the first highlighted portion.

62. The apparatus of claim 56 wherein the processor is configured to:

receive information indicating selection of a first highlighted portion from the one or more highlighted portions of the first representation; and

cause video information from the first recorded information corresponding to the first highlighted portion to be output.

63. An apparatus for displaying information, the apparatus comprising:

a processor; and

a memory coupled to the processor, the memory configured to store a program for controlling the processor;

wherein the processor under control of the program is configured to;

cause a representation of stored information to be displayed;

receive information indicative of one or more portions of the stored information that have been output; and

cause one or more portions of the representation of the stored information corresponding to the one or more portions of the stored information that have been output to be highlighted.

64. An apparatus for displaying information, the apparatus comprising:

a processor; and

a memory coupled to the processor, the memory configured to store a program for controlling the processor;

wherein the processor under control of the program is configured to;

cause a representation of stored information to be displayed;

receive information indicative of one or more portions of the stored information that have been output; and

cause one or more portions of the representation of the stored information corresponding to the one or more portions of the stored information that have not been output to be highlighted.

65. A program stored on a computer-readable storage medium for displaying information, the program comprising:

code for displaying a first representation of first stored information, the first stored information comprising information of a first type and information of a second type, the first representation comprising a representation of information of the first type included in the first stored information and a representation of the information of the second type included in the first stored information; and

code for highlighting one or more portions of the first representation, the highlighted one or more portions of the first representation corresponding to portions of the first representation that include a first criterion.

66. The program of claim 65 further comprising:

code for displaying a second representation of second stored information, the second stored information comprising information of a first type and information of a second type, the second representation comprising a representation of information of the first type included in the second stored information and a representation of information of the second type included in the second stored information; and

code for highlighting one or more portions of the second representation, the highlighted one or more portions of the first representation corresponding to portions of the second representation that include the first criterion.

67. The program of claim 66 wherein:

the first criterion comprises a word;

the code for highlighting one or more portions of the first representation comprises code for highlighting one or more portions of the first representation that contain the word; and

the code for highlighting one or more portions of the second representation comprises code for highlighting one or more portions of the second representation that contain the word.

68. The program of claim 66 wherein:

the first criterion comprises a topic of interest;

the code for highlighting one or more portions of the first representation comprises code for highlighting one or more portions of the first representation that are relevant to the topic of interest; and

the code for highlighting one or more portions of the second representation comprises code for highlighting one or more portions of the second representation that are relevant to the topic of interest.

69. A program stored on a computer-readable storage medium for displaying multimedia information, the program comprising:

code for displaying a first thumbnail comprising a representation of information of a first type included in a first recorded information;

code for displaying a second thumbnail comprising a representation of information of a second type included in the first recorded information;

code for displaying a third thumbnail comprising a representation of information of a first type included in a second recorded information; and

code for displaying a fourth thumbnail comprising a representation of information of a second type included in the second recorded information.

70. The program of claim 69 further comprising:

code for receiving information identifying a set of one or more words; and

code for highlighting one or more portions of the first thumbnail and the third thumbnail that comprise at least one word from the set of words.

71. The program of claim 70 further comprising:

code for highlighting one or more portions of the second thumbnail and the fourth thumbnail that comprise at least one word from the set of words.

72. The program of claim 71 further comprising:

code for receiving information indicating selection of a first portion from the one or more highlighted portions of the second or the fourth thumbnail, the first portion corresponding to a portion of information of the second type included in the first recorded information or the second recorded information; and

code for outputting the information of the second type corresponding to the first portion.

73. A program stored on a computer-readable storage medium for displaying information included in a first recorded information and a second recorded information, the first recorded information comprising audio information and video information, the second recorded information comprising audio and video information, the program comprising:

code for displaying a first representation of information included in the first recorded information, the first representation comprising a first thumbnail and a second thumbnail, the first thumbnail comprising text information obtained from the audio information included in the first recorded information, the second thumbnail comprising one or more keyframes extracted from the video information included in the first recorded information; and

code for displaying a second representation of information included in the second recorded information, the second representation comprising a third thumbnail and a fourth thumbnail, the third thumbnail comprising text information obtained from the audio information included in the second recorded information, the fourth thumbnail comprising one or more keyframes extracted from the video information included in the second recorded information.

74. The program of claim 73 further comprising:

code for receiving information identifying a user criterion; and

code for highlighting one or more portions of the first representation and the second representation that include the user criterion, wherein a highlighted portion of the first representation covers a section of the first thumbnail and the second thumbnail and a highlighted portion of the second representation covers a section of the third thumbnail and the fourth thumbnail.

75. The program of claim 74 wherein the code for highlighting the one or more portions of the first representation and the second representation comprises:

code for identifying locations in the first representation and the second representation that include the user criterion; and

code for determining the one or more portions of the first representation and the second representation to be highlighted based upon the identified locations.

76. The program of claim 74 further comprising:

code for receiving information indicating selection of a first highlighted portion from the one or more highlighted portions of the first representation; and

code for outputting video information from the first recorded information corresponding to the first highlighted portion.

77. A program stored on a computer-readable storage medium for displaying information, the program comprising:

code for displaying a representation of stored information;

code for receiving information indicative of one or more portions of the stored information that have been output; and

code for highlighting one or more portions of the representation of the stored information corresponding to the one or more portions of the stored information that have been output.

78. A program stored on a computer-readable storage medium for displaying information, the program comprising:

code for displaying a representation of stored information;

code for receiving information indicative of one or more portions of the stored information that have been output; and

code for highlighting one or more portions of the representation of the stored information corresponding to the one or more portions of the stored information that have not been output.

79. An apparatus for displaying information, the apparatus comprising:

means for displaying a first representation of first stored information, the first stored information comprising information of a first type and information of a second type, the first representation comprising a representation of information of the first type included in the first stored information and a representation of the information of the second type included in the first stored information;

means for highlighting one or more portions of the first representation, the highlighted one or more portions of the first representation corresponding to portions of the first representation that include a first criterion.

means for displaying a second representation of second stored information, the second stored information comprising information of a first type and information of a second type, the second representation comprising a representation of information of the first type included in the second stored information and a representation of information of the second type included in the second stored information; and

means for highlighting one or more portions of the second representation, the highlighted one or more portions of the first representation corresponding to portions of the second representation that include the first criterion.

80. An apparatus for displaying multimedia information, the apparatus comprising:

means for displaying a first thumbnail comprising a representation of information of a first type included in a first recorded information;

means for displaying a second thumbnail comprising a representation of information of a second type included in the first recorded information;

means for displaying a third thumbnail comprising a representation of information of a first type included in a second recorded information; and

means for displaying a fourth thumbnail comprising a representation of information of a second type included in the second recorded information.

81. An apparatus for displaying information included in a first recorded information and a second recorded information, the first recorded information comprising audio information and video information, the second recorded information comprising audio and video information, the apparatus comprising:

means for displaying a first representation of information included in the first recorded information, the first representation comprising a first thumbnail and a second thumbnail, the first thumbnail comprising text information obtained from the audio information included in the first recorded information, the second thumbnail comprising one or more keyframes extracted from the video information included in the first recorded information; and

means for displaying a second representation of information included in the second recorded information, the second representation comprising a third thumbnail and a fourth thumbnail, the third thumbnail comprising text information obtained from the audio information included in the second recorded information, the fourth thumbnail comprising one or more keyframes extracted from the video information included in the second recorded information.

82. An apparatus for displaying information, the apparatus comprising:

means for displaying a representation of stored information;

means for receiving information indicative of one or more portions of the stored information that have been output; and

means for highlighting one or more portions of the representation of the stored information corresponding to the one or more portions of the stored information that have been output.