Techniques for retrieving multimedia information using a paper-based interface

• US 7,149,957 B2
• Filed: 11/19/2001
• Issued: 12/12/2006
• Est. Priority Date: 11/19/2001
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Hull, Jonathan J.
• Primary Examiner(s): Hong, Stephen
• Assistant Examiner(s): STORK, KYLE R
• Application Number:
  US10/001,894
• Publication Number:
  US 20050229092A1
• Time in Patent Office: 1,849 Days
• Field of Search: 715/500, 715/513, 715/517, 715/523, 715/530
• US Class Current: 715/200
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes

Abstract

The present invention provides techniques for generating a printable representation of multimedia information that can be printed on a paper medium to provide a paper-based interface for the multimedia information. According to the teachings of the present invention, the paper document generated by printing the printable representation on a paper medium also provides an interface for accessing or retrieving multimedia information in electronic form. The paper document may thus be used as an indexing and retrieval tool for retrieving multimedia information.

Claims

1. A computer-implemented method of using a paper document to retrieve multimedia information stored in a multimedia document in electronic form, wherein one or more user-selectable identifiers are printed on the paper document, the method comprising:

receiving a first signal indicating selection of a first user-selectable identifier from the one or more user-selectable identifiers printed on the paper document;

responsive to receiving the first signal, identifying a portion of multimedia information stored by the multimedia document corresponding to the first user-selectable identifier; and

outputting the portion of the multimedia information corresponding to the first user-selectable identifier using an output device;

wherein the multimedia information comprises one or more of audio, image, or video information;

wherein identifying the portion of multimedia information stored by the multimedia document corresponding to the first user-selectable identifier comprises determining a first time and a second time corresponding to the first user-selectable identifier and

including a portion of the multimedia information stored by the multimedia document occurring between the first time and the second time in the portion of multimedia information corresponding to the first user-selectable identifier.

2. The method of claim 1 wherein the first signal comprises information identifying the output device.

3. The method of claim 1 wherein:

the first signal comprises information indicating a playback mode for outputting the portion of the multimedia information corresponding to the first user-selectable identifier; and

outputting the portion of the multimedia information using the output device comprises outputting the information according to the playback mode.

4. The method of claim 1 wherein the one or more user-selectable identifiers include one or more barcodes printed on the paper document.

5. A computer-implemented method of using a paper document to retrieve multimedia information stored in a multimedia document in electronic form, wherein one or more user-selectable identifiers are printed on the paper document, the method comprising:

receiving a first signal indicating selection of a first user-selectable identifier from the one or more user-selectable identifiers printed on the paper document;

responsive to receiving the first signal, identifying a portion of multimedia information stored by the multimedia document corresponding to the first user-selectable identifier; and

outputting the portion of the multimedia information corresponding to the first user-selectable identifier using an output device;

wherein the multimedia information comprises one or more of audio, image, or video information;

wherein one or more control codes are printed on the paper document, the method further comprising;

receiving a second signal indicating selection of a first control code from the one or more control codes printed on the paper document; and

responsive to receiving the second signal, controlling the output of the portion of the multimedia information corresponding to the first user-selectable identifier based upon the control code.

6. A method of using a paper document to access multimedia information stored in a multimedia document in electronic form, wherein one or more user-selectable identifiers are printed on the paper document, the method comprising:

selecting a first user-selectable identifier from the one or more user-selectable identifiers printed on the paper document;

requesting multimedia information corresponding to the first user-selectable identifier;

outputting a portion of the multimedia information stored by the multimedia document corresponding to the first user-selectable identifier using an output device; and

wherein the multimedia information comprises one or more of audio, image, or video information;

wherein;

requesting multimedia information corresponding to the first user-selectable identifier comprises determining two or more time points in the multimedia document;

the first user-selectable identifier is associated with a first time and a second time; and

outputting the portion of the multimedia information corresponding to the first user-selectable identifier using the output device comprises outputting a portion of the multimedia information stored by the multimedia document occurring between the first time and the second time.

7. The method of claim 6 wherein:

the one or more user-selectable identifiers correspond to one or more barcodes printed on the paper document; and

selecting the first user-selectable identifier comprises scanning a first barcode from the one or more barcodes printed on the paper document using a selection device.

8. The method of claim 6 wherein one or more control codes are printed on the paper document, the method further comprising:

selecting a first control code from the one or more control codes printed on the paper document; and

modifying the output of the portion of the multimedia information corresponding to the first user-selectable identifier based upon the control code.

9. A computer-implemented method of using a paper document to retrieve multimedia information stored electronically in a multimedia document, wherein a first plurality of user-selectable identifiers are printed on the paper document, the method comprising:

receiving a signal indicating selection of a second plurality of user-selectable identifiers from the first plurality of user-selectable identifiers printed on the paper document, wherein the second plurality of user-selectable identifiers is a subset of the first plurality of user-selectable identifiers;

responsive to receiving the first signal, identifying portions of multimedia information stored by the multimedia document corresponding to the second plurality of user-selectable identifiers;

outputting the portions of the multimedia information corresponding to the second plurality of user-selectable identifiers using an output device; and

wherein the multimedia information comprises one or more of audio, image, or video information.

10. The method of claim 9 wherein identifying portions of multimedia information stored by the multimedia document corresponding to the second plurality of user-selectable identifiers comprises:

for each user-selectable identifier in the second plurality of user-selectable identifiers;

determining a first time and a second time corresponding to the user-selectable identifier; and

including multimedia information stored by the multimedia document occurring between the first time and the second time corresponding to the user-selectable identifier in the portions of multimedia information corresponding to the second plurality of user-selectable identifiers.

11. A computer-implemented method of retrieving multimedia information using a first paper document and a second paper document, wherein one or more user-selectable identifiers are printed on the first paper document and one or more user-selectable identifiers are printed on the second paper document, the method comprising:

receiving a signal indicating selection of a first user-selectable identifier from the one or more user-selectable identifiers printed on the first paper document, and indicating selection of a second user-selectable identifier from the one or more user-selectable identifiers printed on the second paper document;

identifying a portion of multimedia information corresponding to the first user-selectable identifier from multimedia information stored by a first multimedia document;

identifying a portion of multimedia information corresponding to the second user-selectable identifier from multimedia information stored by a second multimedia document;

outputting the portion of multimedia information stored by the first multimedia document corresponding to the first user-selectable identifier and the portion of multimedia information stored by the second multimedia document corresponding to the second user-selectable identifier using an output device; and

wherein the multimedia information comprises one or more of audio, images, or video information; and

wherein;

identifying the portion of multimedia information corresponding to the first user-selectable identifier from multimedia information stored by the first multimedia document compnses;

determining a first time and a second time associated with the first user-selectable identifier and

including a portion of multimedia information stored by the first multimedia document occurring between the first time and the second time associated with the first user-selectable identifier in the portion of multimedia information corresponding to the first user-selectable identifier; and

identifying the portion of multimedia information corresponding to the second user-selectable identifier from multimedia information stored by the second multimedia document comprises;

determining a first time and a second time associated with the second user-selectable identifier and

including a portion of multimedia information stored by the second multimedia document occurring between the first time and the second time associated with the second user-selectable identifier in the portion of multimedia information corresponding to the second user-selectable identifier.

12. A system for using a paper document to retrieve multimedia information stored in a multimedia document in electronic form, wherein one or more user-selectable identifiers are printed on the paper document, the system comprising:

an output device; and

a data processor;

wherein the data processor is configured to;

receive a first signal indicating selection of a first user-selectable identifier from the one or more user-selectable identifiers printed on the paper document;

identify a portion of multimedia information stored by the multimedia document corresponding to the first user-selectable identifier; and

communicate the portion of the multimedia information corresponding to the first user-selectable identifier to the output device;

wherein the output device is configured to output the portion of the multimedia information corresponding to the first user-selectable identifier received from the data processor; and

wherein the multimedia information comprises one or more of audio, image, and video information;

wherein;

the data processor is configured to identify the portion of multimedia information stored by the multimedia document corresponding to the first user-selectable identifier by determining a first time and a second time corresponding to the first user-selectable identifier and a portion of the multimedia information stored by the multimedia document occurring between the first time and the second time.

13. The system of claim 12 wherein the first signal comprises information identifying the output device.

14. The system of claim 12 wherein:

the first signal comprises information indicating a playback mode for outputting the portion of the multimedia information corresponding to the first user-selectable identifier; and

the output device is configured to output the portion of the multimedia information according to the playback mode.

15. The system of claim 12 wherein the one or more user-selectable identifiers includes barcodes printed on the paper document.

16. A system for using a paper document to retrieve multimedia information stored in a multimedia document in electronic form, wherein one or more user-selectable identifiers are printed on the paper document, the system comprising:

an output device; and

a data processor;

wherein the data processor is configured to;

receive a first signal indicating selection of a first user-selectable identifier from the one or more user-selectable identifiers printed on the paper document;

identify a portion of multimedia information stored by the multimedia document corresponding to the first user-selectable identifier; and

communicate the portion of the multimedia information corresponding to the first user-selectable identifier to the output device;

wherein the output device is configured to output the portion of the multimedia information corresponding to the first user-selectable identifier received from the data processor; and

wherein the multimedia information comprises one or more of audio, image, and video information;

wherein one or more control codes are printed on the paper document, and the data processor is configured to;

receive a second signal indicating selection of a first control from the one or more control codes printed on the paper document; and

control the output of the portion of the multimedia information corresponding to the first user-selectable identifire based upon the control code.

17. A system for using a paper document to access multimedia information stored in a multimedia document in electronic form, wherein one or more user-selectable identifiers are printed on the paper document, the system comprising:

a processor; and

a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising;

a code module for selecting a first user-selectable identifier from the one or more user-selectable identifiers printed on the paper document;

a code module for requesting multimedia information corresponding to the first user-selectable identifier; and

a code module for outputting a portion of the multimedia information stored by the multimedia document corresponding to the first user-selectable identifier using an output device;

wherein the multimedia information comprises one or more of audio, image, or video information;

wherein;

the first user-selectable identifier is associated with a first time and a second time; and

the code module for outputting the portion of the multimedia information corresponding to the first user-selectable identifier using the output device comprises a code module for outputting a portion of the multimedia information stored by the multimedia document occurring between the first time and the second time.

18. The system of claim 17 wherein:

the one or more user-selectable identifiers correspond to one or more barcodes printed on the paper document; and

the code module for selecting the first user-selectable identifier comprises a code module for scanning a first barcode from the one or more barcodes printed on the paper document using a selection device.

19. The system of claim 17 wherein one or more control codes are printed on the paper document, the plurality of code modules further comprising:

a code module for selecting a first control code from the one or more control codes printed on the paper document; and

a code module for modifying the output of the portion of the multimedia information corresponding to the first user-selectable identifier based upon the control code.

20. A system for using a paper document to retrieve multimedia information stored electronically in a multimedia document, wherein a first plurality of user-selectable identifiers are printed on the paper document, the system comprising:

an output device; and

a data processor;

wherein the data processor is configured to;

receive a signal indicating selection of a second plurality of user-selectable identifiers from the first plurality of user-selectable identifiers printed on the paper document, wherein the second plurality of user-selectable identifiers is a subset of the first plurality of user-selectable identifiers;

identify portions of multimedia information stored by the multimedia document corresponding to the second plurality of user-selectable identifiers; and

communicate the portions of the multimedia information of the multimedia document corresponding to the second plurality of user-selectable identifiers to the output device;

wherein the output device is configured to output the portions of the multimedia information corresponding to the second plurality of user-selectable identifiers received from the data processor; and

wherein the multimedia information comprises one or more of audio, image, or video information.

21. The system of claim 20 wherein in order to identify portions of multimedia information stored by the multimedia document corresponding to the second plurality of user-selectable identifiers, the data processor is configured to:

for each user-selectable indentifier in the second plurality of user-selectable identifiers;

determine a first time and a second time corresponding to the user-selectable identifier; and

include multimedia information stored by the multimedia document occurring between the first time and the second time corresponding to the user-selectable identifier in the portions of multimedia information corresponding to the second plurality of user-selectable identifiers.

22. A system for retrieving multimedia information using a first paper document and a second paper document, wherein one or more user-selectable identifiers are printed on the first paper document and one or more user-selectable identifiers are printed on the second paper document, the system comprising:

an output device; and

a data procesor;

wherein the data processor is configured to;

receive a signal indicating selection of a first user-selectable identifier from the one or more user-selectable identifiers printed on the first paper document, and indicating selection of a second user-selectable identifier from the one or more user-selectable identifiers printed on the second paper document;

identify a protion of multimedia information corresponding to the first user-selectable identifier from multimedia information stored by a first multimedia document;

identify a portion of multimedia information ocrresponding to the second user-selectable identifier from multimedia information stored by a second multimedia document; and

communicate the portion of multimedia information stored by the first multimedia document corresponding to the first user-selectable identifier and the portion of multimedia information stored by the second multimedia document corresponding to the second user-selectable identifier to the output device;

wherein the output device is configured to output the portion of multimedia information corresponding to the first user-selectable identifier and the portion of multimedia information corresponding to the second user-selectable identifier received from the data processor; and

wherein the multimedia information comprises one or more of audio, image, or video information;

wherein the data processor identifies the portion of multimedia information corresponding to the first user-selectable identifier from multimedia information stored by the first multimedia document by;

determining a first time and a second time associated with the first user-selectable identifier; and

including a portion of multimedia information stored by the first multimedia document occurring between the first time and the second time associated with the first user-selectable identifier in the portion of multimedia information corresponding to the first user-selectable identifier; and

the data processor identifies the portion of multimedia information corresponding to the second user-selectable identifier from multimedia information stored by the second multimedia document by;

determining a first time and a second time associated with the second user-selectable identifier; and

including a portion of multimedia information stored by the second multimedia document occurring between the first time and the second time associated with the second user-selectable identifier in the portion of multimedia information corresponding to the second user-selectable identifier.

23. A computer program product stored on a computer-readable storage medium for using a paper document to retrieve multimedia information stored in a multimedia document in electronic form, wherein one or more user-selectable identifiers are printed on the paper document, the computer program product comprising:

code for receiving a first signal indicating selection of a first user-selectable identifier from the one or more user-selectable identifiers printed on the paper document;

code for identifying a portion of multimedia information stored by the multimedia document corresponding to the first user-selectable identifier;

code for outputting the portion of the multimedia information using an output device; and

wherein the multimedia information comprises one or more of audio, image, or video information;

wherein the code for identifying the portion of multimedia information stored by the multimedia document corresponding to the first user-selectable identifier comprises;

code for determining a first time and a second time corresponding to the first user-selectable identifier; and

code for including a portion of the multimedia information stored by the multimedia document occurring between the first time and the second time in the portion of multimedia information corresponding to the first user-selectable identifier.

24. A computer program product stored on a computer-readable storage medium for using a paper document to retrieve multimedia information stored in a multimedia document in electronic form, wherein one or more user-selectable identifiers are printed on the paper document, the computer program product comprising:

code for receiving a first signal indicating selection of a first user-selectable identifier from the one or more user-selectable identifiers printed on the paper document;

code for identifying a portion of multimedia information stored by the multimedia document corresponding to the first user-selectable identifier; and

code for outputting the portion of the multimedia information using an output device;

wherein the multimedia information comprises one or more of audio, image, or video information;

wherein one or more control codes are printed on the paper document, the computer program product further comprising;

code for receiving a second signal indicating selection of a first control code from the one or more control codes printed on the paper document; and

code for controlling the output of the portion of the multimedia information corresponding to the first user-selectable identifier based upon the control code.

25. A computer program product stored on a computer-readable storage medium for using a paper document to access multimedia information stored in a multimedia document in electronic form, wherein one or more user-selectable identifiers are printed on the paper document, the computer program product comprising:

code for selecting a first user-selectable identifier from the one or more user-selectable identifiers printed on the paper document;

code for requesting multimedia information corresponding to the first user-selectable identifier; and

code for outputting a portion of the multimedia information stored by the multimedia document corresponding to the first user-selectable identifier using an output device;

wherein the multimedia information comprises one or more of audio, image, or video information;

wherein;

the first user-selectable identifier is associated with a first time and a second time; and

the code for outputting the portion of the multimedia information corresponding to the first user-selectable identifier using the output device comprises code for outputting a portion of the multimedia information stored by the multimedia document occurring between the first time and the second time.

26. The computer program product of claim 25 wherein:

the one or more user-selectable identifiers correspond to one or more barcodes printed on the paper document; and

the code for selecting the first user-selectable identifier comprises code for scanning a first barcode from the one or more barcodes printed on the paper document using a selection device.

27. The computer program product of claim 25 wherein one or more control codes are printed on the paper document, the computer program product further comprising:

code for selecting a first control code from the one or more control codes printed on the paper document; and

code for modifying the output of the portion of the multimedia information corresponding to the first user-selectable identifier based upon the control code.

28. A computer program product stored on a computer-readable storage medium for using a paper document to retrieve multimedia information stored electronically in a multimedia document, wherein a first plurality of user-selectable identifiers are printed on the paper document, the computer program product comprising:

code for receiving a signal indicating selection of a second plurality of user-selectable identifiers from the first plurality of user-selectable identifiers printed on the paper document, wherein the second plurality of user-selectable identifiers is a subset of the first plurality of user-selectable identifiers;

code for responsive to receiving the first signal, identifying portions of multimedia information stored by the multimedia document corresponding to the second plurality of user-selectable identifiers; and

code for outputting the portions of the multimedia information corresponding to the second plurality of user-selectable identifiers using an output device;

wherein the multimedia information comprises one or more of audio, image, or video information.

29. The computer program product of claim 28 wherein the code for identifying portions of multimedia information stored by the multimedia document corresponding to the second plurality of user-selectable identifiers comprises:

for each user-selectable identifier in the second plurality of user-selectable identifiers;

code for determining a first time and a second time corresponding to the user-selectable identifier; and

code for including multimedia information stored by the multimedia document occurring between the first time and the second time corresponding to the user-selectable identifier in the portions of multimedia information corresponding to the second plurality of user-selectable identifiers.

30. A computer program product stored on a computer-readable storage medium for retrieving multimedia information using a first paper document and a second paper document, wherein one or more user-selectable identifiers are printed on the first paper document and one or more user-selectable identifiers are printed on the second paper document, the computer program product comprising:

code for receiving a signal indicating selection of a first user-selectable identifier from the one or more user-selectable identifiers printed on the first paper document, and indicating selection of a second user-selectable identifier from the one or more user-selectable identifiers printed on the second paper document;

code for identifying a portion of multimedia information corresponding to the first user-selectable identifier from multimedia information stored by a first multimedia document;

code for identifying a portion of multimedia information corresponding to the second user-selectable identifier from multimedia information stored by a second multimedia document; and

code for outputting the portion of multimedia information stored by the first multimedia document corresponding to the first user-selectable identifier and the portion of multimedia information stored by the second multimedia document corresponding to the second user-selectable identifier using an output device;

wherein the multimedia information comprises one or more of audio, image, or video information;

wherein;

the code for identifying the portion of multimedia information corresponding to the first user-selectable identifier from multimedia information stored by the first multimedia document comprises;

code for determining a first time and a second time associated with the first user-selectable identifier; and

code for including a portion of multimedia information stored by the first multimedia document occurring between the first time and the second time associated with the first user-selectable identifier in the portion of multimedia information corresponding to the first user-selectable identifier; and

the code for identifying the portion of multimedia information corresponding to the second user-selectable identifier from multimedia information stored by the second multimedia document comprises;

code for determining a first time and a second time associated with the second user-selectable identifier; and

code for including a portion of multimedia information stored by the second multimedia document occurring between the first time and the second time associated with the second user-selectable identifier in the portion of multimedia information corresponding to the second user-selectable identifier.