Techniques for storing multimedia information with source documents

• US 7,266,568 B1
• Filed: 09/12/2003
• Issued: 09/04/2007
• Est. Priority Date: 04/11/2003
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Erol, Berna, Lee, Dar-Shyang, Hull, Jonathan
• Primary Examiner(s): Cottingham; John
• Assistant Examiner(s): LEWIS, CHERYL RENEA
• Application Number:
  US10/660,985
• Time in Patent Office: 1,453 Days
• Field of Search: 707/104.1, 707/100, 715/500, 715/730, 715/513, 715/509, 715/503, 715/500.1, 715/501.1, 715/526, 715/531, 715/732, 396/9, 358/296, 725/87
• US Class Current: 1/1
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A method of storing information for recorded information and a source document is provided. The method comprises: determining a first piece of information included in the recorded information; determining at least a first source document from one or more source documents that comprises information that matches the first piece of information; and storing information identifying the recorded information, information representative of the first piece of information, and information identifying the first source document such that the information identifying the first source document can be determined given the information identifying the recorded information and the information representative of the first piece of information.

Claims

1. A computer implemented method for storing information for recorded information and a plurality of source documents, the method comprising:

determining a first portion of the recorded information, the recorded information including at least one of audio, video, and image information recorded during a presentation of a plurality of information sources;

determining a first electronic source document from the plurality of electronic source documents that includes information corresponding to at least one of the information sources presented during the recording of the first portion of the recorded information, the information in the first electronic source document including at least one of text, image, audio, and video information;

determining a second electronic source document from the plurality of electronic source documents that includes information corresponding to at least one of the information sources presented during the recording of the first portion of the recorded information, the information in the second electronic source document including at least one of text, image, audio, and video information; and

storing in a table information identifying the recorded information, information representative of the first and second portions of the recorded information, information identifying the first source document and a first type of the first source document, and information identifying the second source document and a second type of the second source document, such that the first and second electronic source documents are accessible using the information representative of the respective first and second portions of the recorded information, and the first and second portions of the recorded information are accessible using the information identifying the respective first and second source documents,

wherein storing the first and second types enables the respective first and second source documents to be displayed in applications appropriate for those types, the first source type being different from the second source type.

2. The method of claim 1, further comprising:

determining a first portion of the first source document that comprises the information that corresponds to at least one of the information sources presented during the recording of the first portion of the recorded information;

storing information indicative of the first portion of the first source document such that the information indicative of the first portion of the first source document can be determined given the information identifying the recorded information and the information representative of the first portion of the recorded information.

3. The method of claim 2, wherein the information indicative of the first portion of the first source document comprises at least one of a page number, slide number and an identifier.

4. The method of claim 2, wherein the first portion of the first source document can be accessed using an application accessing the first portion of the recorded information.

5. The method of claim 1, wherein storing the information identifying the presentation document comprises determining an identifier for the presentation document and an identifier for at least one slide in the presentation document.

6. The method of claim 5, wherein determining the identifier for the at least one slide in the presentation document comprises:

matching the first portion of the recorded information to the corresponding information in the one or more source documents; and

determining the information identifying the presentation document using the matched information.

7. The method of claim 5, wherein determining the identifier for the portion in the presentation document comprises:

determining temporal information for the first portion of the recorded information;

determining the portion of the presentation document using the temporal information; and

determining the identifier for the at least one slide in the presentation document.

8. The method of claim 1, wherein determining the presentation document comprises:

matching the first portion of the recorded information to the corresponding information in the one more source documents; and

determining the information identifying the presentation document.

9. The method of claim 1, wherein the first portion of the recorded information comprises at least one of video information and audio information.

10. A computer implemented method for storing information for recorded information and a plurality of source documents, the method comprising:

determining a first portion of the recorded information comprising an image of a slide, the recorded information including at least one of image and video information recorded during a presentation of a plurality of information sources;

determining a second portion of the recorded information corresponding to text from an electronic text document;

determining presentation document from the plurality of electronic source documents that includes slide information corresponding to at least one of the information sources presented during the recording of the first portion of the recorded information;

determining a text document from the plurality of electronic source documents that includes text information corresponding to at least one of the information sources presented during the recording of the first portion of the recorded information; and

storing information identifying the recorded information, information representative of the first portion of the recorded information, information identifying the presentation document and a slide type of the presentation document, and information identifying the text document and a text type of the text document, such that the presentation and text documents can be accessed using the information representative of the respective first and second portions of the recorded information and the respective slide and text types.

11. The method of claim 10, wherein the information in the presentation document that corresponds to the image of the slide comprises a matching image of the slide.

12. A method for storing information for recorded information and a plurality of related source documents of at least two document types, the method comprising:

selecting first source information contained in a first electronic source document of a first document type, the first source information in the first electronic source document including at least one of text, image, audio, and video information;

selecting second source information contained in a second electronic source document of a second document type, the second source information in the second electronic source document including at least one of text, image, audio, and video information;

determining first recorded information that comprises recorded information including a first portion that corresponds to the selected first source information, and a second portion that corresponds to the selected second source information, the recorded information including at least one of audio, video, and image information recorded during a presentation of a plurality of information sources; and

storing information identifying the source document, information representative of the selected first and second source information of the respective first and second document types, information identifying the first recorded information, and information identifying the first and second portions of the first recorded information such that the information identifying the first and second portions of the first recorded information are accessible using the information identifying the respective first and second electronic source documents, and information identifying the selected first and second source information is accessible using the information identifying the first and second recorded portions of the first recorded information.

13. The method of claim 12, wherein the selected first and second source information comprises at least one of a page number, slide number, and an identifier.

14. The method of claim 12, wherein the first recorded information is accessible using an application operable to access the information identifying the selected first and second source information.

15. The method of claim 12, further comprising:

receiving an input for the information representative of the selected first and second source information;

determining the information identifying the first recorded information; and

accessing the first and second recorded portions of the first recorded information.

16. The method of claim 12, wherein one of the selected first and second source information comprises an image of a slide.

17. The method of claim 16, wherein the first recorded information corresponding to the selected source information comprises a corresponding image of the slide.

18. The method of claim 12, wherein storing the information identifying the source document and information representative of the selected source information comprises determining a first identifier for the source document and a second identifier for the selected source information.

19. The method of claim 12, wherein determining first and second portions of the first recorded information comprises:

determining the information identifying the first and second recorded portions using the corresponding information.

20. The method of claim 12, wherein determining first and second recorded portions of the first recorded information comprises:

determining temporal information for the selected first and second source information;

determining the first and second recorded portions of the first recorded information using the temporal information; and

determining the identifier for the first and second recorded portions of the first recorded information.

21. The method of claim 12, wherein determining first and second recorded portions of the first recorded information comprises:

matching the selected first and second source information to information in the first recorded information; and

determining the information identifying the first recorded information.

22. The method of claim 12, wherein the first recorded information comprises at least one of video information and audio information.

23. A data structure embedded in a computer readable medium for accessing related information in a plurality of source documents and recorded information, the data structure comprising:

source document data identifying a first electronic source document and a second electronic source document, information in the first and second electronic source documents including at least one of text, image, audio, and video information;

first and second source identifiers each identifying a source portion of the information in the respective first and second electronic source documents;

first and second document type identifiers each identifying a type of document of the respective first and second electronic source documents;

recorded information data identifying recorded information including at least one of audio, video, and image information recorded during a presentation of a plurality of information sources; and

data identifying first and second recorded portions of the recorded information that correspond to the respective first and second source portions of the electronic source document for the respective first and second source identifiers,

wherein the electronic source document is accessible using the data identifying the first and second recorded portions of the recorded information, and

wherein the first and second recorded portions of the recorded information is accessible using a respective one of the first and second source identifiers.

24. The data structure of claim 23, wherein at least one of the first and second source identifiers comprises a reference used to retrieve the respective source portion of the respective source document.

25. The data structure of claim 24, wherein the reference comprises a pagination number.

26. The data structure of claim 23, wherein the data identifying the respective recorded portion of the recorded information are associated with temporal information, wherein the temporal information is used to access the respective source portion of the respective source document.

27. The data structure of claim 23, wherein the data identifying the respective recorded portion of the recorded information comprises a reference to a storage location of the respective recorded information.

28. The data structure of claim 27, further comprising a reference type that identifies a type of information for the reference.

29. The data structure of claim 23, wherein the data structure is an XML data structure.

30. An XML data structure embedded in a computer readable medium for linking related information in a plurality of source documents and recorded information, the XML data structure comprising:

source document data identifying a first electronic source document and a second electronic source document, information in the first and second electronic source documents including at least one of text, image, audio, and video information;

first and second source identifiers each identifying a source portion of the information in the respective first and second electronic source documents;

first and second document type identifiers each identifying a type of document of the respective first and second electronic source documents;

recorded information data identifying recorded information including at least one of audio, video, and image information recorded during a presentation of a plurality of information sources; and

data identifying first and second recorded portions of the recorded information that correspond to the respective first and second source portions for the respective first and second source identifiers,

wherein the electronic source document is accessible using the data identifying the first and second recorded portions, and

wherein the first and second recorded portions is accessible using a respective one of the first and second source identifiers.

31. A data processing system for accessing corresponding information in a recorded information and a plurality of source documents, the data processing system comprising:

a processor; and

a memory coupled to the processor, the memory configured to store program code for execution by the processor, the program code including

code for determining a first recorded portion of the recorded information, the recorded information including at least one of audio, video, and image information recorded during a presentation of a plurality of information sources;

code for determining a first electronic source document from the plurality of electronic source documents that includes information corresponding to at least one of the information sources presented during the recording of the first portion of the recorded information, the information in the first electronic source document including at least one of text, image, audio, and video information;

code for determining a second electronic source document from the plurality of electronic source documents that includes information corresponding to at least one of the information sources presented during the recording of a second portion of the recorded information, the information in the second electronic source document including at least one of text, image, audio, and video information; and

code for storing in a table information identifying the recorded information, information representative of the first and second portions of the recorded information, information identifying the first source document and a first type of the first source document, and information identifying the second source document and a second type of the second source document, such that the first and second electronic source documents are accessible using the information representative of the respective first and second portions of the recorded information, and the first and second portions of the recorded information are accessible using the information identifying the respective first and second source documents,

wherein the code for storing the first and second types enables the respective first and second source documents to be displayed in applications appropriate for those types, the first source type being different from the second source type.

32. The data processing system of claim 31, wherein the memory is configured to store program code further including:

code for determining a first source portion of the first source document that comprises the information corresponding to the first recorded portion of the recorded information; and

code for storing information indicative of the first source portion of the first source document such that the information indicative of the first source portion of the first source document can be determined given the information identifying the recorded information and the information representative of the first recorded portion of the recorded information.

33. The data processing system of claim 32, wherein the information indicative of the first source portion of the first source document comprises at least one of a page number, slide number and an identifier.

34. The data processing system of claim 32, wherein the first source portion of the first source document is accessible using an application operable to access the first recorded portion of the recorded information.

35. The data processing system of claim 31, wherein the memory is configured to store program code further including:

code for receiving an input for the first recorded portion of the recorded information;

code for determining the information identifying the first source document; and

code for accessing a source portion of the first source document associated with the information identifying the first source document.

36. The data processing system of claim 31, wherein the first recorded portion of the recorded information comprises an image of a slide.

37. The data processing system of claim 36, wherein the information in the first source document that corresponds to the first recorded portion of the recorded information comprises a matching image of the slide.

38. The data processing system of claim 31, wherein the code for storing the information identifying the first source document comprises code for determining an identifier for the first source document and an identifier for a first source portion in the first source document.

39. The data processing system of claim 38, wherein the code for determining the identifier for the first source portion in the first source document comprises:

code for matching the first piece of information to information in the one more plurality of source documents; and

code for determining the information identifying the first source document using the corresponding information.

40. The data processing system of claim 38, wherein the code for determining the identifier for the first source portion in the first source document comprises:

code for determining temporal information for the first piece of information;

code for determining the first source portion of the first source document using the temporal information; and

code for determining the identifier for the first source portion of the first source document.

41. The data processing system of claim 31, wherein the code for determining the first source document comprises:

code for matching the first recorded portion of the recorded information to information in the plurality of source documents; and

code for determining the information identifying the first source document.

42. The data processing system of claim 31, wherein the first recorded portion of the recorded information comprises at least one of video information and audio information.

43. A data processing system for accessing corresponding information in a recorded information and a plurality of source documents, the data processing system comprising:

a processor; and

a memory coupled to the processor, the memory configured to store a program code for execution by the processor, the program code including;

code for determining a first recorded portion of the recorded information corresponding to an image of a slide, the recorded information including at least one of audio, video, and image information recorded during a presentation of a plurality of information sources;

code for determining a second recorded portion of the recorded information corresponding to text from an electronic text document;

code for determining a presentation document from the plurality of electronic source documents that includes slide information corresponding to at least one of the information sources presented during the recording of the first portion of the recorded information;

code for determining a text document from the plurality of electronic source documents that includes text information corresponding to at least one of the information sources presented during the recording of the first portion of the recorded information; and

code for storing information identifying the recorded information, information representative of the first recorded portion of the recorded information, information identifying the presentation document and a slide type of the presentation document, and information identifying the text document and a text type of the text document, such that the presentation and text documents is accessible using the information representative of the respective first and second portions of the recorded information and the respective slide and text types.

44. The data processing system of claim 43, wherein the recorded information can be accessed using an application accessing the information identifying the first electronic source document.

45. The data processing system of claim 43, wherein the memory is configured to store program code further including:

code for receiving an input for the information representative of the first electronic source document;

code for determining the information identifying the recorded information; and

code for accessing the first recorded portion of the recorded information.

46. The data processing system of claim 43, wherein the first recorded information comprises at least one of video information and audio information.

47. A computer program product stored on a computer-readable medium for linking corresponding information for recorded information and a plurality of source documents, the computer program product executable on a processor comprising:

program code for determining information identifying a first source portion of information in a first electronic source document of a first document type, the information in the first electronic source document including at least one of text, image, audio, and video information;

program code for determining information identifying a second source portion of information in a second electronic source document of a second document type, the information in the second electronic source document including at least one of text, image, audio, and video information;

program code for determining a first portion of a first recorded information including recorded information that corresponds to the first portion of the first electronic source document, and for determining a second portion of the first recorded information including recorded information that corresponds to the second portion of the second electronic source document, the first recorded information including at least one of audio, video, and image information recorded during a presentation of a plurality of information sources; and

program code for storing information identifying the first and second electronic source documents, information identifying the first and second document types, information representative of the first and second source portions, information identifying the first recorded information, and information identifying the first and second recorded portions such that the information identifying the first and second recorded portions is accessible given the information representative of the respective first and second source portions, and the information representative of the first and second source portions is accessible given the information identifying the respective first and second recorded portions.

48. The computer program product of claim 47, further comprising:

program code for determining a first source portion of the first source document that comprises the information that corresponds to the first recorded portion;

program code for storing information indicative of the first source portion of the first source document such that the information indicative of the first source portion is accessible using the information identifying the recorded information and the information representative of the first recorded portion.

49. The computer program product of claim 48, wherein the first source portion is accessible using an application configured to access the first recorded portion.

50. The computer program product of claim 47, further comprising:

program code for receiving an input for the first recorded portion;

program code for determining the information identifying the first source document; and

program code for accessing a portion of the first source document associated with the information identifying the first source document.

51. The computer program product of claim 47, wherein the code for storing the information identifying the first source document comprises code for determining an identifier for the first source document and an identifier for a portion in the first source document.

52. The computer program product of claim 51, wherein the code for determining the identifier for the portion in the first source document comprises:

program code for matching the first recorded portion to information in the first source document; and

program code for determining the information identifying the first source document using the corresponding information.

53. The computer program product of claim 51, wherein the code for determining the identifier for the portion in the first source document comprises:

program code for determining temporal information for the first recorded portion;

program code for determining the first source portion using the temporal information; and

program code for determining the identifier for the first source portion.

54. The computer program product of claim 47, wherein the code for determining at least the first source document comprises:

program code for matching the first recorded portion to information in the first source document; and

program code for determining the information identifying the first source document.