Method, system and article of manufacture for linking a video to a scanned document

• US 7,712,017 B2
• Filed: 02/24/2006
• Issued: 05/04/2010
• Est. Priority Date: 05/31/2000
• Status: Expired due to Fees

• Current Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: Girgensohn, Andreas, Foote, Jonathan T., Boreczky, John S., Chiu, Patrick
• Primary Examiner(s): Hutton; Doug
• Assistant Examiner(s): Tran; Quoc A
• Application Number:
  US11/361,391
• Publication Number:
  US 20060143567A1
• Time in Patent Office: 1,530 Days
• Field of Search: 715200-204, 715/209, 715/805, 715230-237, 715/721, 715/730
• US Class Current: 715/200
• CPC Class Codes: H04N 1/00318 with a multi-media apparatus
• CPC Class Codes: H04N 1/0044 for image preview or review, e.g. to help the user position a sheet
• CPC Class Codes: H04N 1/32101 Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 2201/3226 of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
• CPC Class Codes: H04N 2201/3267 of motion picture signals, e.g. video clip
• CPC Class Codes: H04N 2201/3274 Storage or retrieval of prestored additional information

Abstract

Video recordings of meetings and scanned paper documents are natural digital documents that come out of a meeting. These can be placed on the Internet for easy access, with links generated between them by matching scanned documents to a segment of the video referencing the scanned document. Furthermore, annotations made on the paper documents during the meeting can be extracted and used as indexes to the video. An orthonormal transform, such as a Digital Cosine Transform (DCT) is used to compare scanned documents to video frames.

Claims

1. An information system, comprising:

a first processing device coupled to a persistent storage device, said persistent storage device adapted to store linking software, a video file and a scanned document;

the video file comprising a plurality of segments, each segment including at least one video frame;

wherein the scanned document is a digital representation of a physical document, wherein the scanned document is referenced by the video file;

wherein the linking software performs a transform on the scanned document and a plurality of video frames;

the linking software performs an orthonormal transform on the scanned document and the plurality of video frames;

wherein the scanned document comprises an image and a bounding box around said image, wherein the bounding box is reduced until all margins having a uniform color are removed before the transform is performed on the scanned document and the plurality of video frames;

wherein least significant information is removed from at least the transformed document before the transformed document is compared to the transformed video frames, wherein a Discrete Cosine Transform (DCT) is used to compare the scanned document to the plurality of video frames; and

wherein the linking software creates a link between the scanned document and a segment of the video file in which the scanned document is referenced of a video file responsive to a comparison of the transformed scanned document and the transformed video frames.

2. The information system of claim 1, further comprising:

a scanner, coupled to the first processing device, for creating the scanned document from the physical document.

3. The information system of claim 1, further comprising:

a video camera, coupled to the first processing device, for creating the video file.

4. The information system of claim 1, further comprising:

a second processing device, coupled to the first processing device, for viewing the referenced segment of the video.

5. The information system of claim 1, wherein the linking software is adapted to extract handwritten annotations from the scanned document.

6. A computer readable medium, comprising:

(a) a first software program for obtaining a scanned document, wherein the scanned document is a digital representation of a physical document;

(b) a second software program for obtaining a video file, the video file comprising a plurality of segments, each segment including at least one video frame, wherein the scanned document is referenced by the video file; and

(c) a third software program for linking the scanned document to a segment of the video file in which the scanned document is referenced;

(d) wherein the linking software performs a transform on the scanned document and a plurality of video frames; and

the linking software performs an orthonormal transform on the scanned document and the plurality of video frames;

wherein the scanned document comprises an image and a bounding box around said image, wherein the bounding box is reduced until all margins having a uniform color are removed before the transform is performed on the scanned document and the plurality of video frames;

wherein least significant information is removed from at least the transformed document before the transformed document is compared to the transformed video frames, wherein a Discrete Cosine Transform (DCT) is used to compare the scanned document to the plurality of video frames; and

wherein the linking software creates a link between the scanned document and a segment of the video file in which the scanned document is referenced of a video file responsive to a comparison of the transformed scanned document and the transformed video frames.

7. The computer readable medium of claim 6, wherein the third software program includes a scaling software program.

8. The computer readable medium of claim 6, wherein a fourth software program extracts handwritten annotations from the scanned document.

9. The computer readable medium of claim 6, wherein the third software program compares color information from the scanned document to color information from the video file.