Systems and Methods for Efficiently Capturing High-Quality Scans of Multi-Page Documents with Hand-Held Devices

• US 20140268247A1
• Filed: 03/15/2013
• Published: 09/18/2014
• Est. Priority Date: 08/15/2012
• Status: Active Grant

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Carter, Scott, Adcock, John, Hilbert, David M., Chen, Francine, Sakaida, Hiroshi
• Granted Patent: US 9,007,633 B2
• Time in Patent Office: Days
• US Class Current: 358/406
• CPC Class Codes: H04N 1/00005 relating to image data
• CPC Class Codes: H04N 1/00031 Testing, i.e. determining the result of a trial H04N1/00029 takes precedence; using test signals for transmission mode changing H04N2201/33371
• CPC Class Codes: H04N 1/00068 Calculating or estimating
• CPC Class Codes: H04N 1/00076 locally
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00403 Voice input means, e.g. voice commands
• CPC Class Codes: H04N 1/0044 for image preview or review, e.g. to help the user position a sheet
• CPC Class Codes: H04N 1/0045 vertically
• CPC Class Codes: H04N 1/00798 Circuits or arrangements for the control thereof, e.g. using a programmed control device or according to a measured quantity
• CPC Class Codes: H04N 1/19594 using a television camera or a still video camera
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/0452 Indicating the scanned area, e.g. by projecting light marks onto the medium

Abstract

Capturing a sequence of images of a multi-page printed document is performed by a handheld device, such as a Smartphone. The device has one or more processors, memory, and a digital image sensor. The device monitors preview images of a first printed page of the multi-page printed document, where the preview images are generated by the digital image sensor. Without user indication of when to capture an image, the device captures a still image of the first printed page when a first quality metric of the preview images exceeds a first quality threshold. The device repeats the monitoring and capturing of additional pages until receiving indication from the user that capturing images is complete. In response to receiving indication from the user that capturing images is complete, the device concatenates the captured still images into a single digital document and stores the single digital document.

Claims

1. A method of capturing a sequence of images of a multi-page printed document, performed by a handheld device with one or more processors, memory, and a digital image sensor, the method comprising:

monitoring preview images of a first printed page of the multi-page printed document, the preview images generated by the digital image sensor;

without user indication of when to capture an image, capturing a still image of the first printed page when a first quality metric of the preview images exceeds a first quality threshold;

repeating the monitoring and capturing of additional pages of the multi-page printed document until receiving indication from the user that capturing images is complete; and

in response to receiving indication from the user that capturing images is complete;

concatenating the captured still images into a single digital document; and

storing the single digital document.

2. The method of claim 1, wherein capturing an image of a respective printed page further comprises notifying the user to turn the page after capturing the still image.

3. The method of claim 1, wherein capturing an image of a respective printed page further comprises after capturing the still image:

evaluating at least a portion of the captured still image at full resolution according to a second quality metric;

when the second quality metric is below a second quality threshold, notifying the user that capture of the respective page will be repeated, and repeating the monitoring of preview images of the respective printed page.

4. The method of claim 1, wherein capturing an image of a respective printed page further comprises after capturing the still image:

evaluating at least a portion of the captured still image at full resolution according to a second quality metric;

when the second quality metric is below a second quality threshold, repeating the monitoring of preview images of the respective printed page; and

when the second quality metric is at or above the second quality threshold, notifying the user the still image has been captured.

5. The method of claim 1, further comprising:

evaluating each of the respective captured still images, and assigning a respective second quality score to each respective captured still image;

sorting the captured still images according to their assigned second quality scores; and

prompting the user to review the captured still images in the sorted order, and repeating the monitoring and capturing operations for images selected by the user, thereby replacing selected captured still images with higher quality captured images.

6. The method of claim 5, wherein the evaluating, sorting, and prompting are in response to receiving the indication from the user that capturing images is complete.

7. The method of claim 1, further comprising:

evaluating each of the respective captured still images, and assigning a respective second quality score to each respective captured still image;

identifying a set of captured still images whose corresponding second quality scores are below a second quality threshold; and

repeating the monitoring and capturing operations for each of the captured still images in the identified set, thereby replacing the captured still images in the identified set with higher quality captured images.

8. The method of claim 7, wherein the evaluating, identifying, and repeating the monitoring and capturing operations for each of the captured still images in the identified set are in response to receiving the indication from the user that capturing images is complete.

9. The method of claim 1, wherein the indication from the user comprises a button press on a user interface of the handheld device.

10. The method of claim 1, wherein the indication from the user comprises a voice command from the user.

11. The method of claim 1, further comprising:

determining that two or more captured still images correspond to a single printed page of the multi-page printed document;

selecting one of the captured still images corresponding to the single printed page; and

discarding all of the captured still images corresponding to the single printed page except the selected one.

12. The method of claim 11, wherein the determining, selecting, and discarding are in response to receiving the indication from the user that capturing images is complete.

13. The method of claim 1, further comprising:

receiving indication from the user that the multi-page printed document is a two-sided document; and

capturing still images of the multi-page printed document in an order not corresponding to the order of the pages in the multi-page printed document;

wherein concatenating the captured still images into a single digital document further comprises ordering the captured still images corresponding to the order of the pages in the multi-page printed document.

14. The method of claim 1, wherein concatenating the captured still images into a single digital document further comprises ordering the captured still images based on the order in which the still images were captured.

15. The method of claim 1, wherein monitoring preview images further comprises:

identifying four document edge lines in a first preview image;

determining whether there are any turning points for the first preview image inside a rectangle formed by the four document edge lines; and

when there are one or more turning points inside the rectangle, notifying the user of an image protrusion.

16. A system for capturing a sequence of images of a multi-page printed document, comprising:

one or more processors;

memory; and

one or more programs stored in the memory, the one or more programs comprising instructions for;

monitoring preview images of a first printed page of the multi-page printed document, the preview images generated by the digital image sensor;

capturing a still image of the first printed page when a first quality metric of the preview images exceeds a first quality threshold, executed without user indication of when to capture the still image;

repeating the monitoring and capturing of additional pages of the multi-page printed document until receiving indication from the user that capturing images is complete; and

responding to receiving indication from the user that capturing images is complete, including instructions for;

concatenating the captured still images into a single digital document; and

storing the single digital document.

17. A computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions for:

monitoring preview images of a first printed page of the multi-page printed document, the preview images generated by the digital image sensor;

capturing a still image of the first printed page when a first quality metric of the preview images exceeds a first quality threshold, executed without user indication of when to capture the still image;

repeating the monitoring and capturing of additional pages of the multi-page printed document until receiving indication from the user that capturing images is complete; and

responding to receiving indication from the user that capturing images is complete, including instructions for;

concatenating the captured still images into a single digital document; and

storing the single digital document.