Compensating for distortion in digital images
First Claim
1. A method of compensating for distortion in a digital image, comprising:
- projecting an unstructured pattern onto a document using a projector;
capturing a pair of stereoscopic images of the unstructured pattern projected onto the document using one or more stereoscopic cameras;
generating a plurality of lines in each of the stereoscopic images, each line comprising a plurality of non-overlapping regions of the stereoscopic images, the plurality of non-overlapping regions having a first height equal to a second height of each line, and rectifying the pair of stereoscopic images relative to each other such that each line in a first stereoscopic image of the pair of stereoscopic images corresponds to a line in a second stereoscopic image of the pair of stereoscopic images;
cross-correlating portions of the pair of stereoscopic images to identify corresponding portions in the pair of stereoscopic images, the cross-correlating being achieved based on image data from the stereoscopic images without specification of the unstructured pattern;
capturing a digital image of the document using an imaging camera;
constructing a three-dimensional model of a surface of the document; and
compensating for distortion in the digital image by rectifying the digital image based on spatial data provided by the three-dimensional model.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods using an unstructured pattern for three-dimensional model construction, such as may be used for processing images of documents are disclosed. The method generally includes projecting an unstructured infrared pattern onto a target object, capturing a pair of stereoscopic images of the pattern projected onto the target object, such as with infrared cameras, performing signal processing on the pair of stereoscopic images to cross-correlate portions of the stereoscopic images in order to identify corresponding portions in the stereoscopic images, and constructing a three-dimensional model of the target object. The three-dimensional model can be utilized to rectify, e.g., de-warp, an image of the target object, e.g., a page or both facing pages of a bound document.
12 Citations
26 Claims
-
1. A method of compensating for distortion in a digital image, comprising:
-
projecting an unstructured pattern onto a document using a projector; capturing a pair of stereoscopic images of the unstructured pattern projected onto the document using one or more stereoscopic cameras; generating a plurality of lines in each of the stereoscopic images, each line comprising a plurality of non-overlapping regions of the stereoscopic images, the plurality of non-overlapping regions having a first height equal to a second height of each line, and rectifying the pair of stereoscopic images relative to each other such that each line in a first stereoscopic image of the pair of stereoscopic images corresponds to a line in a second stereoscopic image of the pair of stereoscopic images; cross-correlating portions of the pair of stereoscopic images to identify corresponding portions in the pair of stereoscopic images, the cross-correlating being achieved based on image data from the stereoscopic images without specification of the unstructured pattern; capturing a digital image of the document using an imaging camera; constructing a three-dimensional model of a surface of the document; and compensating for distortion in the digital image by rectifying the digital image based on spatial data provided by the three-dimensional model. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A non-transitory computer-readable storage medium embedded with a computer program product, the computer program product including instructions that, when executed by a processor, cause the processor to perform actions comprising:
-
projecting an unstructured pattern onto a document using a projector; capturing a pair of stereoscopic images of the unstructured pattern projected onto the document using one or more stereoscopic cameras; generating a plurality of lines in each of the stereoscopic images, each line comprising a plurality of non-overlapping regions of the stereoscopic images, the plurality of non-overlapping regions having a first height equal to a second height of each line and rectifying the pair of stereoscopic images relative to each other such that each line in a first stereoscopic image of the pair of stereoscopic images corresponds to a line in a second stereoscopic image of the pair of stereoscopic images; cross-correlating portions of the pair of stereoscopic images to identify corresponding portions in the pair of stereoscopic images, the cross-correlating being achieved based on image data from the stereoscopic images without specification of the unstructured pattern; capturing a digital image of the document using an imaging camera; constructing a three-dimensional model of a surface of the document; and compensating for distortion in the digital image by rectifying the digital image based on spatial data provided by the three-dimensional model. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18)
-
-
19. A system, comprising:
-
a projector configured to project an unstructured pattern onto a document; one or more stereoscopic cameras configured to capture a pair of stereoscopic images of the unstructured pattern projected onto the document; one or more processors that generate a plurality of lines in each of the stereoscopic images, each line comprising a plurality of non-overlapping regions of the stereoscopic images, the plurality of non-overlapping regions having a first height equal to a second height of each line and rectify the pair of stereoscopic images relative to each other such that each line in a first stereoscopic image of the pair of stereoscopic images corresponds to a line in a second stereoscopic image of the pair of stereoscopic images, and that cross-correlate portions of the pair of stereoscopic images to identify corresponding portions in the pair of stereoscopic images, the cross-correlating being achieved based on image data from the stereoscopic images without specification of the unstructured pattern; and an imaging camera that captures a digital image of the document, wherein the one or more processors construct a three-dimensional model of a surface of the document, and compensate for distortion in the digital image by rectifying the digital image based on spatial data provided by the three-dimensional model. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26)
-
Specification