System for registering component image tiles in a camera-based scanner device transcribing scene images
First Claim
1. A method for providing a complete undistorted computational representation of an image on a surface, the method comprising the steps of:
- a) projecting a light pattern upon the image, the light pattern including a multiplicity of lightmarks, each lightmark having a neighborhood;
b) capturing a multiplicity of image tiles using at least one camera subsystem, each of the image tiles including a portion of the image and at least a one of the lightmarks, each image tile having an overlapping area for each adjacent image tile overlapped by the image tile;
c) converting the image tiles into a computational format;
d) for each image tile, identifying the overlapping areas;
e) correcting distortions of the image tiles, including perspective distortion, to produce a single undisturbed, computational representation of the image by the substeps of;
1) identifying the lightmarks within the overlapping areas;
2) performing local correlations of image patches in the neighborhoods of the lightmarks within the overlapping areas to identify locations in each image tile of the lightmarks within the overlapping areas;
3) projecting the lightmark locations into surface coordinates;
4) for each pair of overlapping, adjacent image tiles, comparing corresponding pairs of lightmarks within the overlapping area common to the pair of overlapping, adjacent image tiles;
5) for each pair of lightmarks within the overlapping area common to a pair of overlapping, adjacent image tiles, choosing target coordinates at a location intermediate to the surface coordinates of each of the pair of lightmarks within the overlapping area common to the pair of overlapping, adjacent image tiles;
6) computing perspective transforms for each image tile using the target coordinates for the lightmarks within the overlapping areas;
7) repeating substeps
1)-6) until convergence upon locations of lightmarks within the overlapping area of each image tile that represent a cumulative error in surface coordinates of the lightmarks within the overlapping areas of each image tile that is less than a threshold amount.
3 Assignments
0 Petitions
Accused Products
Abstract
A device for registering component image tiles in a scanning system for transcribing, into electronic form, markings on a two-dimensional surface such as a whiteboard. A registration light pattern is projected onto the surface to be imaged. The pattern projected can be chosen to best suite the specific properties of the camera and imaging environment. The pattern markings are processed using perspective transformations to determine the overlap properties of the image tiles and distortion of each tile image, and the resulting data is used to combine the tiles to produce an undistorted composite image of the whiteboard.
180 Citations
5 Claims
-
1. A method for providing a complete undistorted computational representation of an image on a surface, the method comprising the steps of:
-
a) projecting a light pattern upon the image, the light pattern including a multiplicity of lightmarks, each lightmark having a neighborhood; b) capturing a multiplicity of image tiles using at least one camera subsystem, each of the image tiles including a portion of the image and at least a one of the lightmarks, each image tile having an overlapping area for each adjacent image tile overlapped by the image tile; c) converting the image tiles into a computational format; d) for each image tile, identifying the overlapping areas; e) correcting distortions of the image tiles, including perspective distortion, to produce a single undisturbed, computational representation of the image by the substeps of; 1) identifying the lightmarks within the overlapping areas; 2) performing local correlations of image patches in the neighborhoods of the lightmarks within the overlapping areas to identify locations in each image tile of the lightmarks within the overlapping areas; 3) projecting the lightmark locations into surface coordinates; 4) for each pair of overlapping, adjacent image tiles, comparing corresponding pairs of lightmarks within the overlapping area common to the pair of overlapping, adjacent image tiles; 5) for each pair of lightmarks within the overlapping area common to a pair of overlapping, adjacent image tiles, choosing target coordinates at a location intermediate to the surface coordinates of each of the pair of lightmarks within the overlapping area common to the pair of overlapping, adjacent image tiles; 6) computing perspective transforms for each image tile using the target coordinates for the lightmarks within the overlapping areas; 7) repeating substeps
1)-6) until convergence upon locations of lightmarks within the overlapping area of each image tile that represent a cumulative error in surface coordinates of the lightmarks within the overlapping areas of each image tile that is less than a threshold amount. - View Dependent Claims (2, 3, 4)
-
-
5. An automatic system for capturing in computational form an undisturbed image content of an image comprising:
-
a) a surface upon which the image is provided; b) at least one camera subsystem for capturing the image in a matrix of image tiles, each of the image tiles including at least a portion of the image, each of the image tiles having an overlapping area that overlaps an adjacent image tile; c) a projection subsystem for projecting a registration pattern upon the image, the registration pattern including a multiplicity of lightmarks, each of the overlapping areas including at least one of the lightmarks; d) a processor combining the image tiles to create in computational form the undisturbed image content of the image corrected for perspective distortion by the step of; 1) for each pair of adjacent image tiles, identifying a first overlapping area of a first image tile of the pair of adjacent image tiles corresponding to a second overlapping area of a second image tile of the pair of adjacent image tiles; 2) identifying a first lightmark in the first overlapping area corresponding to a second lightmark in the second overlapping area; 3) finding a projection of the first liqhtmark at a first surface coordinate location in the first image tile; 4) finding a projection of the second liqhtmark at a second surface coordinate location in the second image tile; 5) correcting perspective distortion between the first surface coordinate location and the second surface coordinate location; and generating corrected surface coordinates for the first lightmark and the second lightmark; e) memory coupled to the processor, the memory storing instructions for the processor and storing in computation form the undisturbed image content of the image.
-
Specification