Device for transcribing images on a board using a camera based board scanner
First Claim
Patent Images
1. An automatic system for capturing in computational form the image content of an image on a surface, comprising;
- a) a surface upon which is provided an image;
b) at least one camera subsystem for capturing said image in a matrix of image tiles, each of said tiles comprising at least a portion of the image, said tiles each overlapping adjacent tiles, at least one of said tiles including perspective distortion of the portion of the image;
c) a processor for receiving and processing said image tiles to combine said tiles to determine a complete computational image corrected for perspective distortion representing said image, the processor determining an overlapping area in each tile overlapping adjacent tiles, finding a mark in each of said adjacent tiles representing a mark in the overlapping area, and combining said tiles based on said mark to produce a single computational image corrected for perspective distortion representing said image, the processor combining said tiles to produce a single computational image corrected for perspective distortion by;
1) for each two adjacent tiles, determining a region of overlap between a first tile and a second tile;
2) determining at least a mark in said region;
3) finding a projection of said at least one mark at a first surface coordinate location in said first tile image;
4) finding a projection of said mark at a second surface coordinate location in said second tile;
5) correcting perspective distortion between said first and second surface coordinate locations; and
6) writing corrected surface coordinates into a representation of said computational image stored in said memory; and
d) memory accessible by said processor for storing data including instructions for said processor and said computational image corrected for perspective distortion.
4 Assignments
0 Petitions
Accused Products
Abstract
A device for transcribing, into electronic form, markings drawn on a whiteboard or blackboard. An electronic camera such as an ordinary video camera is mounted on a computer-controlled pan/tilt head in the ceiling or to the side of the board. Images are captured by directing the camera successively at small regions of the board, then processing these snapshots electronically, leading to a complete, undistorted, high-resolution image of the entire board.
173 Citations
10 Claims
-
1. An automatic system for capturing in computational form the image content of an image on a surface, comprising;
-
a) a surface upon which is provided an image; b) at least one camera subsystem for capturing said image in a matrix of image tiles, each of said tiles comprising at least a portion of the image, said tiles each overlapping adjacent tiles, at least one of said tiles including perspective distortion of the portion of the image; c) a processor for receiving and processing said image tiles to combine said tiles to determine a complete computational image corrected for perspective distortion representing said image, the processor determining an overlapping area in each tile overlapping adjacent tiles, finding a mark in each of said adjacent tiles representing a mark in the overlapping area, and combining said tiles based on said mark to produce a single computational image corrected for perspective distortion representing said image, the processor combining said tiles to produce a single computational image corrected for perspective distortion by; 1) for each two adjacent tiles, determining a region of overlap between a first tile and a second tile; 2) determining at least a mark in said region; 3) finding a projection of said at least one mark at a first surface coordinate location in said first tile image; 4) finding a projection of said mark at a second surface coordinate location in said second tile; 5) correcting perspective distortion between said first and second surface coordinate locations; and 6) writing corrected surface coordinates into a representation of said computational image stored in said memory; and d) memory accessible by said processor for storing data including instructions for said processor and said computational image corrected for perspective distortion. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method for providing a complete undistorted computational representation of an image on a surface, the method comprising the steps of:
-
a) capturing image tiles using at least one camera subsystem, each tile containing a portion of the image, said tiles each overlapping adjacent tiles; b) converting said image tiles into electronically computational format; c) determining said overlapping area in each tile; d) correcting for distortions including perspective distortion in said overlapping area to produce a single computational image by the substeps of; 1) determining landmarks falling in said area of overlap; 2) performing local correlations of image patches in neighborhoods of landmarks to determine corresponding landmark locations in each image tile; 3) projecting said corresponding landmark locations into surface coordinates; 4) comparing pairs of landmarks from overlapping tiles; 5) choosing target coordinates at intermediate locations; and 6) computing new perspective transforms of each tile for said intermediate locations; wherein said substeps are repeated until convergence upon landmark positions between overlapping tiles represented by cumulative errors in landmark projection being less that a threshold amount.
-
-
10. A method for providing a complete undistorted computational representation of an image on a surface, comprising:
-
a) capturing image tiles using at least one camera subsystem, each tile containing a portion of the surface image, said tiles each overlapping adjacent tiles; b) converting said image tiles into electronically computational format; c) correcting for lightness variation across each tile; d) determining said overlapping area in each tile; e) correcting for distortions including perspective distortions in said overlapping area to produce a single intermediate grey-level image by the substeps of; 1) determining landmarks falling in said region of overlap; 2) performing local correlations of image patches in neighborhoods of landmarks to determine corresponding landmark locations; 3) projecting said corresponding landmark locations into surface coordinates; 4) comparing pairs of landmarks from overlapping tiles; 5) choosing target coordinates at intermediate locations; and 6) computing new perspective transforms of each tile for said intermediate locations; wherein said substeps are repeated until convergence upon landmark positions between overlapping tiles represented by cumulative errors in landmark projection being less that a threshold amount; and f) thresholding said grey-level representation of said image to produce an computational image without perspective distortion representing said image.
-
Specification