Single image digital photography with structured light for document reconstruction

• US 20040218069A1
• Filed: 03/30/2001
• Published: 11/04/2004
• Est. Priority Date: 03/30/2001
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Silverstein, D. Amnon
• Application Number:
  US09/823,366
• Publication Number:
  US 20040218069A1
• Time in Patent Office: Days
• US Class Current: 348/239
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 2201/0436 Scanning a picture-bearing surface lying face up on a support H04N2201/0434 takes precedence; using cylindrical picture bearing surfaces H04N1/06; with manual scanning H04N1/107
• CPC Class Codes: H04N 2201/0452 Indicating the scanned area, e.g. by projecting light marks onto the medium

Abstract

A system and method of obtaining a reconstructed digital image of an image that is projected, displayed, or printed on a surface by capturing a single digital image of the surface is described. According to the system and method, at least three illumination marks are projected onto the surface. The illumination marks have a particular detectable characteristic. An image captures a single image of the surface including the illumination marks to obtain captured image data. The location and the pixel values corresponding to the illumination marks are detected dependent on the particular characteristic of the illumination mark pixels in the captured image data. The locations of the illumination marks are then used to correct for distortion of the image and surface in the captured image data to generate an undistorted digital image of the image on the surface. The illumination mark pixel values are replaced within undistorted digital image with estimated pixel values that are determined using neighboring non-illumination mark pixel values.

Claims

1. A method of reconstructing a digital image of an image on a surface using a digital image capture device arbitrarily positioned with respect to the surface, the method comprising the steps of:

projecting at least three illumination marks on the surface, said illumination marks having a particular characteristic;

capturing a single image of the surface to obtain captured image data;

detecting pixel values corresponding to the illumination marks and their corresponding location on the surface in the captured image data dependent on the particular characteristic;

using the location of the illumination marks in the captured image data to correct for distortion of the image and the surface in the captured image data to generate undistorted image data; and

substituting estimated pixel values for the detected illumination mark pixel values in the undistorted image data, the estimated pixel values being determined using neighboring non-illumination mark pixel values.

2. The method as described in claim 1 wherein the particular characteristic is the intensity level.

3. The method as described in claim 1 wherein the digital image capture device is a digital camera.

4. The method as described in claim 1 wherein the illumination marks are produced from an illumination source of a single color component having a particular intensity.

5. The method as described in claim 4 wherein the single color illumination source is a laser.

6. The method as described in claim 1 wherein the illumination marks are detected by detecting color component and intensity of the captured image data.

7. The method as described in claim 1 wherein the illumination marks are detected by detecting wavelength of the captured image data.

8. The method as described in claim 1 wherein projecting the at least two illumination marks comprises projecting a grid of illumination marks.

9. The method as described in claim 1 wherein projecting the at least two illumination marks comprises projecting a single illumination source through a diffraction grating.

10. A system of reconstructing a digital image of an image on a surface using a digital image capture device arbitrarily positioned with respect to the surface, the method comprising the steps of:

an illumination source for projecting at least three illumination marks on the surface, said illumination marks having a particular characteristic;

an image capturing device for capturing a single image of the surface to obtain captured image data;

an image reconstructor having means for detecting pixel values corresponding to the illumination marks and their corresponding location on the surface in the captured image data dependent on the particular characteristic, a means for using the location of the illumination marks in the captured image data to correct for distortion of the image in the captured image data to generate undistorted image data, and a means for substituting estimated pixel values determined using neighboring non-illumination mark pixel values for the detected illumination mark pixel values.

11. The system as described in claim 10 wherein the digital image capture device is one of a digital still camera and a digital video camera.

12. The system as described in claim 10 wherein the illumination source is a single color component light source.

13. The system as described in claim 10 wherein the illumination source is a laser.

14. The system as described in claim 10 wherein the illumination marks are detected by detecting color component and intensity.

15. The system as described in claim 10 wherein the at least three illumination marks comprise a grid of illumination marks.

16. The system as described in claim 10 wherein the illumination source comprises a diffraction grating for projecting the illumination source through to form a grid of illumination marks.