Freehand image scanning device which compensates for non-linear color movement

• US 5,825,044 A
• Filed: 02/25/1997
• Issued: 10/20/1998
• Est. Priority Date: 03/02/1995
• Status: Expired due to Term

• Current Assignee: Agilent Technologies, Inc., Hewlett-Packard Company (HP Inc.), Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Company (HP Inc.)
• Inventors: Beard, David, Tullis, Barclay J., Allen, Ross R., Smith, Mark T.
• Primary Examiner(s): LE, QUE TAN
• Application Number:
  US08/805,963
• Time in Patent Office: 602 Days
• Field of Search: 250/208.1, 250/559.4, 250/556, 250/559.44, 250/234, 250/557, 364/449.1, 364/460, 364/444, 382/311-315, 382/180, 382/316, 235/472, 235/462
• US Class Current: 250/557
• CPC Class Codes: H04N 1/047 Detection, control or error compensation of scanning velocity or position H04N1/0402 and H04N1/17 take precedence
• CPC Class Codes: H04N 1/107 with manual scanning
• CPC Class Codes: H04N 1/193 using electrically scanned linear arrays , e.g. linear CCD arrays
• CPC Class Codes: H04N 2201/02439 Positioning method
• CPC Class Codes: H04N 2201/0414 Scanning an image in a series of overlapping zones
• CPC Class Codes: H04N 2201/043 Viewing the scanned area
• CPC Class Codes: H04N 2201/04712 using unbroken arrays of detectors, i.e. detectors mounted on the same substrate
• CPC Class Codes: H04N 2201/04729 in the main-scan direction
• CPC Class Codes: H04N 2201/04731 in the sub-scan direction
• CPC Class Codes: H04N 2201/04734 Detecting at frequent intervals, e.g. once per line for sub-scan control
• CPC Class Codes: H04N 2201/04737 by detecting the scanned medium directly, e.g. a leading edge
• CPC Class Codes: H04N 2201/04743 by detecting the image directly detecting reference images H04N2201/04717
• CPC Class Codes: H04N 2201/04787 by changing or controlling the addresses or values of pixels, e.g. in an array, in a memory, by interpolation
• CPC Class Codes: H04N 2201/04794 Varying the control or compensation during the scan, e.g. using continuous feedback or from line to line

Abstract

A scanning device and method of forming a scanned electronic image include an imaging sensor and at least one navigation sensor. For an embodiment, the imaging sensor enables sensing of color images. In the preferred embodiment, the imaging sensor is a linear array of sensor elements, with a two-dimensional navigation sensor array at each end. The scanning device has three degrees of freedom, since position information from the navigation sensors allows manipulation of an image signal from the imaging sensor to reduce distortion artifacts caused by curvilinear scanning. Acceptable sources of the position information include printed matter and contrast variations dictated by variations in the inherent structure-related properties of the medium on which the scanned image is formed. Inherent structure-related properties can also include color contrast. Illumination for optimal operation of the navigation system may be introduced at a grazing angle in some applications or in the normal to a plane of the original in other applications, but this is not essential.

Claims

1. A method of forming an output image comprising the steps of:

moving a scanning device relative to an original having an image, said scanning device having an imaging means for detecting said image, moving said scanning device defining a scan path;

capturing a sequence of color image data formed as said imaging means moves along said scan path;

forming navigation information representative of travel of said scanning device along said scan path, said travel including curvilinear and rotational movement; and

forming an output image from said color image data, including removing image distortion artifacts arising from said curvilinear and rotational movement of said scanning device along said scan path, said removing image distortion artifacts being based upon said navigation information.

2. The method of claim 1 wherein said output image is a color output image.

3. The method of claim 1 wherein said imaging means includes a plurality of arrays, and wherein at least one array of said plurality of arrays has a filter element that selectively passes a color component different from another array of said plurality of arrays.

4. The method of claim 3 wherein said plurality of arrays includes red, green and blue arrays.

5. The method of claim 1 wherein said imaging means sequentially receives illumination from a plurality of different color components.

6. The method of claim 5 wherein said plurality of different color components includes red, green and blue.

7. A scanning device comprising:

sensor means for forming color image signals upon relative movement between said sensor means and an original having an image, said relative movement being a scanning process, said color image signals being responsive to said image;

navigation means, in fixed position relative to said sensor means, including a first two-dimensional array of optical sensor elements, for forming at least one position signal responsive to detection of inherent structure related properties of said original during said scanning process; and

processor means, responsive to said position signal, for manipulating said color image signals based upon relative movement between said navigation means and said original as determined by variations of said inherent structure-related properties and for generating manipulated output image signals, said manipulating being conducted to cause an output image created from said manipulated output image signals to more accurately reproduce said image of said original.

8. The scanning device of claim 7 wherein said output image signals correspond to a color output image.

9. The scanning device of claim 7 wherein said sensor means includes a plurality of image sensor arrays, and wherein at least one image sensor array of said plurality of image sensor arrays has a filter element that selectively passes a color component different from another image sensor array of said plurality of image sensor arrays.

10. The scanning device of claim 9 wherein said plurality of image sensor arrays includes red, green and blue arrays.

11. The scanning device of claim 7 wherein said sensor means sequentially receives illumination from a plurality of different color components.

12. The scanning device of claim 11 wherein said plurality of different color components includes red, green and blue.

13. A scanning device for forming a scanned electronic image of an original comprising:

a housing having a forward side;

a color image sensor having an array of optoelectronic elements, said image sensor being connected to said forward side of said housing, said image sensor having a length greater than a width and having first and second lengthwise ends;

a first navigation sensor having an array of optoelectronic elements, said first navigation sensor being connected to said forward side and being at said first lengthwise end of said image sensor;

a second navigation sensor having an array of optoelectronic elements, said second navigation sensor being connected to said forward side and being at said second lengthwise end of said image sensor;

illumination means for illuminating an original to be scanned in a manner to contrast inherent structural features of said original, said illumination means including first and second light sources positioned proximate to said first and second navigation sensors, respectively;

means connected to receive signals from said first and second navigation sensors for tracking movement of said image sensor relative to said original and generating position signals corresponding to said movement; and

means for mapping signals generated by said image sensor in accordance with said movement of said image sensor relative to said original, said means for mapping signals receiving said position signals and mapping said signals generated by said image sensor based on said position signals to remove image distortion artifacts arising from curvilinear or rotational movement of said image sensor relative to said original.

14. The scanning device of claim 13 wherein said array of optoelectronic elements includes a plurality of image sensor arrays, and wherein at least one image sensor array of said plurality of image sensor arrays has a filter element that selectively passes a color component different from another image sensor array of said plurality of image sensor arrays.

15. The scanning device of claim 14 wherein said plurality of image sensor arrays includes red, green and blue arrays.

16. The scanning device of claim 13 wherein said color image sensor sequentially receives illumination from a plurality of different color components.

17. The scanning device of claim 16 wherein said plurality of different color components includes red, green and blue.

18. A method of forming an output image comprising the steps of:

moving a scanning device relative to an original having an image, said scanning device having an imaging means for detecting said image, moving said scanning device defining a scan path;

capturing a sequence of image data formed as said imaging means moves along said scan path;

forming navigation information representative of travel of said scanning device along said scan path, said travel including curvilinear and rotational movement; and

forming an output image from said image data, including removing image distortion artifacts arising from said curvilinear and rotational movement of said scanning device along said scan path, said removing image distortion artifacts being based upon said navigation information including color contrast information.

19. A scanning device comprising:

sensor means for forming image signals upon relative movement between said sensor means and an original having an image, said relative movement being a scanning process, said image signals being responsive to said image;

navigation means, in fixed position relative to said sensor means, including a first two-dimensional array of optical sensor elements, for forming at least one position signal responsive to detection of inherent structure related properties of said original during said scanning process, said inherent structure related properties including color contrast information; and

processor means, responsive to said position signal, for manipulating said image signals based upon relative movement between said navigation means and said original as determined by variations of said inherent structure-related properties and for generating manipulated output image signals, said manipulating being conducted to cause an output image created from said manipulated output image signals to more accurately reproduce said image of said original.

20. A scanning device for forming a scanned electronic image of an original comprising:

a housing having a forward side;

a image sensor having an array of optoelectronic elements, said image sensor being connected to said forward side of said housing, said image sensor having a length greater than a width and having first and second lengthwise ends;

a first navigation sensor having an array of optoelectronic elements, said first navigation sensor being connected to said forward side and being at said first lengthwise end of said image sensor;

a second navigation sensor having an array of optoelectronic elements, said second navigation sensor being connected to said forward side and being at said second lengthwise end of said image sensor;

illumination means for illuminating an original to be scanned in a manner to contrast inherent structural features of said original, said inherent structural features including color contrast information, said illumination means including first and second light sources positioned proximate to said first and second navigation sensors, respectively;

means connected to receive signals from said first and second navigation sensors for tracking movement of said image sensor relative to said original and generating position signals corresponding to said movement; and

means for mapping signals generated by said image sensor in accordance with said movement of said image sensor relative to said original, said means for mapping signals receiving said position signals and mapping said signals generated by said image sensor based on said position signals to remove image distortion artifacts arising from curvilinear or rotational movement of said image sensor relative to said original.