Image processing handheld scanner system, method, and computer readable medium

• US 8,189,965 B2
• Filed: 11/13/2009
• Issued: 05/29/2012
• Est. Priority Date: 11/17/2008
• Status: Active Grant

• Current Assignee: Visual Content IP, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Adilace Holdings, Inc.
• Inventors: Potucek, Martin, Edgar, Albert Durr, Wilder, Michael Charles, Polk, Darryl Ray, Wilkes, Michael David, Parker, Sheppard
• Primary Examiner(s): Koziol, Stephen R
• Application Number:
  US12/590,786
• Publication Number:
  US 20100124384A1
• Time in Patent Office: 928 Days
• Field of Search: 382/100, 382/276, 382/313
• US Class Current: 382/313
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images
• CPC Class Codes: H04N 1/00408 Display of information to the user, e.g. menus
• CPC Class Codes: H04N 1/0044 for image preview or review, e.g. to help the user position a sheet
• CPC Class Codes: H04N 1/04 Scanning arrangements , i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versaH04N1/387 takes precedence
• CPC Class Codes: H04N 1/107 with manual scanning
• CPC Class Codes: H04N 1/2104 for one or a few pictures
• CPC Class Codes: H04N 1/3876 Recombination of partial images to recreate the original image
• CPC Class Codes: H04N 1/3877 Image rotation
• CPC Class Codes: H04N 1/393 Enlarging or reducing
• CPC Class Codes: H04N 2201/0081 Image reader H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/0096 Portable devices
• CPC Class Codes: H04N 2201/0414 Scanning an image in a series of overlapping zones
• CPC Class Codes: H04N 2201/043 Viewing the scanned area
• CPC Class Codes: H04N 2201/0432 Adjusting the orientation of the scanning elements relative to the scanned sheet, e.g. changing from longitudinal to lateral scanning

Abstract

An image processing system and method is disclosed. The image processing system can be configured for use with a mouse scanner system operable to scan a document. The mouse scanner system includes a scanner built into a computer mouse and the image processing system includes a scanner software application operating on a computer. The scanner includes a positioning system operable to output position indicating data and an imaging system operable to output captured image data. The data is sent to the scanner software application where a feedback image is constructed and displayed on a display in real, or near real, time to allow the user to view what areas have been scanned. The scanner software application also constructs an output image that can be printed, saved or communicated.

Claims

1. A scanner system, comprising:

at least one processor;

memory coupled to said at least processor; and

instructions accessible from said memory by said at least one processor, wherein said instructions are configured for causing said at least one processor to;

process sensor data received from a scanner, wherein said sensor data includes a plurality of image tiles and position indicating data defining a respective relative position of each one of said image tiles, wherein each one of said image tiles includes data representing a discrete portion of visual content of a scanned object; and

display a feedback image derived from said image tile data, wherein causing said at least one processor to display the feedback image includes causing said at least one processor to display the discrete portion of said visual content of each one of said image tiles in a real-time or near real-time manner with respect to each one of said image tiles being generated and wherein causing said at least one processor to display the discrete portion of said visual content of each one of said image tiles includes causing said at least one processor to correlate the relative position of each one of said image tiles in the real-time or near real-time manner with at least one other image tile that has been previously generated and displayed.

2. The scanner system of claim 1 wherein causing said at least one processor to process said sensor data includes causing said at least one processor to derive from said position indicating data a position of the scanner at a point in time when generation of each one of said image tiles was one of initiated, completed, and partially completed.

3. The scanner system of claim 2 wherein causing said at least one processor to derive the position of the scanner includes causing said at least one processor to interpolate the position of the scanner from at least one position indicating data instance generated prior to the point in time when said image capturing was one of initiated, completed, and partially completed and at least one position indicating data instance generated after the point in time when said image capturing was one of initiated, completed, and partially completed.

4. The scanner system of claim 3 wherein causing said at least one processor to interpolate the position of the scanner includes causing said at least one processor to determine a timeline offset dependent upon creation time information of said position indicating data instances and creation time information corresponding to the point in time when generation of each one of said image tiles was one of initiated, completed, and partially completed.

5. The scanner system of claim 3 wherein causing said at least one processor to derive the position of the scanner includes causing said at least one processor to use said position indicating data to determine momentum of the scanner and to use said momentum to determine the position of the scanner at a point in time when generation of each one of said image tiles was one of initiated, completed, and partially completed.

6. The scanner system of claim 1 wherein:

causing said at least one processor to process said sensor data includes causing said at least one processor to receive said sensor data from the scanner;

causing said at least one processor to display the feedback image includes causing said at least one processor to determine a position of a most currently received one of said image tiles with respect to at least one previously received one of said image tiles;

in response to causing said at least one processor to determine the position of the most image tile of the most currently received one of said image tiles, causing said at least one processor to update a preview image to include the most currently received one of said image tiles in its determined position with respect to previously received ones of said image tiles within the preview image; and

causing said at least one processor to derive the feedback image from the preview image after updating the preview image.

7. The scanner system of claim 6 wherein causing said at least one processor to determine a position of the most currently received one of said image tiles with respect to at least one previously received one of said image tiles includes causing said at least one processor to cross correlate an abstract image of the most currently received one of said image tiles with an abstract image of at least one previously received one of said image tiles.

8. The scanner system of claim 7 wherein said instructions are further configured for causing said at least one processor to determine position adjustments of all of said received and cross correlated image tiles in a manner that provides for minimized discrepancy between results of said cross correlation.

9. The scanner system of claim 6 wherein causing said at least one processor to update the preview image includes causing said at least one processor to determine a ratio by which to scale the preview image for causing the feedback image to fit within a size of a visual display area in which the feedback image is to be displayed after causing said at least one processor to include the most currently received one of said image tiles dependent upon a size of a visual display area in which the feedback image is to be displayed.

10. The scanner system of claim 9 wherein:

causing said at least one processor to display the feedback image includes causing said at least one processor to selecting one of a pre-defined scaling ratios dependent upon said determined ratio by which to scale the preview image; and

causing said at least one processor to derive the feedback image from the preview image includes causing said at least one processor to scale the preview image by said selected one of the pre-defined scaling ratios.

11. A method, comprising:

at least one processor accessing, from memory coupled to said at least one processor, instructions causing said at least one processor to process sensor data received from a scanner, wherein said sensor data includes a plurality of image tiles and position indicating data defining a respective relative position of each one of said image tiles, wherein each one of said image tiles includes data representing a discrete portion of visual content of a scanned object; and

said at least one processor accessing, from said memory, instructions causing said at least one processor to display a feedback image derived from said image tile data, wherein instructions causing said at least one processor to display the feedback image includes instructions causing said at least one processor to display the discrete portion of said visual content of each one of said image tiles in a real-time or near real-time manner with respect to each one of said image tiles being generated.

12. The method of claim 11 wherein causing said at least one processor to process said sensor data includes causing said at least one processor to derive from said position indicating data a position of the scanner at a point in time when generation of each one of said image tiles was one of initiated, completed, and partially completed.

13. The method of claim 12 wherein causing said at least one processor to derive the position of the scanner includes causing said at least one processor to interpolate the position of the scanner from at least one position indicating data instance generated prior to the point in time when said image capturing was one of initiated, completed, and partially completed and at least one position indicating data instance generated after the point in time when said image capturing was one of initiated, completed, and partially completed.

14. The method of claim 13 wherein causing said at least one processor to interpolate the position of the scanner includes causing said at least one processor to determine a timeline offset dependent upon creation time information of said position indicating data instances and creation time information corresponding to the point in time when generation of each one of said image tiles was one of initiated, completed, and partially completed.

15. The method of claim 13 wherein causing said at least one processor to derive the position of the scanner includes causing said at least one processor to use said position indicating data to determine momentum of the scanner and to use said momentum to determine the position of the scanner at a point in time when generation of each one of said image tiles was one of initiated, completed, and partially completed.

16. The method of claim 11 wherein:

causing said at least one processor to process said sensor data includes causing said at least one processor to receive said sensor data from the scanner;

causing said at least one processor to display the feedback image includes causing said at least one processor to determine a position of a most currently received one of said image tiles with respect to at least one previously received one of said image tiles;

in response to causing said at least one processor to determine the position of the most image tile of the most currently received one of said image tiles, causing said at least one processor to update a preview image to include the most currently received one of said image tiles in its determined position with respect to previously received ones of said image tiles within the preview image; and

causing said at least one processor to derive the feedback image from the preview image after updating the preview image.

17. The method of claim 16 wherein causing said at least one processor to determine a position of the most currently received one of said image tiles with respect to at least one previously received one of said image tiles includes causing said at least one processor to cross correlate an abstract image of the most currently received one of said image tiles with an abstract image of at least one previously received one of said image tiles.

18. The method of claim 17, further comprising:

said at least one processor accessing, from said memory, instructions causing said at least one processor to determine position adjustments of all of said received and cross correlated image tiles in a manner that provides for minimized discrepancy between results of said cross correlation.

19. The method of claim 16 wherein causing said at least one processor to update the preview image includes causing said at least one processor to determine a ratio by which to scale the preview image for causing the feedback image to fit within a size of a visual display area in which the feedback image is to be displayed after causing said at least one processor to include the most currently received one of said image tiles dependent upon a size of a visual display area in which the feedback image is to be displayed.

20. The method of claim 19 wherein:

causing said at least one processor to display the feedback image includes causing said at least one processor to selecting one of a pre-defined scaling ratios dependent upon said determined ratio by which to scale the preview image; and

causing said at least one processor to derive the feedback image from the preview image includes causing said at least one processor to scale the preview image by said selected one of the pre-defined scaling ratios.

21. A non-transitory computer-readable medium having computer-executable instructions accessible therefrom, said computer-executable instructions configured for controlling at least processor to perform a method of processing sensor data generated by an image scanner, the method comprising the operations of:

processing sensor data received from a scanner, wherein said sensor data includes a plurality of image tiles and position indicating data defining a respective relative position of each one of said image tiles, wherein each one of said image tiles includes data representing a discrete portion of visual content of a scanned object; and

displaying a feedback image derived from said image tile data, wherein displaying the feedback image includes displaying the discrete portion of said visual content of each one of said image tiles in a real-time or near real-time manner with respect to each one of said image tiles being generated and wherein displaying the discrete portion of said visual content of each one of said image tiles includes correlating the relative position of each one of said image tiles in the real-time or near real-time manner with at least one other image tile that has been previously generated and displayed.

22. The non-transitory computer-readable medium of claim 21 wherein processing said sensor data includes deriving from said position indicating data a position of the scanner at a point in time when generation of each one of said image tiles was one of initiated, completed, and partially completed.

23. The non-transitory computer-readable medium of claim 22 wherein deriving the position of the scanner includes interpolating the position of the scanner from at least one position indicating data instance generated prior to the point in time when said image capturing was one of initiated, completed, and partially completed and at least one position indicating data instance generated after the point in time when said image capturing was one of initiated, completed, and partially completed.

24. The non-transitory computer-readable medium of claim 23 wherein interpolating the position of the scanner includes determining a timeline offset dependent upon creation time information of said position indicating data instances and creation time information corresponding to the point in time when generation of each one of said image tiles was one of initiated, completed, and partially completed.

25. The non-transitory computer-readable medium of claim 23 wherein deriving the position of the scanner includes using said position indicating data to determine momentum of the scanner and using said momentum to determine the position of the scanner at a point in time when generation of each one of said image tiles was one of initiated, completed, and partially completed.

26. The non-transitory computer-readable medium of claim 21 wherein:

processing said sensor data includes receiving said sensor data from the scanner;

displaying the feedback image includes determining a position of a most currently received one of said image tiles with respect to at least one previously received one of said image tiles;

in response to determining the position of the most image tile of the most currently received one of said image tiles, updating a preview image to include the most currently received one of said image tiles in its determined position with respect to previously received ones of said image tiles within the preview image; and

deriving the feedback image from the preview image after updating the preview image.

27. The non-transitory computer-readable medium of claim 26 wherein determining a position of the most currently received one of said image tiles with respect to at least one previously received one of said image tiles includes cross correlating an abstract image of the most currently received one of said image tiles with an abstract image of at least one previously received one of said image tiles.

28. The non-transitory computer-readable medium of claim 27, further comprising:

determining position adjustments of all of said received and cross correlated image tiles in a manner that provides for minimized discrepancy between results of said cross correlation.

29. The non-transitory computer-readable medium of claim 26 wherein updating the preview image includes determining a ratio by which to scale the preview image for causing the feedback image to fit within a size of a visual display area in which the feedback image is to be displayed after including the most currently received one of said image tiles dependent upon a size of a visual display area in which the feedback image is to be displayed.

30. The non-transitory computer-readable medium of claim 29 wherein:

displaying the feedback image includes selecting one of a pre-defined scaling ratios dependent upon said determined ratio by which to scale the preview image; and

deriving the feedback image from the preview image includes scaling the preview image by said selected one of the pre-defined scaling ratios.