Automatic perspective distortion detection and correction for document imaging

• US 20060210192A1
• Filed: 03/17/2005
• Published: 09/21/2006
• Est. Priority Date: 03/17/2005
• Status: Abandoned Application

• Current Assignee: Psion Teklogix Systems Incorporated
• Original Assignee: Symagery Microsystems, Inc. (Motorola Solutions, Inc.)
• Inventors: Orhun, Ufuk
• Application Number:
  US11/082,588
• Publication Number:
  US 20060210192A1
• Time in Patent Office: Days
• US Class Current: 382/275
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image

Abstract

A method and apparatus for detecting and correcting perspective distortion for document imaging is described. The document template of the present invention contains special markers that define the corners of the document. One of these markers, different from the others, uniquely identifies a particular corner. When an image of a document is captured and it is found to contain perspective distortion, the smallest rectangle that encloses the special markers in the captured image is calculated and geometric transforms are used to map the special markers in the captured image to the corners of the smallest rectangle. To correct for orientation errors during image capture, the captured image is rotated based on the location of the unique marker. The present invention can also provide feedback to the operator as the image is being captured. This feedback guides the operator to properly align the image reader for substantially perspective distortion-free imaging.

Claims

1. A method of correcting perspective distortion in an image captured by an image reader wherein the captured image has a number of special markers located on the boundary of the image having a predetermined shape, comprising the steps of:

a. calculating the smallest predetermined shape that encloses all of the special boundary markers;

b. building a geometric transform to map the location of the special markers in the captured image to corresponding locations on the predetermined shape; and

c. applying the geometric transform to the captured image.

2. The method as claimed in claim 1 wherein the special boundary markers include a unique identifier marker different from the other special boundary markers and the method comprises:

d. correcting for orientation errors in the captured image based on the unique marker identifier.

3. The method as claimed in claim 2 wherein step d. comprises rotating the captured image.

4. The method as claimed in claim 1 wherein the predetermined shape is a rectangle and the special boundary markers are corner markers.

5. The method as claimed in claim 1 wherein the special boundary markers are polygon shapes.

6. The method as claimed in claim 1 wherein the geometric transform comprises affine transformations.

7. The method as claimed in claim 1 wherein the method comprises:

e. cutting the image within the predetermined shape.

8. A method of positioning an image reader having a rectangular field of view to avoid perspective distortion in a captured image wherein the captured image has special boundary markers located at the corners of the image having a rectangular shape comprising the steps of:

a. capturing an image;

b. calculating the distance between the special boundary markers and the field of view corners;

c. determining if the distances are all the same within a predetermined tolerance; and

d. repositioning the image reader and recapturing the image if the distances are not the same within the predetermined tolerance;

e. repeating steps b., c. and d. until the distances are all the same within the predetermined tolerance.

9. The method as claimed in claim 8 wherein the special boundary markers include a unique identifier marker different from the other special boundary markers and the method comprises:

f. correcting for orientation errors in the captured image based on the unique marker identifier.

10. The method as claimed in claim 9 wherein the correcting for orientation errors step comprises rotating the captured image.

11. The method as claimed in claim 8 wherein the special boundary markers are polygon shapes.

12. A method of producing an image of a substantially rectangular target having special boundary markers at the corners with one of the markers being a unique corner marker using an image reader having a rectangular field of view comprising the steps of:

a. capturing an image;

b. positioning the reader as a function of the distances from the markers to corners of the field of view; and

c. correcting orientation errors of the image using the unique corner marker.

13. The method as claimed in claim 12 comprising before step c. correcting perspective distortion on the captured image using the special boundary markers.

14. The method as claimed in claim 12 wherein the correcting for orientation errors step comprises rotating the captured image.

15. The method as claimed in claim 12 wherein the special boundary markers are polygon shapes.

16. A method of producing an image of a substantially rectangular target having special boundary markers at the corners with one of the markers being a unique corner marker using an image reader comprising the steps of:

a. capturing an image;

b. correcting perspective distortion on the captured image using the special boundary markers; and

c. correcting orientation errors of the image using the unique corner marker.

17. The method as claimed in claim 16 wherein the correcting orientation errors step comprises rotating the captured image.

18. The method as claimed in claim 16 wherein the correcting perspective distortion step comprises the steps of:

b. 1. calculating the smallest predetermined shape that encloses all of the special boundary markers;

b.2 building a geometric transform to map the location of the special markers in the captured image to corresponding locations of the predetermined shape; and

b.3 applying the geometric transform to the captured image.

19. The method as claimed in claim 18 wherein the geometric transform comprises affine transformations.

20. The method as claimed in claim 16 wherein the special boundary markers are polygon shapes.

21. An apparatus for correcting perspective distortion in an image captured by an image reader wherein the captured image has a number of special markers located on the boundary of the image having a predetermined shape comprising:

means for calculating the smallest predetermined shape that encloses all of the special boundary markers;

means for building a geometric transform to map the location of the special markers in the captured image to corresponding locations of the predetermined shape; and

means for applying the geometric transform to the captured image.

22. The apparatus as claimed in claim 21 wherein the special boundary markers include a unique identifier marker different from the other special boundary markers and the apparatus comprises:

means for correcting for orientation errors in the captured image based on the unique marker identifier.

23. The apparatus as claimed in claim 22 wherein orientation correcting means comprises means for rotating the captured image.

24. The apparatus as claimed in claim 21 wherein the predetermined shape is a rectangle and the special boundary markers are corner markers.

25. The apparatus as claimed in claim 21 wherein the special boundary markers are polygon shapes.

26. The apparatus as claimed in claims 21 wherein the apparatus comprises:

means for cutting the image within the predetermined shape.

27. An apparatus for positioning an image reader having a rectangular field of view to avoid perspective distortion in a captured image wherein the captured image has special boundary markers located at the corners of the image having a rectangular shape comprising:

means for capturing an image;

means for calculating the distance between the special boundary markers and the field of view corners;

means for determining if the distances are all the same within a predetermined tolerance;

means for recapturing the image until the distances are all the same within a predetermined tolerance; and

means for indicating when the distances are all the same within a predetermined tolerance.

28. The apparatus as claimed in claim 27 wherein the special boundary markers include a unique identifier marker different from the other special boundary markers and the apparatus comprises means for correcting for orientation errors in the captured image based on the unique marker identifier.

29. The apparatus as claimed in claim 28 wherein the means for correcting orientation errors comprises means for rotating the captured image.

30. The apparatus as claimed in claim 27 wherein the special boundary markers are polygon shapes.

31. An apparatus for producing an image of a substantially rectangular target having special boundary markers at the corners with one of the markers being a unique corner marker using an image reader having a rectangular field of view comprising:

means for capturing an image;

means for providing an indication to position the reader as a function of the distances from the markers to corners of the field of view; and

means for correcting orientation errors of the image using the unique corner marker.

32. The apparatus as claimed in claim 31 comprising means for correcting perspective distortion on the captured image using the special boundary markers.

33. The apparatus as claimed in claim 31 wherein the means for correcting for orientation errors comprises means for rotating the captured image.

34. The apparatus as claimed in claim 31 wherein the special boundary markers are polygon shapes.

35. An apparatus for producing an image of a substantially rectangular target having special boundary markers at the corners with one of the markers being a unique corner marker using an image reader comprising the steps of:

means for capturing an image;

means for correcting perspective distortion on the captured image using the special boundary markers; and

means for correcting orientation errors of the captured image using the unique corner marker.

36. The apparatus as claimed in claim 35 wherein the means for correcting orientation errors comprises means for rotating the captured image.

39. The apparatus as claimed in claim 35 wherein the special boundary markers are polygon shapes.

37. The apparatus as claimed in 35 wherein the means for correcting perspective distortion comprises:

means for calculating the smallest predetermined shape that encloses all of the special boundary markers;

means for building a geometric transform to map the location of the special markers in the captured image to corresponding locations of the predetermined shape; and

means for applying the geometric transform to the captured image.

38. The apparatus as claimed in claim 37 wherein the geometric transform comprises affine transformations.