Method and apparatus for authenticating printed documents using multi-level image comparison based on document characteristics

• US 8,000,528 B2
• Filed: 12/29/2009
• Issued: 08/16/2011
• Est. Priority Date: 12/29/2009
• Status: Active Grant

• Current Assignee: Konica Minolta Laboratory U.S.A., Inc. (Konica Minolta Inc.)
• Original Assignee: Konica Minolta Systems Lab Incorporated (Konica Minolta Inc.)
• Inventors: Ming, Wei, Tian, Yibin
• Primary Examiner(s): TUCKER, WESLEY J
• Application Number:
  US12/648,931
• Publication Number:
  US 20110158483A1
• Time in Patent Office: 595 Days
• Field of Search: 382/112, 382137-140, 382173-180
• US Class Current: 382/173
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text

Abstract

A document authentication method compares a target document image (scanned image) with an original document image at multiple levels, such as block (e.g. paragraph, graphics, image), line, word and character levels. The paragraph level comparison determines whether the target and original images have the same number of paragraphs and whether the paragraphs have the same sizes and locations; the line level comparison determines if the target and original images have the same number of lines and whether the lines have the same sizes and locations; etc. Document segmentation is performed on the target and original images to segment them into paragraph units, line units, etc. for purposes of the comparisons. The original document may be segmented beforehand and the segmentation information stored for later use. The authentication process may be designed to stop when alterations are detected at a higher level, so lower level comparisons are not carried out.

Claims

1. A method implemented in a data processing apparatus for authenticating a target document image by comparing the target document image with an original document image, comprising:

comparing the target document image with the original document image at a first level, including;

(a) segmenting the target document image into a plurality of first-level units;

(b) segmenting the original document image into a plurality of first-level units;

(c) comparing the plurality of first-level units in the target document image with the plurality of first-level units in the original document image to detect alterations in the target document image; and

if no alteration is detected in step (c), comparing the target document image with the original document image at a second level, including;

(d) segmenting the target document image into a plurality of second-level units, wherein the second-level units are smaller than the first-level units;

(e) segmenting the original document image into a plurality of second-level units, wherein the second-level units are smaller than the first-level units; and

(f) comparing the plurality of second-level units in the target document image with the plurality of second-level units in the original document image to detect alterations in the target document image.

2. The method of claim 1, wherein step (c) includes:

(c1) comparing a count of the first-level units in the target document image with a count of the first-level units in the original document image to detect alterations in the target document image; and

(c2) if no alteration is detected in step (c1), comparing a size and a location of each first-level unit in the target document image with a size and a location of a corresponding first-level unit in the original document image to detect alterations in the target document image; and

wherein step (f) includes;

(f1) comparing a count of the second-level units in the target document image with a count of the second-level units in the original document image to detect alterations in the target document image; and

(f2) if no alteration is detected in step (f1), comparing a size and a location of each second-level unit in the target document image with a size and a location of a corresponding second-level unit in the original document image to detect alterations in the target document image.

3. The method of claim 1, wherein the first-level units in the target and original document images are block units each containing a paragraph of text, or a graphic object, or an image object, and wherein the second-level units in the target and original document images are line units each containing a line of text, or word units each containing a word of text, or character units each containing a character of text.

4. The method of claim 1, wherein the first-level units in the target and original document images are line units each containing a line of text, and wherein the second-level units in the target and original document images are word units each containing a word of text or character units each containing a character of text.

5. The method of claim 1, wherein the first-level units in the target and original document images are word units each containing a word of text, and wherein the second-level units in the target and original document images are character units each containing a character of text.

6. The method of claim 1, further comprising:

if no alteration is detected in step (f), performing an overall comparison of the target and original document images or selected portions thereof to detect alterations in the target document image.

7. The method of claim 1, wherein if alterations are detected in step (c) or step (f), displaying a message indicating that an alteration has been detected.

8. The method of claim 7, wherein the message further indicates a type of the alteration.

9. A computer program product comprising a computer usable medium having a computer readable program code embedded therein for controlling a data processing apparatus, the computer readable program code configured to cause the data processing apparatus to execute a process for authenticating a target document image by comparing the target document image with an original document image, the process comprising:

comparing the target document image with the original document image at a first level, including;

(a) segmenting the target document image into a plurality of first-level units;

(b) segmenting the original document image into a plurality of first-level units;

(c) comparing the plurality of first-level units in the target document image with the plurality of first-level units in the original document image to detect alterations in the target document image; and

if no alteration is detected in step (c), comparing the target document image with the original document image at a second level, including;

(d) segmenting the target document image into a plurality of second-level units, wherein the second-level units are smaller than the first-level units;

(e) segmenting the original document image into a plurality of second-level units, wherein the second-level units are smaller than the first-level units; and

(f) comparing the plurality of second-level units in the target document image with the plurality of second-level units in the original document image to detect alterations in the target document image.

10. The computer program product of claim 9, wherein step (c) includes:

(c1) comparing a count of the first-level units in the target document image with a count of the first-level units in the original document image to detect alterations in the target document image; and

(c2) if no alteration is detected in step (c1), comparing a size and a location of each first-level unit in the target document image with a size and a location of a corresponding first-level unit in the original document image to detect alterations in the target document image; and

wherein step (f) includes;

(f1) comparing a count of the second-level units in the target document image with a count of the second-level units in the original document image to detect alterations in the target document image; and

(f2) if no alteration is detected in step (f1), comparing a size and a location of each second-level unit in the target document image with a size and a location of a corresponding second-level unit in the original document image to detect alterations in the target document image.

11. The computer program product of claim 9, wherein the first-level units in the target and original document images are block units each containing a paragraph of text, or a graphic object, or an image object, and wherein the second-level units in the target and original document images are line units each containing a line of text, or word units each containing a word of text, or character units each containing a character of text.

12. The computer program product of claim 9, wherein the first-level units in the target and original document images are line units each containing a line of text, and wherein the second-level units in the target and original document images are word units each containing a word of text or character units each containing a character of text.

13. The computer program product of claim 9, wherein the first-level units in the target and original document images are word units each containing a word of text, and wherein the second-level units in the target and original document images are character units each containing a character of text.

14. The computer program product of claim 9, further comprising:

if no alteration is detected in step (f), performing an overall comparison of the target and original document images or selected portions thereof to detect alterations in the target document image.

15. The computer program product of claim 9, wherein if alterations are detected in step (c) or step (f), displaying a message indicating that an alteration has been detected.

16. The computer program product of claim 15, wherein the message further indicates a type of the alteration.