Document authentication using extracted digital fingerprints

• US 10,043,073 B2
• Filed: 02/15/2016
• Issued: 08/07/2018
• Est. Priority Date: 03/02/2011
• Status: Active Grant

• Current Assignee: Alitheon, Inc.
• Original Assignee: Alitheon, Inc.
• Inventors: Ross, David, Elmenhurst, Brian, Tocci, Mark, Forbes, John, Ross, Heather Wheelock
• Primary Examiner(s): Mistry, Oneal R
• Application Number:
  US15/044,034
• Publication Number:
  US 20160162734A1
• Time in Patent Office: 904 Days
• CPC Class Codes: B07C 5/3422 using video scanning devices, e.g. TV-cameras
• CPC Class Codes: G06F 16/2468 Fuzzy queries
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06Q 50/60 Business processes related to postal services shipping G06Q10/083; franking apparatus G07B17/00
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images
• CPC Class Codes: G06V 30/424 Postal images, e.g. labels or addresses on parcels or postal envelopes
• CPC Class Codes: H04L 9/3247 involving digital signatures

Abstract

Methods and systems for detecting changes, alterations and forgeries in documents utilize digital fingerprinting. A set of documents of a given type that are known to be altered or forgeries are scanned and “fingerprinted” to build a forgery database. Suspect documents are scanned and the resulting fingerprint data is used to query the forgery database to look for matching records, although a match need not be exact. Matches may be counted and compared to a threshold number to assess a confidence that a document is forged or not. The fingerprinting may be directed to at least one authentication region of a document, and one or more features in a region may be incorporated into a fingerprint of the document.

Claims

1. A method comprising:

acquiring digital image data of an image of at least a selected authentication region of a document, without printing or adding anything on to the document, and wherein the document has been previously forged or altered at least in the authentication region from its original state;

extracting at least one native feature from the acquired digital image data from the authentication region, wherein the at least one native feature describes physical characteristics of the authentication region without recognizing content such as alpha-numeric characters that may appear in the authentication region;

forming a feature vector to represent the at least one native feature in a compact form;

storing the feature vector in a database record as part of a digital fingerprint of the document in a forgery database for use in detecting forged or altered documents among a class of documents to which the forged or altered document belongs;

repeating the foregoing steps over additional documents that have been forged or altered to add, respectively, additional feature vectors in additional database records as part of additional digital fingerprints of the additional documents to the forgery database, the additional feature vectors representing corresponding native features in the additional documents;

acquiring second digital image data of a portion of a suspect document, wherein the portion of the suspect document corresponds to the authentication region used to build the forgery database;

extracting second features from the second digital image data;

forming a second feature vector to represent the second features in the compact form;

querying the forgery database using the second feature vector to obtain a result based on zero or more stored feature vectors that match the second feature vector, each stored feature vector that matches the second feature vector defining a fraud indicator match;

counting a number of the fraud indicator matches;

comparing the number of the fraud indicator matches to a predetermined threshold value to determine a confidence level that the suspect document is forged or altered;

generating a report of the determined confidence level based on the comparison; and

transmitting the report to a user interface.

2. The method of claim 1 wherein the feature vector comprises an array of color or gray scale numeric values corresponding to a sub-region within the selected authentication region.

3. The method of claim 2 wherein the numeric values in the array each comprise a mathematical function combining individual values of a corresponding group of pixels forming the sub-region of the authentication region.

4. The method of claim 3 wherein the mathematical function is selected from a set of functions that includes a sum, maximum, and average of the individual values.

5. The method of claim 3 wherein extracting the at least one native feature includes selecting the authentication region based on a predetermined template that defines at least one authentication region for the class of documents to which the forged or altered documents belong.

6. The method of claim 5 wherein at least one of the digital fingerprints in the forgery database corresponds to an original work of art.

7. The method of claim 3 wherein at least one of the digital fingerprints in the forgery database corresponds to a forged or altered document that comprises a numismatic object.

8. The method of claim 3 wherein at least one of the digital fingerprints in the forgery database corresponds to a government-issued identification document.

9. The method of claim 8 wherein the government-issued identification document corresponds to a passport.

10. The method of claim 3 wherein at least one of the digital fingerprints in the forgery database corresponds to a negotiable instrument as defined in the Uniform Commercial Code.

11. The method of claim 3 wherein at least one of the digital fingerprints in the forgery database corresponds to a bill of lading or shipping document.

12. The method of claim 1 including:

acquiring digital image data of multiple different regions of a second document;

processing the acquired digital image data of the multiple different regions by extracting multiple features from the multiple different regions;

including the multiple extracted features in a second digital fingerprint; and

comparing the second digital fingerprint to the digital fingerprints in the forgery database by conducting region-by-region matching to detect what, if any, regions have been changed.

13. A system comprising:

an image capture device to acquire digital image data of an image of at least a selected authentication region of a document, without printing or adding anything on to the document, and wherein the document has been previously forged or altered at least in the authentication region from its original state; and

a processor arranged to access the digital image data, the processor coupled to a non-volatile memory storing machine-readable code executable by the processor, wherein the machine-readable code is arranged to cause the processor, upon execution, to;

extract at least one native feature from the acquired digital image data from the authentication region, wherein the at least one native feature describes physical characteristics of the authentication region without recognizing content such as alpha-numeric characters that may appear in the authentication region;

form a feature vector to represent the at least one native feature in a compact form;

store the feature vector in a database record as part of a digital fingerprint of the document in a forgery database for use in detecting forged or altered documents among a class of documents to which the forged or altered document belongs;

repeat the foregoing steps over additional documents that have been forged or altered to add, respectively, additional feature vectors in additional database records as part of additional digital fingerprints of the additional documents to the forgery database, the additional feature vectors representing corresponding native features in the additional documents;

acquire second digital image data of a portion of a suspect document, wherein the portion of the suspect document corresponds to the authentication region used to build the forgery database;

extract second features from the second digital image data;

form a second feature vector to represent the second features in the compact form;

query the forgery database using the second feature vector to obtain a result based on zero or more stored feature vectors that match the second feature vector, each stored feature vector that matches the second feature vector defining a fraud indicator match;

count a number of the fraud indicator matches;

compare the number of the fraud indicator matches to a predetermined threshold value to determine a confidence level that the suspect document is forged or altered;

generate a report of the determined confidence level based on the comparison; and

transmit the report to a user interface.

14. The system of claim 13 wherein the feature vector comprises an array of color or gray scale numeric values corresponding to a sub-region within the selected authentication region.

15. The system of claim 14 wherein the numeric values in the array each comprise a mathematical function combining individual values of a corresponding group of pixels forming the sub-region of the authentication region.

16. The system of claim 15 wherein the mathematical function is selected from a set of functions that includes a sum, maximum, and average of the individual values.

17. The system of claim 13 wherein extracting the at least one native feature includes selecting the authentication region based on a predetermined template that defines at least one authentication region for the class of documents to which the forged or altered documents belong.

18. The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to a forged or altered document that comprises a numismatic object.

19. The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to a government-issued identification document.

20. The system of claim 13 wherein the government-issued identification document corresponds to a passport.

21. The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to a negotiable instrument as defined in the Uniform Commercial Code.

22. The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to a bill of lading or shipping document.

23. The system of claim 13 wherein at least one of the digital fingerprints in the forgery database corresponds to an original work of art.

24. A manufacture comprising a non-volatile, computer-readable memory, the memory storing instruction to cause a processor to:

access digital image data, the digital image data acquired from at least a selected authentication region of a document;

extract at least one native feature from the acquired image data from the authentication region, wherein the native feature describes physical characteristics of the authentication region without recognizing content such as alpha-numeric characters that may appear in the authentication region;

form a feature vector to represent the at least one native feature in a compact form;

store the feature vector in a database record as part of a digital fingerprint of the document in a forgery database for use in detecting forged or altered documents among a class of documents to which the forged document belongs;

repeat the foregoing steps over additional documents that have been forged or altered to add additional feature vectors to the forgery database, the feature vectors representing corresponding native features in the additional documents;

acquire second digital image data of a portion of a suspect document, wherein the portion of the suspect document corresponds to the authentication region used to build the forgery database;

extract second features from the second image data;

form a second feature vector to represent the second features in a compact form;

querying the forgery database using the second feature vector to obtain a result based on zero or more stored feature vectors that match the second feature vector, each stored feature vector that matches the second feature vector defining a defining a fraud indicator match;

count a number of the fraud indicator matches;

compare the number of the fraud indicator matches to a predetermined threshold value to determine a confidence level that the suspect document is forged or altered;

generate a report of the determined confidence level based on the comparison; and

transmit the report to a user interface.

25. The manufacture of claim 24 wherein the feature vector comprises an array of color or gray scale numeric values corresponding to a sub-region within the selected authentication region.

26. The manufacture of claim 25 wherein the numeric values in the array each comprise a mathematical function combining individual values of a corresponding group of pixels forming the sub-region of the authentication region.

27. The manufacture of claim 26 wherein the mathematical function is selected from a set of functions that includes a sum, maximum, and average of the individual values.

28. The manufacture of claim 24 wherein extracting the at least one native feature includes selecting the authentication region based on a predetermined template that defines at least one authentication region for the class of documents to which the forged or altered documents belong.

29. The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to a forged or altered document that comprises a numismatic object.

30. The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to a government-issued identification document.

31. The manufacture of claim 24 wherein the government-issued identification document corresponds to a passport.

32. The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to a negotiable instrument as defined in the Uniform Commercial Code.

33. The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to a bill of lading or shipping document.

34. The manufacture of claim 24 wherein at least one of the digital fingerprints in the forgery database corresponds to an original work of art.