Comparing extracted card data using continuous scanning

• US 10,152,647 B2
• Filed: 06/16/2016
• Issued: 12/11/2018
• Est. Priority Date: 06/28/2013
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Kumar, Sanjiv, Rowley, Henry Allan, Wang, Xiaohang, Okshtein, Yakov, Shamsi, Farhan, Bissacco, Alessandro
• Primary Examiner(s): Couso, Yon
• Application Number:
  US15/184,198
• Publication Number:
  US 20160292527A1
• Time in Patent Office: 908 Days
• Field of Search: 382137
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 20/322 Aspects of commerce using mobile devices [M-devices]
• CPC Class Codes: G06Q 20/327 Short range or proximity payments by means of M-devices
• CPC Class Codes: G06Q 20/34 using cards, e.g. integrated circuit [IC] cards or magnetic cards
• CPC Class Codes: G06Q 20/4016 involving fraud or risk level assessment in transaction processing
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 10/16 using multiple overlapping images; Image stitching
• CPC Class Codes: G06V 10/22 by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
• CPC Class Codes: G06V 10/98 Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/153 using recognition of characters or words
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images

Abstract

Comparing extracted card data from a continuous scan comprises receiving, by one or more computing devices, a digital scan of a card; obtaining a plurality of images of the card from the digital scan of the physical card; performing an optical character recognition algorithm on each of the plurality of images; comparing results of the application of the optical character recognition algorithm for each of the plurality of images; determining if a configured threshold of the results for each of the plurality of images match each other; and verifying the results when the results for each of the plurality of images match each other. Threshold confidence level for the extracted card data can be employed to determine the accuracy of the extraction. Data is further extracted from blended images and three-dimensional models of the card. Embossed text and holograms in the images may be used to prevent fraud.

Claims

1. A computer-implemented method to compare extracted card data, comprising:

performing, by one or more computing devices, an optical character recognition algorithm on each of a plurality of images obtained from a digital scan of a card, the digital scan being a continuous digital scan;

determining, by the one or more computing devices, if a configured threshold number of results for each of the plurality of images match each other based on a comparison of the results of the performance of the optical character recognition algorithm on each of the plurality of images; and

verifying, by the one or more computing devices, the matching results as card data when at least the configured threshold number of results for each of the plurality of images match each other is reached.

2. The method of claim 1, further comprising:

accessing, by the one or more computing devices, at least one additional digital image of the card when the one or more computing devices determines that at least the configured threshold number is not reached;

performing, by the one or more computing devices, the optical character recognition algorithm on each additional image of the card; and

including, by the one or more computing devices, the results of the performance of the optical character recognition algorithm to each additional image in the determining.

3. The method of claim 2, wherein the at least one additional image is accessed from the plurality of images obtained from the digital scan of the card.

4. The method of claim 2, further comprising performing a second digital scan of the card to obtain the at least one additional image.

5. The method of claim 1, wherein the results are determined to match when a percentage of matching digits meets or exceeds the configured threshold.

6. The method of claim 1, wherein the digital scan is received from a camera.

7. The method of claim 1, wherein the digital scan comprises a video or a plurality of still images.

8. The method of claim 1, wherein the card is a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.

9. A computer program product, comprising:

a non-transitory computer-readable storage device having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to compare extracted card data from multiple images to identify matched extraction results, the computer-executable program instructions comprising;

computer-executable program instructions to perform an optical character recognition algorithm on a first image of a plurality of images obtained from a digital scan of a card, the digital scan being a continuous digital scan;

computer-executable program instructions to perform the optical character recognition algorithm on a second image of the plurality of images obtained from the digital scan of the card;

computer-executable program instructions to compare results from the performance of the optical character recognition on the first image with results from the performance of the optical character recognition on the second image;

computer-executable program instructions to determine if a configured threshold number of the results for the first image matches the results of the second image based on the comparison of the results of the performance of the optical character recognition algorithm on the first image and the second image;

computer-executable program instructions to accept the matching results as card data when at least the configured threshold number of results match; and

computer-executable program instructions to communicate the matching result to a processing system.

10. The computer program product of claim 9, the computer-executable program instructions further comprising:

computer-executable program instructions to access at least one additional digital image of the card when the one or more computing devices determines at least the configured threshold number is not reached;

computer-executable program instructions to perform the optical character recognition algorithm on each additional image of the card; and

computer-executable program instructions to include the results of the performance of the optical character recognition algorithm to each additional image in the determining.

11. The computer program product of claim 9, computer-executable program instructions to perform a second digital scan of the card to obtain the at least one additional image is accessed from the obtained images.

12. The computer program product of claim 9, computer-executable program instructions further comprising performing a second digital scan of the card to obtain the at least one additional image.

13. The computer program product of claim 9, wherein the results are determined to match when a percentage of matching digits meets or exceeds the configured threshold.

14. The computer program product of claim 9, wherein the digital scan is received from a camera.

15. The computer program product of claim 9, wherein the digital scan comprises a video or a plurality of still images.

23. The computer program product of claim 9, wherein the card is a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.

16. A system to compare extracted card data, comprising:

a storage resource;

a processor communicatively coupled to the storage resource, wherein the processor is configured to execute computer-readable instructions that are stored in the storage resource to cause the system to;

perform an optical character recognition algorithm on a first image of a plurality of images obtained from a digital scan of a card, the digital scan being a continuous digital scan;

perform the optical character recognition algorithm on a second image of the plurality of images obtained from the digital scan of the card;

compare results from the performance of the optical character recognition on the first image with results from the performance of the optical character recognition on the second image;

determine if a configured threshold number of the results for the first image matches the results of the second image based on the comparison of the results of the performance of the optical character recognition algorithm on the first image and the second image; and

accept the matching results as card data when at least the configured threshold number of results match; and

communicate the matching result to a processing system.

17. The system of claim 16, wherein the processor is further configured to execute computer-readable instructions to cause the system to:

access at least one additional digital image of the card when the one or more computing devices determines that least the configured threshold number of results is not reached;

perform the optical character recognition algorithm on each additional image of the card; and

include the results of the performance of the optical character recognition algorithm to each additional image in the determining.

18. The system of claim 17, wherein the at least one additional image is accessed from the plurality of images obtained from the digital scan of the card.

19. The system of claim 16, wherein the results are determined to match when a percentage of matching digits meets or exceeds the configured threshold.

20. The system of claim 16, wherein the card is a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.

21. The system of claim 16, wherein the digital scan is received from a camera.

22. The system of claim 16, wherein the digital scan comprises a video or a plurality of still images.