Comparing extracted card data using continuous scanning

• US 10,515,290 B2
• Filed: 08/16/2017
• Issued: 12/24/2019
• Est. Priority Date: 06/28/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Wang, Xiaohang, Mitchell, Marcus Quintana
• Primary Examiner(s): Couso, Yon J
• Application Number:
  US15/678,990
• Publication Number:
  US 20170344825A1
• Time in Patent Office: 860 Days
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 20/322 Aspects of commerce using mobile devices [M-devices]
• CPC Class Codes: G06Q 20/327 Short range or proximity payments by means of M-devices
• CPC Class Codes: G06Q 20/34 using cards, e.g. integrated circuit [IC] cards or magnetic cards
• CPC Class Codes: G06Q 20/4016 involving fraud or risk level assessment in transaction processing
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 10/16 using multiple overlapping images; Image stitching
• CPC Class Codes: G06V 10/22 by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
• CPC Class Codes: G06V 10/98 Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/153 using recognition of characters or words
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images

Abstract

Comparing extracted card data from a continuous scan comprises receiving, by one or more computing devices, a digital scan of a card; obtaining a plurality of images of the card from the digital scan of the physical card; performing an optical character recognition algorithm on each of the plurality of images; comparing results of the application of the optical character recognition algorithm for each of the plurality of images; determining if a configured threshold of the results for each of the plurality of images match each other; and verifying the results when the results for each of the plurality of images match each other. Threshold confidence level for the extracted card data can be employed to determine the accuracy of the extraction. Data is further extracted from blended images and three-dimensional models of the card. Embossed text and holograms in the images may be used to prevent fraud.

Claims

1. A computer-implemented method to compare extracted card data using continuous scanning, comprising:

receiving, by one or more computing devices, a digital scan of a card from a camera;

obtaining, by the one or more computing devices, a plurality of images of the card from the digital scan of the card;

creating, by the one or more computing devices, a first three-dimensional model of the card that captures embossed text that is displayed on the card based upon a digital manipulation of the plurality of images;

comparing, by the one or more computing devices, the first three-dimensional model of the card displaying the embossed text to a standard three-dimensional model of the card depicting the embossed text on the card;

determining, by the one or more computing devices, that perspectives of the first three-dimensional model of the embossed text match the standard three-dimensional model of the embossed text; and

verifying, by the one or more computing devices, the first three-dimensional model of the embossed text based on the determination that the perspectives of the first three-dimensional model of the embossed text match the standard three-dimensional model of the embossed text.

2. The method of claim 1, further comprising:

accessing, by the one or more computing devices, at least one additional digital image of the card based on a determination by the one or more computing devices that the three-dimensional model of the embossed text does not match the standard three-dimensional model of the embossed text;

creating, by the one or more computing devices, a second three-dimensional model of the card that captures the embossed text based upon the additional digital images and at least a portion of the plurality of images;

comparing, by the one or more computing devices, the second three-dimensional model of the embossed text to the standard three-dimensional model of the embossed text;

determining, by the one or more computing devices, if perspectives of the second three-dimensional model of the embossed text match the standard three-dimensional model of the embossed text; and

verifying, by the one or more computing devices, the second three-dimensional model of the embossed text when the perspectives of the second three-dimensional model of the embossed text match the standard three-dimensional model of the embossed text.

3. The method of claim 2, wherein the one or more computing devices receive the at least one additional digital image from the obtained plurality of images.

4. The method of claim 2, wherein the one or more computing devices receives the at least one additional digital image via a second scan of the card by the camera.

5. The method of claim 1, wherein the digital scan is received from a camera.

6. The method of claim 1, wherein the digital scan comprises a video or a plurality of still images.

7. The method of claim 1, wherein the card is a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.

8. A computer program product, comprising:

a non-transitory computer-readable storage device having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to compare extracted card data using continuous scanning, the computer-executable program instructions comprising;

computer-executable program instructions to receive a digital scan of a card;

computer-executable program instructions to obtain a plurality of images of the card from the digital scan of the card;

computer-executable program instructions to create a first three-dimensional model of the card that captures embossed text that is displayed on the card based upon a digital manipulation of the plurality of images;

computer-executable program instructions to compare the first three-dimensional model of the card displaying the embossed text to a standard three-dimensional model of the card depicting the embossed text on the card;

computer-executable program instructions to determine that perspectives of the first three-dimensional model of the embossed text match the standard three-dimensional model of the embossed text; and

computer-executable program instructions to verify the first three-dimensional model of the embossed text based on the determination that the perspectives of the first three-dimensional model of the embossed text match the standard three-dimensional model of the embossed text.

9. The computer program product of claim 8, the computer program further comprising:

computer-executable program instructions to access at least one additional digital image of the card;

computer-executable program instructions to create a second three-dimensional model of the card that captures the embossed text based upon the additional digital images and at least a portion of the plurality of images;

computer-executable program instructions to compare the second three-dimensional model of the embossed text to the standard three-dimensional model of the embossed text; and

computer-executable program instructions to determine if perspectives of the second three-dimensional model of the embossed text match the standard three-dimensional model of the embossed text.

10. The computer program product of claim 8, wherein the computer receives the at least one additional digital image from the obtained plurality of images.

11. The computer program product of claim 8, wherein the computer receives the at least one additional digital image via a second scan of the card.

12. The computer program product of claim 8, wherein the digital scan is received from a camera.

13. The computer program product of claim 8, wherein the digital scan comprises a video or a plurality of still images.

14. A system to compare extracted card data, the system comprising:

a storage resource; and

a processor communicatively coupled to the storage resource, wherein the processor is configured to execute computer-readable instructions that are stored in the storage resource and that cause the system to;

receive a digital scan of a card;

obtain a plurality of images of the card from the digital scan of the card;

create a first three-dimensional model of the card that captures embossed text that is displayed on the card based upon a digital manipulation of the plurality of images;

compare the first three-dimensional model of the card displaying the embossed text to a standard three-dimensional model of the card depicting the embossed text on the card; and

determine that perspectives of the first three-dimensional model of the embossed text match the standard three-dimensional model of the embossed text.

15. The system of claim 14, the computer-readable instructions being configured to further cause the system to:

access at least one additional digital image of the card;

create a second three-dimensional model of the card that captures the embossed text based upon the additional digital images and at least a portion of the plurality of images;

compare the second three-dimensional model of the embossed text to the standard three-dimensional model of the embossed text; and

determine if perspectives of the second three-dimensional model of the embossed text match the standard three-dimensional model of the embossed text.

16. The system of claim 15, wherein the at least one digital additional image is accessed from the obtained plurality of images.

17. The system of claim 14, wherein the card is a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.