Extracting card data for simultaneous display with an image

• US 10,387,742 B2
• Filed: 11/02/2016
• Issued: 08/20/2019
• Est. Priority Date: 06/27/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Mitchell, Marcus Quintana, Wang, Xiaohang
• Primary Examiner(s): Chang, Jon
• Application Number:
  US15/342,116
• Publication Number:
  US 20170061225A1
• Time in Patent Office: 1,021 Days
• CPC Class Codes: G06K 7/10 by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
• CPC Class Codes: G06Q 20/3223 Realising banking transactions through M-devices
• CPC Class Codes: G06Q 20/3276 using a pictured code, e.g. barcode or QR-code, being read by the M-device
• CPC Class Codes: G06Q 20/34 using cards, e.g. integrated circuit [IC] cards or magnetic cards
• CPC Class Codes: G06Q 20/36 using electronic wallets or electronic money safes
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/2253 Recognition of characters printed with magnetic ink G06V30/2247 takes precedence
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00

Abstract

Extracting card data comprises receiving, by one or more computing devices, a digital image of a card; perform an image recognition process on the digital representation of the card; identifying an image in the digital representation of the card; comparing the identified image to an image database comprising a plurality of images and determining that the identified image matches a stored image in the image database; determining a card type associated with the stored image and associating the card type with the card based on the determination that the identified image matches the stored image; and performing a particular optical character recognition algorithm on the digital representation of the card, the particular optical character recognition algorithm being based on the determined card type. Another example superimposes the extracted data directly above, below, or beside the corresponding section on the displayed image.

Claims

1. A computer-implemented method to extract card information, comprising:

performing, by one or more computing devices, an optical character recognition algorithm on an image of a card to identify a number sequence from the image of the card;

presenting, by the one or more computing devices and via a user interface of the one or more computing devices, the image of the card, the image of the card comprising the number sequence;

presenting, by the one or more computing devices and via the user interface of the one or more computing devices, a virtual display of the identified number sequence, the virtual display of the identified number sequence being superimposed on the presented image of the card;

presenting, by the one or more computing devices and via the user interface of the one or more computing devices, an interface object to request an acceptance of the identified number sequence, wherein the interface object is presented simultaneously with the virtual display of the identified number sequence on the user interface;

receiving, by the one or more computing devices, a user tap on the superimposed image of the identified number sequence on the user interface, wherein the user tap indicates that the identified number sequence is incorrect; and

performing, by the one or more computing devices, a second optical character recognition algorithm on the image of the card upon receipt of the user tap.

2. The method of claim 1, wherein accepting the identified number sequence based on an input via the interface object indicates that the presented identified number sequence matches corresponding information on the presented image of the card.

3. The method of claim 2, further comprising submitting the identified number sequence to a digital wallet to be used in a transaction in response to accepting the identified number sequence.

4. The method of claim 1, further comprising rejecting the identified number sequence based on the user tap on the superimposed image, wherein rejecting the identified number sequence indicates that the presented identified number sequence does not match corresponding information on the presented image of the card.

5. The method of claim 1, wherein the card comprises one or more of a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.

6. The method of claim 1, further comprising receiving, by the one or more computing devices, an input from a user via the interface object specifying whether the presented identified number sequence matches the presented number sequence of the card.

7. The method of claim 1, wherein the virtual display of the identified number sequence is superimposed below the presented number sequence on the presented image of the card.

8. A computer program product, comprising:

a non-transitory computer-readable storage device having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to extract card information, comprising;

computer-executable program instructions to present an image of a card on a user interface of one or more computing devices;

computer-executable program instructions to perform a first optical character recognition algorithm on the image of the card;

computer-executable program instructions to identify based on the performance of the first optical character recognition algorithm on the image of the card, an identification number associated with an issuer of the card from information and characteristics of the identification number, the characteristics being one or more of a font, color, and spacing of characters of the identification number;

computer-executable program instructions to present a virtual display of the identified identification number on the user interface, the virtual display of the identified identification number being superimposed on the presented image of the card;

computer-executable program instructions to present an interface object to request an acceptance of the identified identification number, wherein the interface object is presented simultaneously with the virtual display of the identified identification number on the user interface;

computer-executable program instructions to receive a user tap on the superimposed image of the identified identification number on the user interface, wherein the user tap indicates that the identified identification number is incorrect; and

computer-executable program instructions to perform a second optical character recognition algorithm on the image of the card upon receipt of the user tap.

9. The computer program product of claim 8, further comprising computer-executable program instructions to receive an input from a user via the interface object specifying whether the presented identified identification number matches the identification number of the card.

10. The computer program product of claim 8, further comprising computer-executable program instructions to accept the identified identification number based on an input from a user via the interface object, wherein accepting the identified identification number indicates that the presented identified identification number matches the identification number of the card.

11. The computer program product of claim 8, further comprising computer-executable program instructions to reject the identified identification number based on the user tap on the superimposed image, wherein rejecting the identified identification number indicates that the presented identified identification number does not match the identification number of the card.

12. The computer program product of claim 8, wherein the virtual display of the identified identification number is superimposed below the identification number on the presented image of the card.

13. The computer program product of claim 8, further comprising computer-executable program instructions to submit the identified identification number to a digital wallet to be used in a transaction.

14. A system to extract card information, comprising:

a storage resource; and

a processor communicatively coupled to the storage resource, wherein the processor is configured to execute computer-readable instructions that are stored in the storage resource to cause the system to;

present an image of a card on a user interface of one or more computing devices;

perform a first optical character recognition algorithm on the image of the card;

identify based on the performance of the first optical character recognition algorithm on the image of the card, an identification number associated with an issuer of the card from information and characteristics of the identification number, the characteristics being one or more of a font, color, and spacing of characters of the identification number;

present a virtual display of the identified identification number, the virtual display of the identified identification number being superimposed on the presented image of the card;

present an interface object to request an acceptance of the identified identification number, wherein interface object is presented simultaneously with the virtual display of the identified identification number on the user interface;

receive a user tap on the superimposed image of the identified identification number on the user interface, wherein the user tap indicates that the identified identification number is incorrect; and

perform a second optical character recognition algorithm on the image of the card upon receipt of the user tap.

15. The system of claim 14, further comprising instructions to accept the identified identification number based on an input from a user via the interface object, wherein accepting the identified identification number indicates that the presented identified identification number matches the identification number of the card.

16. The system of claim 14, further comprising instructions to reject the identified identification number based on the user tap on the superimposed image, wherein rejecting the identified identification number indicates that the presented identified identification number does not match the identification number of the card.

17. The system of claim 14, further comprising instructions to submit the identified identification number to a digital wallet to be used in a transaction.

18. The system of claim 14, wherein the virtual display of the identified identification number is superimposed below the identification number on the presented image of the card.

19. The system of claim 14, wherein the card comprises one or more of a credit card, a debit card, an identification card, a loyalty card, an access card, or a stored value card.