FACIAL PROFILE MODIFICATION FOR HANDS FREE TRANSACTIONS

• US 20170255942A1
• Filed: 03/01/2017
• Published: 09/07/2017
• Est. Priority Date: 03/01/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Chandrasekaran, Sashikanth, Ho, Denise, Kalenichenko, Dmitry, Chitilian, Varouj, Zwiebel, Timothy Raymond, Palczewski, Michal
• Granted Patent: US 10,482,463 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06Q 20/202 Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR
• CPC Class Codes: G06Q 20/40145 Biometric identity checks

Abstract

An account management system establishes a facial template for a user based on an image. The user computing device, signed into a payment application at the merchant location, receives an identifier from a merchant beacon device to transmit to the account management system, which transmits payment tokens based on payment account data and facial templates to the merchant POS device for each user signed in at the merchant location. The merchant POS device identifies the user by comparing a captured image of the user against the received facial templates and transmits the payment token to an issuer system. At a later time, the account management system receives, from a user computing device, a subsequent user image and generates a subsequent facial template. If the difference of the subsequent facial template is less than a threshold from the existing facial template, the subsequent facial template is associated with the user account.

Claims

1. A computer-implemented method to update a facial template for use in processing a hands-free transaction with facial recognition of a user, comprising:

receiving, by one or more computing devices, a first facial image of a user;

generating, by the one or more computing devices, a first facial template comprising a computer code representation of the first facial image;

associating, by the one or more computing devices, the generated first facial template with an account of the user;

receiving, by one or more computing devices and from a user computing device, a second facial image of the user and an indication of an input of an option to modify the first facial template;

generating, by the one or more computing devices, a second facial template comprising a computer code representation of the second facial image;

determining, by the one or more computing devices, a difference value representing a difference between the generated second facial template and the generated first facial template by comparing the generated second facial template against the generated first facial template; and

in response to determining that the difference value representing the difference between the generated second facial template and the generated first facial template is less than a threshold difference value, associating, by the one or more computing devices, the generated second facial template with the account of the user.

2. The computer-implemented method of claim 1, wherein the first facial image is received from the user computing device.

3. The computer-implemented method of claim 1, wherein the first generated facial template and the second generated facial template comprise respective computer generated codes representing one or more features of the first facial image and the second facial image, respectively.

4. The computer-implemented method of claim 3, wherein the one or more features comprise one or more of shape, color, line, value, space, form, texture, or other useful or relevant feature of the image or of particular regions of the respective facial image.

5. The computer-implemented method of claim 3, wherein determining the difference value representing a difference between the generated second facial template and the generated first facial template by comparing the generated second facial template against the generated first facial template comprises:

comparing one or more particular features of the generated second facial template against the one or more corresponding features of the generated first facial template;

for each of the one or more particular features of the generated second facial template that is compared against the corresponding feature of the generated first facial template, determining a particular delta value that describes a degree of difference between the generated second facial template and the generated first facial template with respect to the particular feature; and

based on each of the particular determined delta values, calculating, by the one or more computing devices, the difference value, the difference value comprising an overall delta value describing an overall degree of difference between the generated second facial template and the generated first facial template.

6. The computer-implemented method of claim 1, further comprising:

at a time after associating the first generated facial template with the user account and before receiving the second facial image, receiving, by the one or more computing devices and from the user computing device, location data corresponding to a location comprising a point of sale device;

adding, by the one or more computing devices the first generated facial template to a log of current customers at the location;

receiving, by the one or more computing devices and from the point of sale device at the location, a request for the log of current customers at the location; and

transmitting, by the one or more computing devices and to the point of sale device at the location, the log of current customers comprising at least the first generated facial template.

7. The computer-implemented method of claim 1, further comprising:

at a time after associating the second generated facial template with the user account, receiving, by the one or more computing devices and from the user computing device, location data corresponding to a location comprising a point of sale device;

adding, by the one or more computing devices, the second generated facial template to a log of current customers at the location;

receiving, by the one or more computing devices and from the point of sale device at the location, a request for the log of current customers at the location; and

transmitting, by the one or more computing devices and to the point of sale device at the location, the log of current customers comprising at least the second generated facial template.

14. The computer program product of claim 1, further comprising:

at a time after associating the second generated facial template with the user account, computer-executable program instructions to receive, from the user computing device, location data corresponding to a location comprising a point of sale device;

computer-executable program instructions to add the second generated facial template to a log of current customers at the location;

computer-executable program instructions to receive, from the point of sale device at the location, a request for the log of current customers at the location; and

computer-executable program instructions to transmit, to the point of sale device at the location, the log of current customers comprising at least the second generated facial template.

8. A computer program product, comprising:

a non-transitory computer-readable medium having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to update facial templates for use in processing hands-free transactions, the computer-executable program instructions comprising;

computer-executable program instructions to associate a generated first facial template with an account of the user;

computer-executable program instructions to receive, from a user computing device, a second facial image of the user and an indication of an input of an option to modify the first facial template;

computer-executable program instructions to generate a second facial template comprising a computer code representation of the second facial image;

computer-executable program instructions to determine a difference value representing a difference between the generated second facial template and the generated first facial template by comparing the generated second facial template against the generated first facial template; and

in response to determining that the difference value representing the difference between the generated second facial template and the generated first facial template is less than a threshold difference value, computer-executable program instructions to associate the generated second facial template with the account of the user.

9. The computer program product of claim 8, further comprising:

computer-executable program instructions to receive, from the user computing device, a first facial image of a user; and

computer-executable program instructions to generate the first facial template comprising a computer code representation of the first facial image.

10. The computer program product of claim 8, wherein the first generated facial template and the second generated facial template comprise respective computer generated codes representing one or more features of the first facial image and the second facial image, respectively.

11. The computer program product of claim 10, wherein the one or more features comprise one or more of shape, color, line, value, space, form, texture, or other useful or relevant feature of the image or of particular regions of the respective facial image.

12. The computer program product of claim 10, wherein determining the difference value representing a difference between the generated second facial template and the generated first facial template by comparing the generated second facial template against the generated first facial template comprises:

comparing one or more particular features of the generated second facial template against the one or more corresponding features of the generated first facial template;

for each of the one or more particular features of the generated second facial template that is compared against the corresponding feature of the generated first facial template, determining a particular delta value that describes a degree of difference between the generated second facial template and the generated first facial template with respect to the particular feature; and

based on each of the particular determined delta values, calculating, by the one or more computing devices, the difference value, the difference value comprising an overall delta value describing an overall degree of difference between the generated second facial template and the generated first facial template.

13. The computer program product of claim 8, further comprising:

at a time after associating the first generated facial template with the user account and before receiving the second facial image, computer-executable program instructions to receive, from the user computing device, location data corresponding to a location comprising a point of sale device;

computer-executable program instructions to add the first generated facial template to a log of current customers at the location;

computer-executable program instructions to receive, from the point of sale device at the location, a request for the log of current customers at the location; and

computer-executable program instructions to transmit, to the point of sale device at the location, the log of current customers comprising at least the first generated facial template.

15. A system to update a facial template for use in processing a hands-free transaction with facial recognition of a user, comprising:

a storage device; and

a processor communicatively coupled to the storage device, wherein the processor executes application code instructions that are stored in the storage device to cause the system to;

receive a first facial image of a user;

generate a first facial template comprising a computer code representation of the first facial image;

associate the generated first facial template with an account of the user;

receive, from a user computing device, a second facial image of the user and an indication of an input of an option to modify the first facial template;

generate, a second facial template comprising a computer code representation of the second facial image;

determine, a difference value representing a difference between the generated second facial template and the generated first facial template by comparing the generated second facial template against the generated first facial template; and

in response to determining that the difference value representing the difference between the generated second facial template and the generated first facial template is less than a threshold difference value, associate the generated second facial template with the account of the user.

16. The system of claim 15, wherein the first facial image is received from the user computing device.

17. The system of claim 15, wherein the first generated facial template and the second generated facial template comprise respective computer generated codes representing one or more features of the first facial image and the second facial image, respectively.

18. The system of claim 17, wherein the one or more features comprise one or more of shape, color, line, value, space, form, texture, or other useful or relevant feature of the image or of particular regions of the respective facial image.

19. The system of claim 17, wherein determining the difference value representing a difference between the generated second facial template and the generated first facial template by comparing the generated second facial template against the generated first facial template comprises:

comparing one or more particular features of the generated second facial template against the one or more corresponding features of the generated first facial template;

for each of the one or more particular features of the generated second facial template that is compared against the corresponding feature of the generated first facial template, determining a particular delta value that describes a degree of difference between the generated second facial template and the generated first facial template with respect to the particular feature; and

based on each of the particular determined delta values, calculating, by the one or more computing devices, the difference value, the difference value comprising an overall delta value describing an overall degree of difference between the generated second facial template and the generated first facial template.

20. The system of claim 15, wherein the processor is further configured to execute computer-executable program instructions stored in the storage device to cause the system to:

at a time after associating the first generated facial template with the user account and before receiving the second facial image, receive, from the user computing device, location data corresponding to a location comprising a point of sale device;

add the first generated facial template to a log of current customers at the location;

receive, from the point of sale device at the location, a request for the log of current customers at the location; and

transmit, to the point of sale device at the location, the log of current customers comprising at least the first generated facial template.