Facial profile modification for hands free transactions

• US 10,482,463 B2
• Filed: 03/01/2017
• Issued: 11/19/2019
• Est. Priority Date: 03/01/2016
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Chandrasekaran, Sashikanth, Ho, Denise, Kalenichenko, Dmitry, Chitilian, Varouj, Zwiebel, Timothy Raymond, Palczewski, Michal
• Primary Examiner(s): Feild, Lynn D
• Assistant Examiner(s): McCoy, Richard A
• Application Number:
  US15/447,083
• Publication Number:
  US 20170255942A1
• Time in Patent Office: 993 Days
• Field of Search: None
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06Q 20/202 Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR
• CPC Class Codes: G06Q 20/40145 Biometric identity checks

Abstract

An account management system establishes a facial template for a user based on an image. The user computing device, signed into a payment application at the merchant location, receives an identifier from a merchant beacon device to transmit to the account management system, which transmits payment tokens based on payment account data and facial templates to the merchant POS device for each user signed in at the merchant location. The merchant POS device identifies the user by comparing a captured image of the user against the received facial templates and transmits the payment token to an issuer system. At a later time, the account management system receives, from a user computing device, a subsequent user image and generates a subsequent facial template. If the difference of the subsequent facial template is less than a threshold from the existing facial template, the subsequent facial template is associated with the user account.

Claims

1. A computer-implemented method to provide updated facial templates of users located at service system locations to service computing devices for use in identifying users via facial recognition, comprising, by one or more computing devices:

associating a first facial template with an account of a user;

receiving, from a user computing device, a facial image of the user and a request to modify the first facial template;

generating a second facial template comprising a computer code representation of the facial image;

comparing the second facial template and the first facial template to determine a difference value representing a difference between the second facial template and the first facial template;

determining that the difference value representing the difference between the second facial template and the first facial template is less than a threshold difference value;

associating the second facial template with the account of the user;

at a time after associating the second facial template with the user account, receiving, from the user computing device, a beacon device identifier broadcast by a service computing device at a service system location;

determining that the beacon device identifier corresponds to the service computing device;

in response to determining that the beacon device identifier corresponds to the service computing device, adding the second facial template to a log of current customers comprising facial templates corresponding to user computing devices that retransmitted the beacon device identifier to the one or more computing devices;

receiving, from the service computing device at the service system location, a request for the log of current customers; and

transmitting, to the service computing device at the service system location, the log of current customers comprising at least the second facial template; and

after an end of a predetermined period after first receiving the beacon identifier without subsequently receiving the beacon identifier, transmitting, to the service computing device, instructions to delete the second facial template from the log of current customers.

2. The computer-implemented method of claim 1, wherein the facial image is captured by the user computing device.

3. The computer-implemented method of claim 1, wherein the second facial template comprises computer generated code representing one or more features of the facial image.

4. The computer-implemented method of claim 3, wherein the one or more features comprise one or more of shape, color, line, value, space, form, texture, or other useful or relevant feature of the image or of particular regions of the facial image.

5. The computer-implemented method of claim 3, wherein determining the difference value representing a difference between the second facial template and the first facial template by comparing the second facial template against the first facial template comprises, by the one or more computing devices:

comparing one or more particular features of the second facial template against the one or more corresponding features of the first facial template;

for each of the one or more particular features of the second facial template that is compared against the corresponding feature of the first facial template, determining a particular delta value that describes a degree of difference between the second facial template and the first facial template with respect to each particular feature; and

based on each of the particular determined delta values, calculating the difference value, the difference value comprising an overall delta value describing an overall degree of difference between the second facial template and the first facial template.

6. The computer-implemented method of claim 1, further comprising, by the one or more computing devices:

at a time before receiving the facial image, receiving, from the user computing device, location data corresponding to the location comprising the point of sale device;

adding the first facial template to the log of current customers at the service system location;

receiving, from the service computing device at the location, a request for the log of current customers; and

transmitting, to the service computing device at the service system location, the log of current customers comprising at least the first facial template.

7. A computer program product to provide updated facial templates of users located at service system locations to service computing devices for use in identifying users via facial recognition, comprising:

a non-transitory computer-readable medium having computer-executable program instructions embodied thereon that when executed by a computer cause the computer to;

associate a first facial template with an account of the user;

receive, from a user computing device, a facial image of the user and an indication of an input of an option to modify the first facial template;

generate a second facial template comprising a computer code representation of the facial image;

compare the second facial template and the first facial template to determine a difference value representing a difference between the second facial template and the first facial template;

determine that the difference value representing the difference between the second facial template and the first facial template is less than a threshold difference value;

associate, in response to determining that the difference value representing the difference between the second facial template and the first facial template is less than a threshold difference value, the second facial template with the account of the user;

at a time after associating the second facial template with the user account, receive, from the user computing device, location data corresponding to a service system location comprising a service computing device;

add the second facial template to a log of current customers comprising facial templates corresponding to user computing devices that retransmitted the beacon device identifier to the one or more computing devices;

receive, from the service computing device at the service system location, a request for the log of current customers at the location;

transmit, to the service computing device at the service system location, the log of current customers comprising at least the second facial template; and

after an end of a predetermined period after first receiving the beacon identifier without subsequently receiving the beacon identifier, transmit, to the service computing device, instructions to delete the second facial template from the log of current customers.

8. The computer program product of claim 7, further comprising:

computer-executable program instructions to receive, from the user computing device, an initial facial image of a user; and

computer-executable program instructions to generate the first facial template comprising a computer code representation of the initial facial image.

9. The computer program product of claim 7, wherein the second generated facial template comprises computer generated code representing one or more features of the facial image.

10. The computer program product of claim 9, wherein the one or more features comprise one or more of shape, color, line, value, space, form, texture, or other useful or relevant feature of the image or of particular regions of the facial image.

11. The computer program product of claim 9, wherein determining the difference value representing a difference between the second facial template and the first facial template by comparing the second facial template against the first facial template comprises:

comparing one or more particular features of the second facial template against the one or more corresponding features of the first facial template;

for each of the one or more particular features of the second facial template that is compared against the corresponding feature of the first facial template, determining a particular delta value that describes a degree of difference between the second facial template and the first facial template with respect to the particular feature; and

based on each of the particular determined delta values, calculating, by the one or more computing devices, the difference value, the difference value comprising an overall delta value describing an overall degree of difference between the second facial template and the first facial template.

12. The computer program product of claim 7, further comprising:

computer-executable program instructions to receive, from the user computing device at a time after associating the first facial template with the user account and before receiving the facial image, location data corresponding to the service system location comprising the service computing device;

computer-executable program instructions to add the first facial template to the log of current customers at the service system location;

computer-executable program instructions to receive, from the service computing device at the location, a request for the log of current customers; and

computer-executable program instructions to transmit, to the service computing device at the service system location, the log of current customers comprising at least the first facial template.

13. A system to provide updated facial templates of users located at service system locations to service computing devices for use in identifying users, comprising:

a storage device; and

a processor communicatively coupled to the storage device, wherein the processor executes application code instructions that are stored in the storage device to cause the system to;

associate a first facial template with an account of the user;

receive, from a user computing device, a facial image of the user and a request to modify the first facial template;

generate a second facial template comprising a computer code representation of the facial image;

compare the second facial template and the first facial template to determine a difference value representing a difference between the second facial template and the first facial template;

determine that the difference value representing the difference between the second facial template and the first facial template is less than a threshold difference value;

in response to determining that the difference value representing the difference between the second facial template and the first facial template is less than a threshold difference value, associate the second facial template with the account of the user;

at a time after associating the first facial template with the user account and before receiving the second facial image, receive, from the user computing device, location data corresponding to a service system location comprising a service computing device;

add the first facial template to a log of current customers at the service system location;

receive, from the service computing device at the location, a request for the log of current customers at the service system location;

transmit, to the service computing device at the location, the log of current customers comprising at least the first facial template; and

after an end of a predetermined period after first receiving the beacon identifier without subsequently receiving the beacon identifier, transmit, to the service computing device, instructions to delete the second facial template from the log of current customers.

14. The system of claim 13, wherein the facial image is captured by the user computing device.

15. The system of claim 13, wherein the second generated facial template comprises computer generated code representing one or more features of the facial image.

16. The system of claim 15, wherein the one or more features comprise one or more of shape, color, line, value, space, form, texture, or other useful or relevant feature of the image or of particular regions of the facial image.

17. The system of claim 15, wherein determining the difference value representing a difference between the second facial template and the first facial template by comparing the second facial template against the first facial template comprises:

comparing one or more particular features of the second facial template against the one or more corresponding features of the first facial template;

for each of the one or more particular features of the second facial template that is compared against the corresponding feature of the first facial template, determining a particular delta value that describes a degree of difference between the second facial template and the first facial template with respect to the particular feature; and

based on each of the particular determined delta values, calculating, by the one or more computing devices, the difference value, the difference value comprising an overall delta value describing an overall degree of difference between the second facial template and the first facial template.