Systems and methods of sound-based fraud protection

• US 10,388,286 B1
• Filed: 03/20/2018
• Issued: 08/20/2019
• Est. Priority Date: 03/20/2018
• Status: Active Grant

• Current Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Original Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Inventors: Mossoba, Michael, Edwards, Joshua, Cunningham, Sarah, Rothbaum, Mark
• Primary Examiner(s): Sharma, Neeraj
• Application Number:
  US15/926,034
• Time in Patent Office: 518 Days
• Field of Search: None
• CPC Class Codes: G06Q 30/0185 Product, service or business identity fraud
• CPC Class Codes: G06Q 30/0249 based upon budgets or funds
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/06 Decision making techniques; Pattern matching strategies
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 63/1408 by monitoring network traffic monitoring network traffic per se H04L43/00
• CPC Class Codes: H04W 12/12 Detection or prevention of fraud
• CPC Class Codes: H04W 12/65 Environment-dependent, e.g. using captured environmental data

Abstract

The present disclosure describes systems and methods of fraud protection. A listening device may monitor ambient sound and detect one or more triggering sound patterns. The listening device may record the one or more triggering sound patterns and record a person'"'"'s voice, and send the recordings to a server, wherein the server is configured to calculate a confidence level of fraud based on the one or more triggering sound patterns and the recording of the person'"'"'s voice using a speech pattern model of the person, and to output an alert if the confidence level of fraud is greater than a threshold value.

Claims

1. A computer-implemented method of fraud protection for a computer-accessible account, comprising:

monitoring, by a listening device, ambient sound;

detecting, by the listening device, one or more triggering sound patterns from the ambient sound, the one or more triggering sound patterns including sound indicative of an initiation of an interaction between an initiator and a recipient;

recording, by the listening device, the one or more triggering sound patterns;

recording, by the listening device, a voice of the recipient for a first time duration, in response to detecting the one or more triggering sound patterns; and

transmitting, by the listening device, to a server in communication with the listening device, the recorded one or more triggering sound patterns and the recording of the recipient'"'"'s voice,

and wherein the server is configured to;

determine a correlation between the one or more triggering sound patterns and the recording of the recipient'"'"'s voice;

determine a speech pattern of the recipient from the recorded recipient'"'"'s voice;

determine a speech pattern model of the recipient by analyzing one or more speech samples associated with the recipient;

determine a difference between the speech pattern and the speech pattern model of the recipient;

calculate a confidence level of fraud being attempted against the recipient based on the determined correlation and the determined difference; and

freeze the computer-accessible account associated with the recipient if the confidence level of fraud is greater than a threshold value, thereby restricting access to the computer-accessible account by one or more computing devices.

2. The method of claim 1, wherein the one or more triggering sound patterns comprise at least one of “

IRS,”

“

owe,”

“

money,”

“

debt,”

“

wire,”

“

IRA,”

“

investment,”

“

may be at risk,”

“

retirement,”

“

back taxes,”

“

act now,”

“

before it'"'"'s too late,”

“

time is running out,”

“

failure to act,”

“

once in a lifetime,”

“

you'"'"'ve won,”

“

last chance,”

“

arrest,”

or “

pay”

.

3. The method of claim 1, wherein the one or more triggering sound patterns comprises at least one of a doorbell sound, a door knock sound, a phone ring, a voicemail, or a TV sound clip.

4. The method of claim 1, wherein the first time duration is between 0.1 and 300 seconds.

5. The method of claim 1, further comprising:

receiving, by the listening device, the alert from the server; and

outputting a notification in response to receiving the alert.

6. The method of claim 1, further comprising:

detecting one or more triggering words in the recipient'"'"'s voice; and

replacing the first time duration with a second time duration.

7. A computer-implemented method of fraud protection for a computer-accessible account, comprising:

receiving, by a server, one or more speech samples associated with a person;

generating a speech pattern model of the person based on extracting a person'"'"'s speech from the one or more speech samples;

storing the speech pattern model of the person;

receiving one or more triggering sound patterns and a recording of the person'"'"'s voice obtained by a listening device, the one or more triggering sound patterns including sound indicative of an initiation of an interaction between an initiator and a recipient;

determining, a correlation between the one or more triggering sound patterns and the recording of the person'"'"'s voice, thereby identifying the person as the recipient;

determining a speech pattern from the recorded recipient'"'"'s voice;

determining a difference between the speech pattern and the generated speech pattern model of the recipient;

determining a confidence level of fraud being attempted against the recipient from the determined correlation between the one or more triggering sound patterns and the recording of the recipient'"'"'s voice and the difference between the speech pattern of the recipient and the speech pattern model of the recipient; and

freezing the computer-accessible account associated with the recipient if the determined confidence level of fraud is greater than a threshold value, thereby restricting access to the computer-accessible account by one or more computing devices.

8. The method of claim 7, wherein the one or more triggering sound patterns comprise at least one of “

IRS,”

“

owe,”

“

money,”

“

debt,”

“

wire,”

“

IRA,”

“

investment,”

“

may be at risk,”

“

retirement,”

“

back taxes,”

“

act now,”

“

before it'"'"'s too late,”

“

time is running out,”

“

failure to act,”

“

once in a lifetime,”

“

you'"'"'ve won,”

“

last chance,”

“

arrest,”

or “

pay”

.

9. The method of claim 7, wherein the one or more triggering sound patterns comprises at least one of a doorbell sound, a door knock sound, a phone ring, a voicemail, or a TV sound clip.

10. The method of claim 7, further comprising:

sending an alert to a pre-determined entity associated with the recipient if the confidence level of fraud is greater than a first threshold value.

11. The method of claim 10, wherein the pre-determined entity comprises at least one of a financial institution, a law enforcement agency, a family member of the recipient, or a caregiver associated with the recipient.

12. The method of claim 7, further comprising:

updating a flag status of the computer-accessible account associated with the recipient if the confidence level of fraud exceeds a second threshold value; and

outputting the flag status of the account in a user interface.

13. The method of claim 12, wherein the computer-accessible account associated with the recipient comprises at least one of a bank account, a checking account, a saving account, a credit card account, an investment account, a loan account, or an individual retirement account.

14. The method of claim 7, wherein the computer-accessible account associated with the recipient comprises at least one of a bank account, a checking account, a saving account, a credit card account, an investment account, a loan account, or an individual retirement account.

15. A system of fraud protection for a computer-accessible account, comprising:

one or more microphones configured to monitor ambient sound and detect one or more triggering sound patterns from the ambient sound, the one or more triggering sound patterns including sound indicative of an initiation of an interaction between an initiator and a recipient; and

a processor circuit coupled to the one or more microphones and configured to execute instructions causing the processor to;

record the one or more triggering sound patterns;

record a voice of the recipient for a first time duration, in response to detecting the one or more triggering sound patterns; and

transmit the recorded one or more triggering sound patterns and the recording of the recipient'"'"'s voice to a server in communication with the processor circuit,

and wherein the server is configured to;

determine a correlation between the one or more triggering sound patterns and the recording of the recipient'"'"'s voice;

determine a speech pattern of the person from the recorded recipient'"'"'s voice for the first time duration;

determine a speech pattern model of the recipient by analyzing one or more speech samples associated with the recipient;

determine a difference between the speech pattern and the speech pattern model of the recipient;

calculate a confidence level of fraud being attempted against the recipient based on the determined correlation and the determined difference; and

freeze the computer-accessible account associated with the recipient if the confidence level of fraud is greater than a threshold value, thereby restricting access to the computer-accessible account by one or more computing devices.

16. The system of claim 15, wherein the one or more triggering sound patterns comprise at least one of “

IRS,”

“

owe,”

“

money,”

“

debt,”

“

wire,”

“

IRA,”

“

investment,”

“

may be at risk,”

“

retirement,”

“

back taxes,”

“

act now,”

“

before it'"'"'s too late,”

“

time is running out,”

“

failure to act,”

“

once in a lifetime,”

“

you'"'"'ve won,”

“

last chance,”

“

arrest,”

or “

pay”

.

17. The system of claim 15, wherein the first time duration is between 0.1 and 300 seconds.

18. The system of claim 15, wherein the pre-determined entity comprises at least one of a financial institution, a law enforcement agency, a family member of the recipient, or a caregiver associated with the recipient.

19. The system of claim 15, comprising:

a speaker coupled to the processor circuit and configured to play an audio file in response to the confidence level of fraud exceeding a threshold value.