System and method of providing and validating enhanced CAPTCHAs

• US 9,519,766 B1
• Filed: 09/07/2015
• Issued: 12/13/2016
• Est. Priority Date: 09/07/2015
• Status: Active Grant

• Current Assignee: Cerence Inc.
• Original Assignee: VoiceBox Technologies Corporation (Microsoft Corporation)
• Inventors: Bhosale, Vikrant, Rothwell, Spencer John, Elshenawy, Ahmad Khamis
• Primary Examiner(s): Dolly, Kendall
• Application Number:
  US14/846,923
• Time in Patent Office: 463 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 2221/2133 Verifying human interaction, e.g., Captcha

Abstract

The invention relates to a system and method of automatically distinguishing between computers and human based on responses to enhanced Completely Automated Public Turing test to tell Computers and Humans Apart (“e-captcha”) challenges that do not merely challenge the user to recognize skewed or stylized text. A given e-captcha challenge may be specific to a particular knowledge domain. Accordingly, e-captchas may be used not only to distinguish between computers and humans, but also determine whether a respondent has demonstrated knowledge in the particular knowledge domain. For instance, participants in crowd-sourced tasks, in which unmanaged crowds are asked to perform tasks, may be screened using an e-captcha challenge. This not only validates that a participant is a human (and not a bot, for example, attempting to game the crowd-source task), but also screens the participant based on whether they can successfully respond to the e-captcha challenge.

Claims

1. A computer implemented method of distinguishing between computers and humans through enhanced completely automated public turing test to tell computers and humans apart (e-captcha), the method being implemented in a computer system having one or more physical processors programmed with computer program instructions that, when executed by the one or more physical processors, cause the computer system to perform the method, the method comprising:

providing, by the computer system, via a network, executable instructions configured to generate a user interface that includes an e-captcha challenge, wherein the e-captcha challenge requires one or more words or phrases to be uttered;

receiving, by the computer system, an audio input via at least one input configured to receive the audio input, the audio input comprising a response to the e-captcha challenge;

using, by the computer system, an automated speech recognition engine to convert the audio input to text;

determining, by the computer system, an edit distance between the one or more words or phrases to be uttered and the text converted from the audio input;

determining, by the computer system, whether the one or more words or phrases to be uttered were at least partially correctly uttered based on the edit distance;

responsive to a determination that the one or more words or phrases were at least partially correctly uttered, causing, by the computer system, information indicating that the response is valid to be provided; and

responsive to a determination that the one or more words or phrases were not at least partially correctly uttered, causing, by the computer system, information indicating that the response is invalid to be provided.

2. The method of claim 1, wherein the e-captcha challenge comprises a math problem and the response comprises an attempted solution to the math problem.

3. The method of claim 1, wherein the e-captcha challenge comprises a question to be answered.

4. The method of claim 1, the method further comprising:

receiving, by the computer system, a request to provide the e-captcha challenge, wherein the executable instructions are provided responsive to the request, and wherein the request comprises one or more parameters that specify an e-captcha challenge to be provided; and

identifying, by the computer system, the e-captcha challenge based on the one or more parameters.

5. The method of claim 4, wherein the one or more parameters specify a subject matter of the e-captcha challenge to be provided.

6. The method of claim 4, wherein the one or more parameters further specify a level of difficulty of the e-captcha challenge.

7. The method of claim 4, wherein the one or more parameters further specify a time limit by which the response to the e-captcha challenge must be received.

8. The method of claim 1, the method further comprising:

storing, by the computer system, an indication of whether the one or more words or phrases were at least partially correctly uttered in association with identifying information that identifies a user or an end user device associated with the response; and

determining, by the computer system, a number of times that the user or the end user device associated with the response has failed or passed skill-based actions based on the stored indication, wherein the number of times indicates a proficiency of the user or the end user device at correctly completing e-captcha challenges.

9. The method of claim 1, wherein the e-captcha challenge further comprises a trivia question to be answered and wherein the response comprises an attempted answer to the trivia question.

10. The method of claim 1, wherein the e-captcha challenge further comprises an audio clip to be identified and wherein the response comprises an attempted identification of the audio clip.

11. The method of claim 1, wherein the e-captcha challenge further comprises a video clip to be identified and wherein the response comprises an attempted identification of the video clip.

12. The method of claim 1, wherein the e-captcha challenge further comprises an image to be identified and wherein the response comprises an attempted identification of the image.

13. The method of claim 1, wherein the e-captcha challenge further comprises a puzzle to be solved and wherein the response comprises an attempted solution to the puzzle.

14. A system of distinguishing between computers and humans through enhanced completely automated public turing test to tell computers and humans apart (e-captcha), comprising:

a computer system having a memory that stores computer program instructions and one or more physical processors programmed with the computer program instructions that, when executed by the memory and one or more physical processors, cause the computer system to;

provide, via the network, executable instructions configured to generate a user interface that includes an e-captcha challenge, wherein the e-captcha challenge requires-one or more words or phrases to be uttered;

receive an audio input via at least one input configured to receive the audio input, the audio input comprising a response to the e-captcha challenge;

use an automated speech recognition engine to convert the audio input to text;

determine an edit distance between the one or more words or phrases and the text converted from the audio input;

determine whether the one or more words or phrases to be uttered were was at least partially correctly uttered based on the edit distance;

responsive to a determination that the one or more words or phrases were at least partially correctly uttered, cause information indicating that the response is valid to be provided; and

responsive to a determination that the one or more words or phrases were not at least partially correctly uttered, cause information indicating that the response is invalid to be provided.

15. The system of claim 14, wherein the e-captcha challenge comprises a math problem and the response comprises an attempted solution to the math problem.

16. The system of claim 14, wherein the e-captcha challenge comprises a question to be answered.

17. The system of claim 14, wherein the computer system is further programmed to:

receive a request to provide the e-captcha challenge, wherein the executable instructions are provided responsive to the request, and wherein the request comprises one or more parameters that specify an e-captcha challenge to be provided; and

identify the e-captcha challenge based on the one or more parameters.

18. The system of claim 17, wherein the one or more parameters specify a subject matter of the e-captcha challenge.

19. The system of claim 17, wherein the one or more parameters further specify a level of difficulty of the e-captcha challenge.

20. The system of claim 17, wherein the one or more parameters further specify a time limit by which the response to the e-captcha challenge must be received.

21. The system of claim 14, wherein the computer system is further programmed to:

store an indication of whether the one or more words or phrases were at least partially correctly uttered in association with identifying information that identifies a user or an end user device associated with the response; and

determine a number of times that the user or the end user device associated with the response has failed or passed skill-based actions based on the stored indication, wherein the number of times indicates a proficiency of the user or the end user device at correctly completing e-captcha challenges.

22. The system of claim 14, wherein the e-captcha challenge further comprises a trivia question to be answered and wherein the response comprises an attempted answer to the trivia question.

23. The system of claim 14, wherein the e-captcha challenge further comprises an audio clip to be identified and wherein the response comprises an attempted identification of the audio clip.

24. The system of claim 14, wherein the e-captcha challenge further comprises a video clip to be identified and wherein the response comprises an attempted identification of the video clip.

25. The system of claim 14, wherein the e-captcha challenge further comprises an image to be identified and wherein the response comprises an attempted identification of the image.

26. The system of claim 14, wherein the e-captcha challenge further comprises a puzzle to be solved and wherein the response comprises an attempted solution to the puzzle.