×

System and method for validating natural language content using crowdsourced validation jobs

  • US 10,504,522 B2
  • Filed: 03/19/2018
  • Issued: 12/10/2019
  • Est. Priority Date: 09/07/2015
  • Status: Active Grant
First Claim
Patent Images

1. A computer-implemented method, the method being implemented in a computer system having one or more physical processors programmed with computer program instructions that, when executed by the one or more physical processors, program the computer system to perform the method, the method comprising:

  • obtaining, by the computer system, a transcription pair comprising natural language content and text, wherein the natural language content comprises audio content received from one or more audio input components, and wherein the text corresponds to a transcription of the natural language content;

    creating, by the computer system, a first crowdsourced validation job to be performed at one or more first validation devices, the first crowdsourced validation job comprising first instructions for a crowd user to provide an indication of an accuracy of the transcription of the natural language content;

    causing, by the computer system, the transcription pair and the first crowdsourced validation job to be provided to the one or more first validation devices;

    receiving, by the computer system, at least a first response from at least a first validation device from among the one or more first validation devices, wherein the first response includes a first indication of an accuracy of the transcription of the natural language content; and

    storing, by the computer system, the transcription pair in a validated transcription library based, at least in part, on the first response.

View all claims
  • 5 Assignments
Timeline View
Assignment View
    ×
    ×