Automated validation of results of human performance of tasks
First Claim
1. A computer-implemented method comprising:
- receiving, by one or more configured computing systems, information from a task requester about a task that is available for performance and that has one or more associated validation tests;
receiving, by the one or more configured computing systems, one or more results from performance of the task by one or more task performers;
applying, by the one or more configured computing systems, at least one of the validation tests associated with the task to the received one or more results;
determining, by the one or more configured computing systems, that the received one or more results are validated based at least in part on the received one or more results passing the applied validation tests; and
providing the received one or more results to the task requester.
0 Assignments
0 Petitions
Accused Products
Abstract
Techniques are described for facilitating automated validation of results of performance of tasks. In some situations, task requesters may specify various automated validation criteria for tasks that they submit, and those specified validation criteria may automatically be used to determine whether results of performance of those tasks by task performers are validated. To facilitate such automated validation, predefined types of validation criteria may be provided that a user may select and/or configure. The outcome of automated validation of results may be used in various ways, such as to indicate when results have been validated and/or have not been validated, to determine whether to provide results to a task requester (e.g., if results are not provided unless they have been validated, or if results that fail validation are corrected or replaced with results that pass validation) and/or to compensate task performers for providing the results.
-
Citations
25 Claims
-
1. A computer-implemented method comprising:
-
receiving, by one or more configured computing systems, information from a task requester about a task that is available for performance and that has one or more associated validation tests; receiving, by the one or more configured computing systems, one or more results from performance of the task by one or more task performers; applying, by the one or more configured computing systems, at least one of the validation tests associated with the task to the received one or more results; determining, by the one or more configured computing systems, that the received one or more results are validated based at least in part on the received one or more results passing the applied validation tests; and providing the received one or more results to the task requester. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A non-transitory computer-readable medium whose contents configure a computing device to perform a method comprising:
-
receiving an indication from a user of one or more tasks that are not yet performed; providing information to the user to enable the user to indicate at least one predefined type of validation criteria that is available for validating results of task performance; and after receiving an indication from the user to use one or more of the at least one predefined types of validation criteria in an indicated manner, using the indicated one or more predefined types of validation criteria in the indicated manner to validate results of performance of the one or more tasks. - View Dependent Claims (15, 16, 17, 18, 20)
-
-
19. A non-transitory computer-readable medium whose contents configure a computing device to perform a method comprising:
-
receiving an indication from a user of one or more tasks that are not yet performed; providing information to the user to enable the user to indicate at least one predefined type of validation criteria that is available for validating results of task performance; and after receiving an indication from the user to use one or more of the at least one predefined types of validation criteria in an indicated manner, using, by the configured computing device, the indicated one or more predefined types of validation criteria in the indicated manner to validate results of performance of the one or more tasks, wherein the using of the indicated one or more predefined types of validation criteria includes, after receiving one or more results from performance of the one or more tasks by one or more task performers, automatically determining whether the received one or more results are validated based at least in part on whether the received one or more results satisfy the one or more predefined types of validation criteria.
-
-
21. A computing device configured to validate results of task performance, comprising:
-
a processor; a first component that is configured to, when executed by the processor, receive information about a task that is available from a task requester and that has one or more associated validation criteria; and a second component that is configured to, when executed by the processor and after receiving one or more results from performance of the task by one or more task performers; determine to initiate applying the one or more associated validation criteria for the task to the received one or more results; and determine whether the received one or more results are validated based at least in part on the applying of the one or more associated validation criteria for the task. - View Dependent Claims (22, 23, 24, 25)
-
Specification