Managing Crowdsourcing Environments
First Claim
1. A method comprising:
- receiving, by a processor of an information processing system and from a computing device corresponding to at least one customer associated with a task to be crowdsourced, wherein an information set associated with the task comprises at least;
a description of the task;
a reward to be provided for completion of the task; and
at least one adjudication rule for accepting a task result received from a worker system;
identifying a plurality of sub-tasks of the task, wherein the task comprises a workflow having multiple steps, each step in the workflow comprising at least one sub-task;
transmitting, from the information processing system, one or more notifications regarding the task and availability of the reward to a set of one or more worker systems;
receiving, at the information processing system and from at least one of the worker systems in the set, at least one task result associated with one of the sub-tasks;
comparing, by the processor, the task result against the adjudication rule to determine whether the task result conforms to an acceptable degree of accuracy; and
upon assessing satisfaction of the adjudication rule, providing the reward to at least one of the worker systems from which a conforming task result was received.
8 Assignments
0 Petitions
Accused Products
Abstract
One or more embodiments manage web-based crowdsourcing of tasks to an unrelated group of workers. An information set associated with a task to be crowdsourced is received from at least one customer that is associated with the task. This information set comprises at least a description of the task, a reward to be provided for completion of the task, and at least one adjudication rule for accepting a task result. At least one advertising campaign for the task is created based on the information set. The advertising campaign is published for access by a set of one or more worker systems. At least one task result associated with the task is received from at least one of the set of one or more of the worker systems. The task result is compared against the rule. Task results are received and compared to the adjudication rule until the rule is satisfied.
39 Citations
20 Claims
-
1. A method comprising:
-
receiving, by a processor of an information processing system and from a computing device corresponding to at least one customer associated with a task to be crowdsourced, wherein an information set associated with the task comprises at least; a description of the task; a reward to be provided for completion of the task; and at least one adjudication rule for accepting a task result received from a worker system; identifying a plurality of sub-tasks of the task, wherein the task comprises a workflow having multiple steps, each step in the workflow comprising at least one sub-task; transmitting, from the information processing system, one or more notifications regarding the task and availability of the reward to a set of one or more worker systems; receiving, at the information processing system and from at least one of the worker systems in the set, at least one task result associated with one of the sub-tasks; comparing, by the processor, the task result against the adjudication rule to determine whether the task result conforms to an acceptable degree of accuracy; and upon assessing satisfaction of the adjudication rule, providing the reward to at least one of the worker systems from which a conforming task result was received. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. One or more computer-readable non-transitory storage media embodying software comprising instructions operable when executed to:
-
receive, from a computing device corresponding to at least one customer associated with a task to be crowdsourced, wherein an information set associated with the task comprises at least; a description of the task; a reward to be provided for completion of the task; and at least one adjudication rule for accepting a task result received from a worker system; identify a plurality of sub-tasks of the task, wherein the task comprises a workflow having multiple steps, each step in the workflow comprising at least one sub-task; transmit one or more notifications regarding the task and availability of the reward to a set of one or more worker systems; receive, from at least one of the worker systems in the set, at least one task result associated with one of the sub-tasks; compare the task result against the adjudication rule to determine whether the task result conforms to an acceptable degree of accuracy; and upon assessing satisfaction of the adjudication rule, provide the reward to at least one of the worker systems from which a conforming task result was received. - View Dependent Claims (17, 18, 19)
-
-
20. A system comprising one or more processors and a memory coupled to the processors comprising instructions executable by the processors, the processors being operable when executing the instructions to:
-
receive, from a computing device corresponding to at least one customer associated with a task to be crowdsourced, wherein an information set associated with the task comprises at least; a description of the task; a reward to be provided for completion of the task; and at least one adjudication rule for accepting a task result received from a worker system; identify a plurality of sub-tasks of the task, wherein the task comprises a workflow having multiple steps, each step in the workflow comprising at least one sub-task; transmit one or more notifications regarding the task and availability of the reward to a set of one or more worker systems; receive, from at least one of the worker systems in the set, at least one task result associated with one of the sub-tasks; compare the task result against the adjudication rule to determine whether the task result conforms to an acceptable degree of accuracy; and upon assessing satisfaction of the adjudication rule, provide the reward to at least one of the worker systems from which a conforming task result was received.
-
Specification