TECHNIQUES FOR CREATING MICROTASKS FOR CONTENT PRIVACY PRESERVATION

• US 20120054112A1
• Filed: 08/30/2010
• Published: 03/01/2012
• Est. Priority Date: 08/30/2010
• Status: Abandoned Application

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Gormish, Michael J., Erol, Berna, Moraleda, Jorge, Bailloeul, Timothee, Liu, Xu, Stork, David G.
• Application Number:
  US12/871,665
• Publication Number:
  US 20120054112A1
• Time in Patent Office: Days
• US Class Current: 705/301
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/103 Workflow collaboration or project management

Abstract

Techniques for performing a task while preserving the privacy or confidentiality of information used as input for the task. In one embodiment the task is broken down into smaller tasks (called subtasks or microtasks), which are then outsourced. The input information for each microtask is based upon and is generally a subset of the input information received for the task. The determination of microtasks for the task is performed in such a manner that constraints associated with the task are satisfied. For example, microtasks may be determined for the task based upon risk (e.g., the risk associated with the privacy or confidentiality of the input information being compromised as a result of the outsourcing), quality constraints (e.g., desired quality of the work product resulting from performance of the task), cost constraints, and other constraints associated with the job.

Claims

1. A computer-readable storage medium storing a plurality of instructions for controlling a computer system, the plurality of instructions comprising:

instructions that cause the computer system to receive information identifying a task and input information for the task;

instructions that cause the computer system to determine a risk threshold for the task;

instructions that cause the computer system to determine, based upon the risk threshold, a plurality of microtasks for performing the task, each microtask associated with a portion of the input information;

instructions that cause the computer system to distribute the plurality of microtasks to a plurality of workers;

instructions that cause the computer system to receive a plurality of work products resulting from performance of the plurality of microtasks by the plurality of workers; and

instructions that cause the computer system to generate a final work product for the task based upon the plurality of work products resulting from performance of the plurality of microtasks.

2. The computer-readable storage medium of claim 1 wherein the instructions that cause the system to determine the plurality of microtasks comprise instructions that cause the computer system to segment the input information into a set of segments based upon the risk threshold, each segment comprising a portion of the input information.

3. The computer-readable storage medium of claim 2 wherein the instructions that cause the system to determine the plurality of microtasks further comprise instructions that cause the computer system to generate a combined segment based upon the set of segments and the risk threshold, the combined segment comprising information from at least one segment from the set of segments and additional data not included in the input information.

4. The computer-readable storage medium of claim 2 wherein the instructions that cause the system to determine the plurality of microtasks further comprise:

instructions that cause the computer system to generate a set of combined segments based upon the set of segments, the set of combined segments comprising at least one combined segment comprising information from at least two different segments from the set of segments; and

instructions that cause the computer system to determine the plurality of microtasks based upon the set of combined segments.

5. The computer-readable storage medium of claim 4 wherein:

the input information comprises a first document and a second document;

the set of segments comprises a first segment comprising a portion of the first document and a second segment comprising a portion of the second document;

the set of combined segments comprises a first combined segment comprising contents of the first segment and the second segment;

the plurality of microtasks comprises a first microtask to be performed using the first combined segment as input.

6. The computer-readable storage medium of claim 1 wherein the plurality of instructions further comprises:

instructions that cause the computer system to output a quality estimate for the final work product, wherein the quality estimate is based upon quality estimates associated with the plurality of work products resulting from performance of the plurality of microtasks.

7. The computer-readable storage medium of claim 6 wherein the plurality of instructions further comprises:

instructions that cause the computer system to determine, based upon the quality estimate, if a second set of microtasks is to be determined for the task.

8. The computer-readable storage medium of claim 1 wherein the plurality workers comprises at least one human worker.

9. The computer-readable storage medium of claim 1 wherein:

the plurality of instructions further comprises instructions that cause the computer system to determine a quality threshold for the task; and

the instructions that cause the computer system to determine the plurality of microtasks comprise instructions that cause the computer system to determine the plurality of microtasks based upon the risk threshold and the quality threshold.

10. The computer-readable storage medium of claim 1 wherein the instructions that cause the computer system to generate the final work product comprise instructions that cause the computer system to combine a first work product resulting from performance of a first microtask by a human worker and a second work product resulting from performance of a second microtask by a machine worker.

11. The computer-readable storage medium of claim 1 wherein the input information is an image and the task is to recognize a set of words or objects in the image.

12. The computer-readable storage medium of claim 1 wherein the input information is an image and the task is to provide a symbolic representation of the image.

13. A system comprising:

a memory configured to store input information for a task to be performed; and

a processor coupled with the memory, the processor configured to;

determine a risk threshold for the task;

determine, based upon the risk threshold, a plurality of microtasks for performing the task, each microtask associated with a portion of the input information;

cause the plurality of microtasks to be distributed to a plurality of workers;

receive a plurality of work products resulting from performance of the plurality of microtasks by the plurality of workers; and

generate a final work product for the task based upon the plurality of work products resulting from performance of the plurality of microtasks.

14. The system of claim 13 wherein the processor is configured to:

segment the input information into a set of segments based upon the risk threshold, each segment comprising a portion of the input information; and

generate a combined segment based upon the set of segments and the risk threshold, the combined segment comprising information from at least one segment from the set of segments and additional data not included in the input information.

15. The system of claim 13 wherein the processor is configured to:

segment the input information into a set of segments based upon the risk threshold, each segment comprising a portion of the input information; and

generate a set of combined segments based upon the set of segments, the set of combined segments comprising at least one combined segment comprising information from at least two different segments from the set of segments; and

determine the plurality of microtasks based upon the set of combined segments.

16. The system of claim 15 wherein:

the input information comprises a first document and a second document;

the set of segments comprises a first segment comprising a portion of the first document and a second segment comprising a portion of the second document;

the set of combined segments comprises a first combined segment comprising contents of the first segment and the second segment;

the plurality of microtasks comprises a first microtask to be performed using the first combined segment as input.

17. The system of claim 13 wherein the processor is configured to output a quality estimate for the final work product, wherein the quality estimate is based upon quality estimates associated with the plurality of work products resulting from performance of the plurality of microtasks.

18. The system of claim 17 wherein the processor is configured to determine, based upon the quality estimate, if a second set of microtasks is to be determined for the task.

19. The system of claim 13 wherein the plurality workers comprises at least one human worker.

20. The system of claim 13 wherein the processor is configured to generate the final work product by combining a first work product resulting from performance of a first microtask by a human worker and a second work product resulting from performance of a second microtask by a machine worker.

21. The system of claim 13 wherein the input information is an image and the task is to recognize a set of words or objects in the image.

22. A method comprising:

receiving, by a processing system, information identifying a task and input information for the task;

determining, by the processing system, a risk threshold for the task;

determining, by the v system, based upon the risk threshold, a plurality of microtasks for performing the task, each microtask associated with a portion of the input information;

causing the plurality of microtasks to be distributed to a plurality of workers;

receiving, by the processing system, a plurality of work products resulting from performance of the plurality of microtasks by the plurality of workers; and

generating, by the processing system, a final work product for the task based upon the plurality of work products resulting from performance of the plurality of microtasks.