SYSTEMS AND METHODS TO CONTROL WORK PROGRESS FOR CONTENT TRANSFORMATION BASED ON NATURAL LANGUAGE PROCESSING AND/OR MACHINE LEARNING
First Claim
1. A computer-implemented method, comprising:
- collecting, in a computing apparatus, data about works to transform text-based content, information about workers performing the works, and ratings of work outputs provided by the workers;
generating, by the computing apparatus using the data, the information and the ratings and using natural language processing techniques and machine learning techniques, indicators ofcompleteness of work outputs corresponding to works, capacity of workers, anddegrees of matching between works and workers;
assigning, by the computing apparatus, works to workers based on the indicators; and
automating, by the computing apparatus, quality assurance check and work time limit management using at least some of the indicators.
6 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are provided to compute indicators of completeness of the work output of a transformation of text-based content, worker capacity in performing the transformation, and/or the degree of matching between a unit of work and a worker, based on information collected about complexity of works, times and throughput of workers, rating of work outputs and using natural language processing techniques and machine learning techniques, such as language detection, longest common substring, length ratio, document similarity, etc. The indicators are utilized to optimize job pickup and output submission for online crowdsourcing tasks related to transformation of text-based content, such as transcription, translation, proofreading, etc.
-
Citations
20 Claims
-
1. A computer-implemented method, comprising:
-
collecting, in a computing apparatus, data about works to transform text-based content, information about workers performing the works, and ratings of work outputs provided by the workers; generating, by the computing apparatus using the data, the information and the ratings and using natural language processing techniques and machine learning techniques, indicators of completeness of work outputs corresponding to works, capacity of workers, and degrees of matching between works and workers; assigning, by the computing apparatus, works to workers based on the indicators; and automating, by the computing apparatus, quality assurance check and work time limit management using at least some of the indicators. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A computing apparatus, comprising:
-
at least one processor; and a memory storing instructions configured to instruct the at least one processor to; collect data about works to transform text-based content, information about workers performing the works, and ratings of work outputs provided by the workers; generate, using the data, the information and the ratings and using natural language processing techniques and machine learning techniques, indicators of completeness of work outputs corresponding to works, capacity of workers, and degrees of matching between works and workers; assign works to workers based on the indicators; and automate quality assurance check and work time limit management using at least some of the indicators.
-
-
20. A non-transitory computer-storage medium storing instructions configured to instruct a computing apparatus to perform at least:
-
collecting, in the computing apparatus, data about works to transform text-based content, information about workers performing the works, and ratings of work outputs provided by the workers; generating, by the computing apparatus using the data, the information and the ratings and using natural language processing techniques and machine learning techniques, indicators of completeness of work outputs corresponding to works, capacity of workers, and degrees of matching between works and workers; assigning, by the computing apparatus, works to workers based on the indicators; and automating, by the computing apparatus, quality assurance check and work time limit management using at least some of the indicators.
-
Specification