IDENTIFYING EFFECTIVE CROWDSOURCE CONTRIBUTORS AND HIGH QUALITY CONTRIBUTIONS
First Claim
1. A computer system comprising:
- at least one processor; and
memory storing instructions that, when executed by the at least one processor, cause the system to;
determine a concept space for a new contribution from a contributor to a crowdsourced repository;
obtain previously correct contributions of the contributor in the concept space;
obtain previously incorrect contributions of the contributor in the concept space;
determine an expertise confidence score for the new contribution based on a comparison of the new contribution with the previously correct contributions and the previously incorrect contributions; and
automatically approve the new contribution for the crowdsourced repository based on whether a threshold is met based on the expertise confidence score.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are disclosed for targeting effective contributors and identifying high quality contributions. For example, a method may include displaying an advertisement to a potential contributor via an advertising platform, receiving an indication that the potential contributor responded to the advertisement, generating a crowdsourcing exercise that is presented to the contributor, receiving a response (a conversion event) from the contributor to the crowdsourcing exercise, and notifying the advertising platform about the conversion event. As another example, a method may include determining a concept space for a new contribution, obtaining previously correct and incorrect contributions of the contributor in the concept space, and determining an expertise confidence score for the new contribution based on a comparison of the new contribution with the previously correct and incorrect contributions. The method may include automatically approving the new contribution for the crowdsourced repository based on the expertise confidence score.
32 Citations
22 Claims
-
1. A computer system comprising:
-
at least one processor; and memory storing instructions that, when executed by the at least one processor, cause the system to; determine a concept space for a new contribution from a contributor to a crowdsourced repository; obtain previously correct contributions of the contributor in the concept space; obtain previously incorrect contributions of the contributor in the concept space; determine an expertise confidence score for the new contribution based on a comparison of the new contribution with the previously correct contributions and the previously incorrect contributions; and automatically approve the new contribution for the crowdsourced repository based on whether a threshold is met based on the expertise confidence score. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method comprising:
-
determining, using at least one processor formed in a substrate, a contribution type for a new contribution from a contributor to a crowdsourced repository, obtaining a first positive feature set of prior correct contributions from the contributor for the contribution type; obtaining a first negative feature set of prior incorrect contributions from the contributor for the contribution type; determining, using the at least one processor, a first expertise confidence score for the new contribution based on a comparison of the new contribution with the first positive feature set and the first negative feature set; determining a taxonomy classification for the new contribution; obtaining a second positive feature set of prior correct contributions from the contributor for the taxonomy classification; obtaining a second negative feature set of prior incorrect contributions from the contributor for the taxonomy classification; determining, using the at least one processor, a second expertise confidence score for the new contribution based on a comparison of the new contribution with the second positive feature set and with the second negative feature set; determining a contribution confidence score based on a combination of the first expertise confidence score and the second expertise confidence score; and automatically adding the new contribution to active contributions for the crowdsourced repository based on whether the contribution confidence score meets a threshold. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A method comprising:
-
providing information to an advertising platform, the advertising platform using the information to determine potential contributors for a crowdsourced repository and to display an advertisement to the potential contributors; receiving, using at least one processor formed in a substrate, an indication that a contributor of the potential contributors responded to the advertisement; generating, using the at least one processor, a crowdsourcing exercise that is presented to the contributor; determining that a conversion event occurred for the contributor in response to receiving a response from the contributor to the crowdsourcing exercise; and notifying the advertising platform that the conversion event occurred for the contributor. - View Dependent Claims (17, 18, 19, 20, 21, 22)
-
Specification