Closed loop voting feedback

• US 8,566,144 B2
• Filed: 03/31/2005
• Issued: 10/22/2013
• Est. Priority Date: 03/31/2005
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Round, Matthew J., Gadre, Aniruddha
• Primary Examiner(s): FEENEY, BRETT A
• Application Number:
  US11/098,008
• Publication Number:
  US 20060224442A1
• Time in Patent Office: 3,127 Days
• Field of Search: None
• US Class Current: 705/7.38
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

Embodiments of the present invention provide a system and method for providing reviewer feedback identifying a correlation between a reviewer'"'"'s past voting record and successful results. Based on a reviewer'"'"'s past record, the reviewer may be assigned a power rating identifying the statistical accuracy of the reviewer'"'"'s voting history. That power rating may be used to weight future votes, thereby increasing the likelihood that accurate decisions will be made.

Claims

1. A non-transitory computer-accessible medium having instructions stored thereon that, in response to execution by a computing system having a processor and a memory, cause the computing system to:

receive a first plurality of votes corresponding to a decision to be made with respect to an object, wherein at least one of the first plurality of votes is a first vote received from a reviewer;

based at least in part on the first plurality of received votes, determine a first action to take with respect to the object;

receive a second plurality of votes corresponding to the decision to be made with respect to the object, wherein at least one of the second plurality of votes is a second vote received from the reviewer;

based at least in part on the second plurality of received votes, determine a second action to take with respect to the object;

receive a performance review of the object;

update a voting results average for the reviewer based at least in part the performance review, the voting results average being a function of a plurality of previously reviewed objects upon which the reviewer has voted;

update a total voting timeliness average for the reviewer based at least in part on a voting timeliness of the one of the first plurality of received votes and a voting timeliness of the one of the second plurality of received votes;

update a total voting consistency average for the reviewer based at least in part on;

a consensus between the one of the first plurality of received votes and a remainder of the first plurality of received votes excluding the one of the first plurality of received votes; and

a consensus between the one of the second plurality of received votes and a remainder of the second plurality of received votes excluding the one of the second plurality of received votes; and

calculate a power rating of the reviewer as a function of;

the voting results average for the reviewer, the total voting timeliness average for the reviewer, and the total voting consistency average for the reviewer.

2. The non-transitory computer-accessible medium of claim 1, wherein the object is a job candidate.

3. The non-transitory computer-accessible medium of claim 1, wherein the power rating of the reviewer is used to weight votes received from the reviewer.

4. The non-transitory computer-accessible medium of claim 1, wherein the power rating of the reviewer is subject to change based at least in part on future votes received from the reviewer.

5. The non-transitory computer-accessible medium of claim 1, further comprising instructions that direct the computing system to:

determine a third action to take with respect to the object based at least in part on the first and second votes received from the reviewer, wherein the first and second votes received from the reviewer are weighted by the power rating of the reviewer, and the third action to take is selected from a group consisting of pursuing the object, rejecting the object, and holding the object for a determination at a later time.

6. The non-transitory computer-accessible medium of claim 1, wherein the instructions further cause the computing system to generate a report embodying at least one of the total voting consistency average, the total voting timeliness average, the voting results average, or the power rating.

7. The non-transitory computer-accessible medium of claim 1, wherein the total voting timeliness average is based at least in part on a plurality of voting timeliness scores calculated as a function of a respective one of a plurality of previously cast votes.

8. The non-transitory computer-accessible medium of claim 7, wherein the voting timeliness scores are weighted according to a respective one of a plurality of previous decisions.

9. The non-transitory computer-accessible medium of claim 1, wherein the total voting consistency average is based at least in part on a plurality of voting consistency scores calculated as a function of a respective one of a plurality of previously cast votes.

10. The non-transitory computer-accessible medium of claim 9, wherein the voting consistency scores are weighted according to a respective one of a plurality of previous decisions.

11. The non-transitory computer-accessible medium of claim 1, wherein determining the first action or the second action comprises determining whether a voting score meets a predefined threshold.

12. The non-transitory computer-accessible medium of claim 5, wherein determining the third action comprises determining whether a voting score meets a predefined threshold.

13. The non-transitory computer-accessible medium of claim 1, wherein the first vote or the second vote is weighted as a function of a previously calculated power rating.

14. A method for determining an action to take with respect to an object, the method comprising:

receiving, by a computing device, a plurality of votes from a plurality of reviewers corresponding to a decision to be made with respect to the object;

acquiring, by the computing device, after taking the decision, a performance review of the object;

updating, by the computing device, a voting results average for one of the reviewers based at least in part the performance review, the voting results average being a function of a plurality of previously reviewed objects upon which the one of the reviewers has voted;

updating a total voting timeliness average for the one of the reviewers based at least in part on a voting timeliness of the object;

updating a total voting consistency average for the one of the reviewers based at least in part on a one of the votes cast by the one of the reviewers and the plurality of votes;

determining, by the computing device, a power rating for the one of the reviewers based at least in part on the voting results average for the one of the reviewers, the total voting timeliness average for the one of the reviewers, and the total voting consistency average for the one of the reviewers; and

determining, by the computing device, the action to take with respect to the object based at least in part on the plurality of votes received from the plurality of reviewers, wherein the one of the votes cast by one of the reviewers is weighted in accordance with the power rating of the one of the reviewers.

15. The method of claim 14, wherein the object is a job candidate.

16. The method of claim 14, wherein the total voting timeliness average is a calculated average value based at least in part on an average punctuality of all votes cast by the one of the reviewers.

17. The method of claim 14, wherein the power rating for the one of the reviewers is subject to change based at least in part on future votes received from the one of the reviewers.

18. The method of claim 14, wherein the action to take is selected from a group consisting of pursuing the object, rejecting the object, and holding the object for a determination at a later time.

19. The method of claim 14, further comprising generating, by the computing device, a report embodying at least one of the total voting consistency average, the total voting timeliness average, the voting results average, or the power rating.

20. The method of claim 14, wherein the total voting timeliness average is based at least in part on a plurality of voting timeliness scores calculated as a function of a respective one of a plurality of previously cast votes.

21. The method of claim 20, wherein the voting timeliness scores are weighted according to a respective one of a plurality of previous decisions.

22. The method claim 14, wherein the total voting consistency average is based at least in part on a plurality of voting consistency scores calculated as a function of a respective one of a plurality of previously cast votes.

23. The method claim 22, wherein the voting consistency scores are weighted according to a respective one of a plurality of previous decisions.

24. The method of claim 14, wherein determining the action comprises determining whether a voting score meets a predefined threshold.

28. The system of claim 18, wherein the power rating for the one of the reviewers is used to weight votes received from the one of the reviewers.

29. The system of claim 18, wherein the power rating for the one of the reviewers changes based at least in part on future votes cast by the one of the reviewers.

25. A system, comprising:

at least one computing device;

an application executable in the at least one computing device, comprising;

logic that obtains a plurality of votes from a plurality of reviewers corresponding to a decision to be made with respect to an object;

logic that obtains, after taking the decision, a performance review of the object;

logic that updates a voting results average for one of the reviewers based at least in part the performance review, the voting results average being a function of a plurality of previously reviewed objects upon which the one of the reviewers has voted;

logic that updates a total voting timeliness average for the one of the reviewers based at least in part on a voting timeliness of the object;

logic that updates a total voting consistency average for the one of the reviewers based at least in part on a one of the votes cast by the one of the reviewers and the plurality of votes;

logic that calculates a power rating for one of the reviewers based at least in part on the voting results average for the one of the reviewers, the total voting timeliness average for the one of the reviewers, and the total voting consistency average for the one of the reviewers; and

logic that determines an action to take with respect to the object based at least in part on the plurality of votes received from the plurality of reviewers, wherein the one of the votes from the one of the reviewers is weighted in accordance with the power rating of the one of the reviewers.

26. The system of claim 25, wherein the object is a job candidate.

27. The system of claim 25, wherein the total voting timeliness average for the one of the reviewers is a calculated average value based at least in part on an average punctuality of all votes cast by the one of the reviewers.

30. The system of claim 25, wherein the action to take is selected from a group consisting of pursuing the object, rejecting the object, and holding the object for a determination at a later time.

31. The system of claim 25, wherein the total voting timeliness average is based at least in part on a plurality of voting timeliness scores calculated as a function of a respective one of a plurality of previously cast votes, the voting timeliness scores being weighted according to a respective one of a plurality of previous decisions.

32. The system of claim 25, wherein the total voting consistency average is based at least in part on a plurality of voting consistency scores calculated as a function of a respective one of a plurality of previously cast votes, the voting consistency scores being weighted according to a respective one of a plurality of previous decisions.

33. The system of claim 25, wherein the logic that determines the action comprises logic that determines whether a voting score meets a predefined threshold.