Systems and methods for coding competitions

• US 7,300,346 B2
• Filed: 07/29/2005
• Issued: 11/27/2007
• Est. Priority Date: 01/09/2001
• Status: Expired due to Term

• Current Assignee: TopCoder, Inc. (Wipro Limited)
• Original Assignee: TopCoder, Inc. (Wipro Limited)
• Inventors: Hughes, John M., Lydon, Michael
• Primary Examiner(s): Hotaling; John
• Assistant Examiner(s): D'AGOSTINO, PAUL ANTHONY
• Application Number:
  US11/193,019
• Publication Number:
  US 20060052886A1
• Time in Patent Office: 851 Days
• Field of Search: 463 1- 49, 2731381-309
• US Class Current: 463/9
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/06398 Performance of employee with respect to a job function
• CPC Class Codes: G06Q 20/085 involving remote charge determination or related payment systems
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0209 Incentive being awarded or redeemed in connection with the playing of a video game
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: G07F 17/32 for games, toys, sports, or amusements
• CPC Class Codes: G07F 17/3276 wherein the players compete, e.g. tournament
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F

Abstract

This invention relates to a method and apparatus for providing a coding competition. In one embodiment, a method for providing a coding competition includes transmitting a coding problem to contestants, receiving computer code created by a contestant, determining a response of the computer code to test data, and evaluating the response of the computer code to the test data. In another embodiment, a method for evaluating a skill level of a contestant includes electronically communicating a coding problem to contestants, electronically receiving a software program in response to the coding problem from one of the contestants, evaluating the received software program, awarding points to the contestant based on the received software program, and determining a rating for the contestant for the competition based on the number of points awarded to the contestant.

Claims

1. A method for evaluating participants in a competition provided over a communications network, the participant having a previous rating prior to the competition, the method comprising:

a. electronically inviting via a communications network three or more participants to participate in a competition provided over the communications network, the competition having a predetermined start time and end time;

b. electronically receiving competition data during the competition from three or more participating participants;

c. automatically performing evaluations of the received competition data from three or more participating participants at one or more respective times after the start time of the competition; and

d. determining a subsequent rating for the three or more participating participants based on their previous ratings, the evaluations, statistical attributes associated with the competition, and the number of participating participants.

2. The method of claim 1 wherein the step of electronically inviting the participants comprises transmitting an email to the three or more participants.

3. The method of claim 1 wherein the step of electronically inviting the participants comprises posting the invitation on a web site.

4. The method of claim 1 wherein the statistical attributes associated with the competition comprises an average rating for the competition based of the previous ratings of the participating participants.

5. The method of claim 1 wherein the statistical attributes associated with the competition comprises a volatility of ratings attributed to each of the three or more participating participants.

18. The method of claim 1 wherein the step of determining a subsequent rating for the participating participants further comprises adjusting the rating in smaller increments as the frequency that the participating participants is rated increases.

19. The method of claim 1 wherein the step of determining the subsequent rating for the participating participants is further in response to the previous ratings of the participating participants prior to the competition.

20. The method of claim 19 wherein the step of determining the subsequent rating for the participating participants is further in response to the ratings of other participating participants during the competition.

6. A method for evaluating participants in an competition provided over a communication network, the participant having a previous rating prior to the competition, the method comprising:

a. electronically inviting three or more participants to participate in the competition via a communication network, the competition having a predetermined start time and end time;

b. electronically receiving competition data during the competition from three or more participating participants;

c. automatically performing evaluations of the received competition data from three or more participating participants at one or more respective times after the start time of the competition; and

d. determining a subsequent rating for the three or more participating participants based on their previous ratings and the evaluations.

7. The method of claim 6 wherein the step of electronically inviting the participants comprises transmitting an email to the three or more participants.

8. The method of claim 6 wherein the step of electronically inviting the participants comprises posting the invitation on a web site.

9. The method of claim 6 wherein step (d) further comprises determining an average rating for the competition based on previous ratings of the participating participants and a total number of participants participating in the competition.

10. The method of claim 9 wherein step (d) further comprises determining a competition factor for the competition based on at least one of previous ratings of the participating participants, a total number of participants participating in the competition, and volatility of the ratings of the participating participants.

11. The method of claim 10 wherein step (d) further comprises determining a skill for the participating participants based on the previous rating of the participating participants.

12. The method of claim 11 wherein step (d) further comprises determining a deviation value for each of the participating participants relative to other participating participants based on the volatility of the ratings of the participating participants.

13. The method of claim 12 wherein step (d) further comprises estimating a probability of awarding a participating participant a higher rating than another participating participant in the competition.

14. The method of claim 13 wherein step (d) further comprises calculating at least one of an expected performance, an expected rank, and an actual performance for the participating participants.

15. The method of claim 14 wherein step (d) further comprises calculating a new rating volatility of the participating participants.

16. The method of claim 15 further comprising determining a maximum rating increase for the participating participants.

17. The method of claim 16 further comprising determining a weighting effect of the competition for the participating participants.

21. A system for evaluating a skill level of participants in a competition, the participants having a previous rating prior to the competition, the system comprising:

a. a client interface server for electronically communicating an invitation to participate in a contest to three or more participants, the contest having a start time and an end time;

b. an evaluation engine in communication with the client interface for automatically evaluating contest data submitted by three or more participating participants in response to the invitation at one or more times during the competition; and

c. a rating engine for assigning a subsequent rating to three or more participating participants in response to the evaluation and the previous rating of the participating participants.

22. The system of claim 21 wherein the rating engine further calculates an average rating for the competition based on the previous ratings of the participating participants and a total number of participants participating in the competition.

23. The system of claim 22 wherein the rating engine further calculates a competition factor for the competition based on at least one of the previous ratings of the participating participants, a total number of participants receiving the invitation, and the volatility of the previous ratings of the participating participants.

24. The system of claim 23 wherein the rating engine further calculates a skill for the one of the participating participants based on the previous rating of the one of the participating participants.

25. The system of claim 24 wherein the rating engine further calculates a deviation value for the participating participants relative to other participating participants based on the volatility of the previous ratings of the participating participants.

26. The system of claim 25 wherein the rating engine further estimates a probability of awarding the one of the participating participants a higher rating than other participants participating in the competition.

27. The system of claim 26 wherein the rating engine further calculates at least one of an expected performance, an expected rank, and an actual performance for the participating participants.

28. The system of claim 27 wherein the rating engine further calculates a subsequent volatility of the rating for the participating participants.

29. The system of claim 28 wherein the rating engine further calculates a maximum rating increase for the participating participants.

30. The system of claim 29 wherein the rating engine further calculates a weighting effect of the competition for the participating participants.

31. The system of claim 29 wherein the rating engine adjusts the rating in smaller increments as the frequency that the participating participants is rated increases.

32. The system of claim 21 wherein the rating engine assigns the subsequent rating to the participating participants in response to the evaluations of the data submitted by the participating participant during the competition and the previous ratings of other participants participating in the competition.