System and method for automated and objective assessment of programming language code
First Claim
1. A method of evaluating a software program, the method comprising:
- receiving, by an evaluation computing device, a proposed problem application, a master solution associated with the proposed problem application, a score value for each of one or more solution attributes associated with the proposed problem application, and a submitted response to the proposed problem application;
identifying, by the evaluation computing device, the one or more solution attributes in the master solution and corresponding one or more response attributes in the submitted response to the proposed problem application;
generating, by the evaluation computing device, one or more master test case outputs corresponding to one or more first test cases, and a scoring profile for the proposed problem application based on the received score value for each of the one or more solution attributes, wherein the one or more first test cases are based on the identified one or more solution attributes in the master solution, and comprise one or more static test cases;
generating, by the evaluation computing device, one or more submitted response test case outputs by applying the generated one or more first test cases to the corresponding one or more response attributes in the submitted response to the proposed problem application;
comparing, by the evaluation computing device, the one or more submitted response test case outputs with the corresponding one or more master test case outputs; and
providing, by the evaluation computing device, an assessment of the submitted response to the proposed problem application based on the comparison of the one or more submitted response test case outputs with the corresponding one or more master case outputs, the assessment comprising an overall score based on applying the scoring profile to the one or more submitted response test case outputs.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method of evaluating a software program is disclosed. Information of a proposed problem is received from a user via the user interface and a problem profile associated with the proposed problem is created. A master software solution associated with the proposed problem is processed to identify one or more attributes, such as a first identified attribute. One or more first test cases associated with the first identified attribute in the master software solution are generated. An evaluation program including at least the one or more generated first test cases is generated. The generated evaluation program is configured to be applied to at least one submitted software program that is to be evaluated. At least the one or more first test cases is configured to be applied as one or more test inputs to a corresponding attributes in the submitted software program.
16 Citations
27 Claims
-
1. A method of evaluating a software program, the method comprising:
-
receiving, by an evaluation computing device, a proposed problem application, a master solution associated with the proposed problem application, a score value for each of one or more solution attributes associated with the proposed problem application, and a submitted response to the proposed problem application; identifying, by the evaluation computing device, the one or more solution attributes in the master solution and corresponding one or more response attributes in the submitted response to the proposed problem application; generating, by the evaluation computing device, one or more master test case outputs corresponding to one or more first test cases, and a scoring profile for the proposed problem application based on the received score value for each of the one or more solution attributes, wherein the one or more first test cases are based on the identified one or more solution attributes in the master solution, and comprise one or more static test cases; generating, by the evaluation computing device, one or more submitted response test case outputs by applying the generated one or more first test cases to the corresponding one or more response attributes in the submitted response to the proposed problem application; comparing, by the evaluation computing device, the one or more submitted response test case outputs with the corresponding one or more master test case outputs; and providing, by the evaluation computing device, an assessment of the submitted response to the proposed problem application based on the comparison of the one or more submitted response test case outputs with the corresponding one or more master case outputs, the assessment comprising an overall score based on applying the scoring profile to the one or more submitted response test case outputs. - View Dependent Claims (2, 3, 4, 5, 6, 7, 22, 25)
-
-
8. A non-transitory computer readable medium having stored thereon instructions for evaluating a software program, comprising machine executable code which when executed by at least one processor, causes the processor to perform steps comprising:
-
receiving a proposed problem application, a master solution associated with the proposed problem application, a score value for each of one or more solution attributes associated with the proposed problem application, and a submitted response to the proposed problem application; identifying one or more solution attributes in the master solution and corresponding one or more response attributes in the submitted response to the proposed problem application; generating one or more master test case outputs corresponding to one or more first test cases, and a scoring profile for the proposed problem application based on the received score value for each of the one or more solution attributes, wherein the one or more first test cases are based on the identified one or more solution attributes in the master solution, and comprise one or more static test cases; generating one or more submitted response test case outputs by applying the generated one or more first test cases to the corresponding one or more response attributes in the submitted response to the proposed problem application; comparing the one or more submitted response test case outputs with the corresponding one or more master test case outputs; and providing an assessment of the submitted response to the proposed problem application based on the comparison of the one or more submitted response test case outputs with the corresponding one or more master case outputs, the assessment comprising an overall score based on applying the scoring profile to the one or more submitted response test case outputs. - View Dependent Claims (9, 10, 11, 12, 13, 14, 23, 26)
-
-
15. An evaluation computing device comprising:
-
one or more processors; a memory, wherein the memory is coupled to one or more processors which are configured to be capable of executing programmed comprising and stored in the memory to; receive a proposed problem application, a master solution associated with the proposed problem application, a score value for each of one or more solution attributes associated with the proposed problem application, and a submitted response to the proposed problem application; identify one or more solution attributes in the master solution and corresponding one or more response attributes in the submitted response to the proposed problem application; generate one or more master test case outputs corresponding to one or more first test cases, and a scoring profile for the proposed problem application based on the received score value for each of the one or more solution attributes, wherein the one or more first test cases are based on the identified one or more solution attributes in the master solution, and comprise one or more static test cases; generate one or more submitted response test case outputs by applying the generated one or more first test cases to the corresponding one or more response attributes in the submitted response to the proposed problem application; compare the one or more submitted response test case outputs with the corresponding one or more master test case; and provide an assessment of the submitted response to the proposed problem application based on the comparison of the one or more submitted response test case outputs with the corresponding one or more master case outputs, the assessment comprising an overall score based on applying the scoring profile to the one or more submitted response test case outputs. - View Dependent Claims (16, 17, 18, 19, 20, 21, 24, 27)
-
Specification