Method and apparatus for evaluating software

• US 7,735,064 B2
• Filed: 12/14/2001
• Issued: 06/08/2010
• Est. Priority Date: 12/15/2000
• Status: Active Grant

• Current Assignee: United States Postal Service (Government of the United States of America)
• Original Assignee: United States Postal Service (Government of the United States of America)
• Inventors: Hunt, Charles B., Jamieson, Harry D.
• Primary Examiner(s): Bullock, Jr.; Lewis A
• Assistant Examiner(s): Yaary; Michael
• Application Number:
  US10/450,497
• Publication Number:
  US 20040031021A1
• Time in Patent Office: 3,098 Days
• Field of Search: 717128-164, 717125-135, 705/7, 705/402, 705/406, 705/209, 703/2, 700/219, 714/38, 702/123
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3668 Software testing software testing in telephone exchanges H04M3/242, testing of hardware G06F11/22

Abstract

A method and system for evaluating software includes generating a test deck (310), where the test deck is formulated to test the software for compliance with delivery system operation procedures (315), processing the test deck with the software, and grading the performance of the software for compliance with delivery system operation procedures (320).

Claims

1. A method for evaluating software comprising:

generating a test deck, wherein the test deck is formulated to test the software for compliance with delivery system operation procedures;

processing the test deck with the software; and

grading the performance of the software for compliance with delivery system operation procedures,

wherein generating the test deck comprises;

selecting at least one delivery system operation procedure with which to test the software for compliance;

selecting a test deck programming module with which to generate the test deck, the test deck programming module formulated to generate the test deck to test the software for compliance with the at least one delivery system operation procedure; and

creating the test deck using the test deck programming module.

2. The method of claim 1, wherein processing the test deck further comprises:

executing the software using at least the test deck as input; and

providing the output of the software to the delivery system operator.

3. The method of claim 1, wherein grading the performance of the software further comprises:

selecting a grading programming module formulated to grade the software for compliance with at least one delivery system operation procedure; and

generating a grade using the grading programming module.

4. The method of claim 1, wherein addresses comprising the test deck comprise geographical segment codes chosen at random.

5. The method of claim 4, wherein the geographical segment code comprises at least one of the following:

a United States Postal Service ZIP code, and a United States Postal Service ZIP+4 code.

6. The method of claim 1, wherein the test deck comprises addresses and addresses within the test deck are sorted by street address.

7. The method of claim 1, wherein grading the performance of the software further comprises reporting infractions of the delivery system operation procedures.

8. The method of claim 1, further comprising grading the compliance of at least one of the following:

presort qualification reports, postage statements, and container labels.

9. A system for evaluating software comprising:

an input terminal for receiving software; and

a processor coupled to the input terminal for;

generating a test deck, wherein the test deck is formulated to test the software for compliance with delivery system operation procedures;

processing the test deck with the software; and

grading the performance of the software for compliance with delivery system operation procedures,

wherein generating the test deck further comprises;

selecting at least one delivery system operation procedure with which to test the software for compliance;

selecting a test deck programming module with which to generate the test deck, the test deck programming module formulated to generate the test deck to test the software for compliance with the at least one delivery system operation procedure; and

creating the test deck using the test deck programming module.

10. The system of claim 9, wherein processing the test deck further comprises:

executing the software using at least the test deck as input; and

providing the output of the software to the delivery system operator.

11. The system of claim 9, wherein grading the performance of the software further comprises:

selecting a grading programming module formulated to grade the software for compliance with at least one delivery system operation procedure; and

generating a grade using the grading programming module.

12. The system of claim 9, wherein addresses comprising the test deck comprise geographical segment codes chosen at random.

13. The system of claim 12, wherein the geographical segment code comprises at least one of the following:

a United States Postal Service ZIP code, and a United States Postal Service ZIP+4 code.

14. The system of claim 9, wherein the test deck comprises addresses and addresses within the test deck are sorted by street address.

15. The system of claim 9, further comprising reporting infractions of the delivery system operation procedures.

16. The system of claim 9, further comprising grading the compliance of at least one of the following:

presort qualification reports, postage statements, and container labels.

17. A computer-readable storage medium on which is stored a set of instructions for evaluating software, which when executed perform stages comprising:

generating a test deck, wherein the test deck is formulated to test the software for compliance with delivery system operation procedures;

processing the test deck with the software; and

grading the performance of the software for compliance with delivery system operation procedures,

wherein generating the test deck further comprises;

selecting at least one delivery system operation procedure with which to test the software for compliance;

selecting a test deck programming module with which to generate the test deck, the test deck programming module formulated to generate the test deck to test the software for compliance with the at least one delivery system operation procedure; and

creating the test deck using the test deck programming module.

18. The computer-readable storage medium of claim 17, wherein processing the test deck further comprises:

executing the software using at least the test deck as input; and

providing the output of the software to the delivery system operator.

19. The computer-readable storage medium of claim 17, wherein grading the performance of the software further comprises:

selecting a grading programming module formulated to grade the software for compliance with at least one delivery system operation procedure; and

generating a grade using the grading programming module.

20. The computer-readable storage medium of claim 17, wherein addresses comprising the test deck comprise geographical segment codes chosen at random.

21. The computer-readable storage medium of claim 17, wherein the geographical segment code comprises at least one of the following:

a United States Postal Service ZIP code, and a United States Postal Service ZIP+4 code.

22. The computer-readable storage medium of claim 17, wherein the test deck comprises addresses and addresses within the test deck are sorted by street address.

23. The computer-readable storage medium of claim 17, wherein grading the performance of the software further comprises reporting infractions of the delivery system operation procedures.

24. The computer-readable storage medium of claim 17, further comprising grading the compliance of at least one of the following:

presort qualification reports, postage statements, and container labels.

25. A method for evaluating software comprising:

selecting at least one delivery system operation procedure with which to test the software for compliance;

selecting a test deck programming module with which to generate a test deck, the test deck programming module formulated to generate the test deck to test the software for compliance with the at least one delivery system operation procedure;

creating the test deck using the test deck programming module, wherein addresses comprising the test deck comprise geographical segment codes chosen at random, the geographical segment code comprises at least one of the following;

a United States Postal Service ZIP code, and a United States Postal Service ZIP+4 code, and wherein addresses comprising the test deck are sorted by street address;

executing the software using at least the test deck as input;

providing the output of the software to the delivery system operator;

selecting a grading programming module formulated to grade the software for compliance with at least one delivery system operation procedure;

generating a grade using the grading programming module;

grading the compliance of at least one of the following;

presort qualification reports, postage statements, and container labels; and

reporting infractions of the delivery system operation procedures.