Method and apparatus for testing a process in a computer system

• US 6,594,820 B1
• Filed: 09/28/1999
• Issued: 07/15/2003
• Est. Priority Date: 09/28/1999
• Status: Expired due to Term

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Ungar, David
• Primary Examiner(s): Chaki, Kakali
• Assistant Examiner(s): Nahar, Qamrun
• Application Number:
  US09/406,502
• Time in Patent Office: 1,386 Days
• Field of Search: 717/124, 717/130, 717/131, 717/160, 717/161, 717/126, 717/127, 714/38
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A method and apparatus for testing processes in a computer system are described. In a software process, there exist many test points in the execution of the process where stress testing may be applied. The process is executed with stress testing applied at selected test points and test intervals. The selected test points are based on prime numbers and varied for successive execution iterations. An efficient distribution of evaluated test points is achieved, and all possible test points are ultimately evaluated within a small number of execution iterations. In one embodiment, the total number of test points is first determined. A first execution run is evaluated at selected test points that correspond to prime numbers greater than the square root of the total number of test points. Subsequent execution iterations are then performed evaluating test points at selected test intervals, where the test intervals for respective execution iterations correspond to prime numbers less than or equal to the square root of the total number of test points. The prime numbers for the selected test intervals are chosen in decreasing order, for example.

Claims

1. In a computer system, an apparatus comprising:

a first process comprising a plurality of test points; and

a second process configured to cause evaluation of selected test points; and

wherein, during one or more interval-based execution iterations of the first process, the selected test points comprise a plurality of test points chosen at test intervals, the test intervals dependent on a prime number that is less than or equal to a first value, further wherein;

subsequent execution iterations are performed evaluating tests points at selected test intervals, where the test intervals for the respective execution iterations correspond to prime numbers less than or equal to the square root of the total number of the test points.

2. The apparatus of claim 1, wherein, during a first execution iteration of the first process, the selected test points correspond to one or more prime numbers greater than the first value.

3. The apparatus of claim 2, wherein the first execution iteration precedes the one or more interval-based execution iterations.

4. The apparatus of claim 2, wherein the one or more interval-based execution iterations precede the first execution iteration.

5. The apparatus of claim 2, wherein, during the first execution run, the selected test points further comprise a first-occurring test point in the plurality of test points.

6. The apparatus of claim 1, wherein, during the one or more interval-based execution iterations, the second process is configured to vary the test intervals between successive execution iterations of the first process.

7. The apparatus of claim 1, wherein the second process is configured to determine a total number of test points in the first process.

8. The apparatus of claim 1, further comprising a subprocess that is executed when one of the selected test points is evaluated.

9. The apparatus of claim 8, wherein the subprocess comprises a garbage collector, and the plurality of test points comprise garbage collection points.

10. The apparatus of claim 9, wherein the first process is executed within a virtual machine.

11. In a computer system, a method for testing a process having a plurality of test oints, comprising:

performing a plurality of execution iterations;

during each of the plurality of execution iterations, evaluating selected test points, wherein, during one or more interval-based execution iterations of the process, the selected test points comprise a plurality of test points chosen at test intervals, the test intervals dependent on a prime number that is less than or equal to a first value, further wherein;

subsequent execution iterations are performed evaluating test points at selected test intervals, where the test intervals for the respective execution iterations correspond to prime numbers less than or equal to the square root of the total number of the test points.

12. The method of claim 11, wherein evaluating a test point comprises executing a subprocess.

13. The method of claim 11, further comprising identifying one or more failed test points.

14. The method of claim 11, further comprising varying the test interval between successive interval-based execution iterations.

15. The method of claim 11, wherein, during a first execution iteration of the process, the selected test points correspond to one or more prime numbers that are greater than the first value.

16. The method of claim 15, wherein, during the first execution iteration, the selected test points comprise a first-occurring test point.

17. The method of claim 15, wherein the first execution iteration precedes the one or more interval-based execution iterations.

18. The method of claim 15, wherein the one or more interval-based execution iterations precede the first execution iteration.

19. A computer program product comprising:

a computer readable medium having computer program code embodied therein for testing a process having a plurality of test points, the computer readable medium comprising computer program code configured to cause a computer to;

perform a plurality of execution iterations;

during each of the plurality of execution iterations, evaluate selected test points, wherein, during one or more interval-based execution iterations of the process, the selected test points comprise a plurality of test points chosen at test intervals, the test intervals dependent on a prime number that is less than or equal to a first value, further wherein;

subsequent execution iterations are performed evaluating test points at selected test intervals, where the test intervals for the respective execution iterations correspond to prime numbers less than or equal to the square root of the total number of the test points.

20. The computer program product of claim 19, wherein evaluating a test point comprises executing a subprocess.

21. The computer program product of claim 19, wherein the computer program code is further configured to cause the computer to identify one or more failed test points.

22. The computer program product of claim 19, wherein, during a first execution iteration of the process, the selected test points correspond to one or more prime numbers that are greater than the first value.

23. The computer program product of claim 22, wherein, during the first execution iteration, the selected test points comprise a first-occurring test point.

24. The computer program product of claim 22, wherein the first execution iteration precedes the one or more interval-based execution iterations.

25. The computer program product of claim 22, wherein the one or more interval-based execution iterations precede the first execution iteration.