Detection of deadlocks or race conditions in physical systems using load testing

• US 8,448,148 B1
• Filed: 04/05/2011
• Issued: 05/21/2013
• Est. Priority Date: 04/09/2010
• Status: Active Grant

• Current Assignee: Parasoft Corporation
• Original Assignee: Parasoft Corporation
• Inventors: Kolawa, Adam K., Jakubiak, Nathan M., Lambert, Mark L., Haaker, Wilhelm, Gandhi, Neel
• Primary Examiner(s): Zhen, Wei
• Assistant Examiner(s): Chen, Qing
• Application Number:
  US13/080,501
• Time in Patent Office: 777 Days
• Field of Search: 717124-135, 703 23- 28, 714/37, 714/38.1
• US Class Current: 717/134
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A method and system for testing a physical system including a number of input channels for receiving physical inputs, using load testing, comprising: intercepting at least a portion of the input channels; replacing at least a portion of the physical inputs of the intercepted input channels with one or more emulation programs, wherein the emulation programs include parameters which allow to control outputs of the one or more emulation programs to the intercepted input channels; configuring a functional test in a load testing software tool to drive execution of the one or more emulation programs; randomly generating outputs simulating the physical inputs, from the one or more emulation programs, by executing the load testing software tool; collecting data from the execution of the one or more emulation programs as the load testing software tool executes; and analyzing the collected data for presence or absence of deadlocks or race conditions.

Claims

1. A method for testing a physical system including a plurality of input channels for receiving physical inputs, using load testing, the method comprising:

intercepting at least a portion of said plurality of input channels of said physical system;

replacing at least a portion of said physical inputs of said intercepted at least a portion of said plurality of input channels of said physical system with one or more emulation programs, wherein said one or more emulation programs include parameters which allow to control outputs of said one or more emulation programs to said intercepted at least a portion of said plurality of input channels of said physical system;

configuring a functional test in a load testing software tool to drive execution of said one or more emulation programs;

randomly generating outputs from said one or more emulation programs simulating said physical inputs by executing the load testing software tool and inputting said randomly generated outputs to said intercepted at least a portion of said plurality of input channels of said physical system;

monitoring and collecting data from said physical system as the load testing software tool executes, wherein said monitoring includes observing the amount of time it takes for said randomly generated outputs generated by said one or more emulation programs to be processed by said physical system; and

analyzing said collected data for presence or absence of deadlocks or race conditions.

2. The method of claim 1, wherein said plurality of input channels of said physical system include a first channel for receiving inputs from a brake pedal of a car and a second channel for receiving inputs from an accelerator pedal of the car.

3. The method of claim 1, wherein said data is monitored and collected by the load testing software tool.

4. The method of claim 1, further comprising generating a report of data gathered from said one or more emulation programs during the execution of the load testing software tool, that illustrates the presence or absence of deadlocks or race conditions.

5. The method of claim 4, wherein the report is generated by the load testing software tool.

6. The method of claim 1, further comprising generating a report of data gathered from said physical system during the execution of the load testing software tool, that illustrates the presence or absence of deadlocks or race conditions.

7. A system for testing a physical system including a plurality of input channels for receiving physical inputs, using load testing comprising:

means for intercepting at least a portion of said plurality of input channels of said physical system;

means for replacing at least a portion of said physical inputs of said intercepted at least a portion of said plurality of input channels of said physical system with one or more emulation programs, wherein said one or more emulation programs include parameters which allow to control outputs of said one or more emulation programs to said intercepted at least a portion of said plurality of input channels of said physical system;

means for configuring a functional test in a load testing software tool to drive execution of said one or more emulation programs;

means for randomly generating outputs from said one or more emulation programs simulating said physical inputs by executing the load testing software tool and inputting said randomly generated outputs to said intercepted at least a portion of said plurality of input channels of said physical system;

means for monitoring and collecting data from said physical system as the load testing software tools executes, wherein said monitoring includes observing the amount of time it takes for said randomly generated outputs generated by said one or more emulation programs to be processed by said physical system; and

means for analyzing said collected data for presence or absence of deadlocks or race conditions.

8. The system of claim 7, wherein said plurality of input channels of said physical system include a first channel for receiving inputs from a brake pedal of a car and a second channel for receiving inputs from an accelerator pedal of the car.

9. The system of claim 7, wherein said data is monitored and collected by the load testing software tool.

10. The system of claim 7, further comprising means for generating a report of data gathered from said one or more emulation programs during the execution of the load testing software tool, that illustrates the presence or absence of deadlocks or race conditions.

11. The system of claim 10, wherein the report is generated by the load testing software tool.

12. The system of claim 7, further comprising means for generating a report of data gathered from said physical system during the execution of the load testing software tool, that illustrates the presence or absence of deadlocks or race conditions.

13. A method for testing a physical system including a plurality of input channels for receiving physical inputs, using load testing, the method comprising:

intercepting at least a portion of said plurality of input channels of said physical system;

replacing at least a portion of said physical inputs of said intercepted at least a portion of said plurality of input channels of said physical system with one or more emulation programs, wherein said one or more emulation programs include parameters which allow to control outputs of said one or more emulation programs to said intercepted at least a portion of said plurality of input channels of said physical system;

configuring a functional test in a load testing software tool to drive execution of said one or more emulation programs;

randomly generating inputs for said physical system simulating said physical inputs, from said one or more emulation programs, by driving the execution of said one or more emulation programs with the load testing software tool and inputting said randomly generated inputs to said intercepted at least a portion of said plurality of input channels of said physical system;

monitoring and collecting data from said physical system as the load testing software tool executes, wherein said monitoring includes observing the amount of time it takes for said randomly generated inputs generated by said one or more emulation programs to be processed by said physical system; and

analyzing said collected data for errors in said physical system.

14. The method of claim 13, wherein the errors are one or more of the group consisting of deadlocks and race conditions.

15. The method of claim 13, wherein said plurality of input channels of said physical system include a first channel for receiving inputs from a brake pedal of a car and a second channel for receiving inputs from an accelerator pedal of the car.

16. The method of claim 13, wherein said data is monitored and collected by the load testing software tool.

17. The method of claim 13, further comprising generating a report of data gathered from said one or more emulation programs during the execution of the load testing software tool, that illustrates presence or absence of deadlocks or race conditions.

18. The method of claim 13, further comprising generating a report of data gathered from said physical system during the execution of the load testing software tool, that illustrates presence or absence of deadlocks or race conditions.

19. The method of claim 18, wherein the report is generated by the load testing software tool.