Computer system and method for performing a virtual load test

• US 10,379,982 B2
• Filed: 10/31/2017
• Issued: 08/13/2019
• Est. Priority Date: 10/31/2017
• Status: Active Grant

• Current Assignee: Uptake Technologies, Inc.
• Original Assignee: Uptake Technologies, Inc.
• Inventors: Thompson, Timothy, Becker, Joseph, Salitra, Praveen
• Primary Examiner(s): Butler, Sarai E
• Application Number:
  US15/799,802
• Publication Number:
  US 20190129820A1
• Time in Patent Office: 651 Days
• Field of Search: 714 25
• CPC Class Codes: G05B 19/0428 Safety, monitoring G05B19/0423 takes precedence
• CPC Class Codes: G06F 11/2268 Logging of test results
• CPC Class Codes: G06F 11/2294 by remote test
• CPC Class Codes: G06F 11/3013 where the computing system is an embedded system, i.e. a combination of hardware and software dedicated to perform a certain function in mobile devices, printers, automotive or aircraft systems testing or monitoring of control systems or parts thereof G05B23/02
• CPC Class Codes: G06F 11/34 Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 11/36 Preventing errors by testing or debugging software
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 17/40 Data acquisition and logging for input to computer G06F3/00
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/20 Administration of product repair or maintenance
• CPC Class Codes: G06Q 50/30 Transportation; Communications
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083

Abstract

Computing systems, devices, and methods for performing a virtual load test are disclosed herein. In accordance with the present disclosure, an asset data platform may define a respective range of acceptable values for each load-test variable in a set of load-test variables. The asset data platform may then receive one or more under-load reports from a given asset, and carry out a virtual load test for the given asset by, performing a comparison between the respective observation value for the load-test variable included in the most recent under-load report and the respective range of acceptable values for the load-test variable. In turn, the asset data platform may identify load-test variables for which the respective observation value falls outside of the respective range of acceptable values, and may then cause a client station to present results of the virtual load test for the given asset.

Claims

1. A computing system comprising:

at least one processor;

a tangible, non-transitory computer-readable medium; and

program instructions stored on the tangible, non-transitory computer-readable medium that are executable by the at least one processor to cause the computing system to;

analyze historical under-load reports sent by a group of assets and thereby define a respective range of acceptable values for each load-test variable in a set of load-test variables included in the historical under-load reports;

receive one or more under-load reports from a given asset;

carry out a virtual load test for the given asset by;

accessing a most recent under-load report received from the given asset, wherein the most recent under-load report comprises a respective observation value for each load-test variable in the set of load-test variables;

accessing the respective range of acceptable values for each load-test variable in the set of load-test variables;

for each load-test variable in the set of load-test variables, performing a comparison between the respective observation value for the load-test variable included in the most recent under-load report and the respective range of acceptable values for the load-test variable; and

based on the comparisons, identifying any load-test variable in the set of load-test variables for which the respective observation value included in the most recent under-load report falls outside of the respective range of acceptable values;

and

after carrying out the virtual load test for the given asset, cause a client station to present results of the virtual load test for the given asset, wherein the results comprise an indication of each identified load-test variable for which the respective observation value in the most recent under-load report falls outside of the respective range of acceptable values.

2. The computing system of claim 1, wherein the set of load-test variables comprise one or more diagnostic variables and one or more in-motion variables.

3. The computing system of claim 1, wherein the historical under-load reports sent by the group of assets comprise operating data reports that were previously sent by assets in the group of assets while under a given set of load conditions.

4. The computing system of claim 1, wherein each historical under-load report comprises a respective historical value for each load-test variable in the set of load-test variables, and wherein the program instructions that are executable by the at least one processor to cause the computing system to analyze the historical under-load reports and thereby define a respective range of acceptable values for each load-test variable in the set of load-test variables comprise program instructions stored on the tangible, non-transitory computer-readable medium that are executable by the at least one processor to cause the computing system to:

for each load-test variable in the set of load-test variables, evaluate the historical values included in the historical load-test reports to determine a representative historical value for the load-test variable and then define a range of acceptable values for the load-test variable based on the representative historical value.

5. The computing system of claim 1, wherein the respective range of acceptable values for each load-test variable in the set of load-test variables comprises one or both of a minimum acceptable value and a maximum acceptable value for each load-test variable in the set of load-test variables.

6. The computing system of claim 1, wherein the program instructions that are executable by the at least one processor to cause the computing system to carry out a virtual load test for the given asset comprise program instructions stored on the tangible, non-transitory computer-readable medium that are executable by the at least one processor to cause the computing system to:

carry out the virtual load test for the given asset in response to receiving a request triggered via a graphical user interface (GUI) being displayed on the client station.

7. The computing system of claim 1, wherein the program instructions that are executable by the at least one processor to cause the computing system to carry out a virtual load test for the given asset comprise program instructions stored on the tangible, non-transitory computer-readable medium that are executable by the at least one processor to cause the computing system to:

carry out the virtual load test for the given asset in response to receiving a user-triggered under-load report, wherein the user-triggered under-load report is received in response to operator input.

8. The computing system of claim 1, wherein the program instructions that are executable by the at least one processor to cause the computing system to carry out a virtual load test for the given asset comprise program instructions stored on the tangible, non-transitory computer-readable medium that are executable by the at least one processor to cause the computing system to:

carry out the virtual load test for the given asset in accordance with a predefined schedule.

9. The computing system of claim 1, wherein the program instructions that are executable by the at least one processor further causes the computing system to:

store the results of the virtual load test after carrying out the virtual load test for the given asset.

10. The computing system of claim 1, wherein the program instructions that are executable by the at least one processor to cause the computing system to cause a client station to present results of the virtual load test for the given asset comprise program instructions stored on the tangible, non-transitory computer-readable medium that are executable by the at least one processor to cause the computing system to:

send the results of the virtual load test to the client station; and

cause the client station to display the results of the of the virtual load test via a graphical user interface (GUI).

11. The computing system of claim 10, wherein sending the results of the virtual load test to the client station comprises sending the results of the virtual load test in response to a user request via the GUI.

12. The computing system of claim 1, wherein the program instructions that are executable by the at least one processor further causes the computing system to:

send an alert to notify that the results of the virtual load test are available after carrying out the virtual load test for the given asset.

13. The computing system of claim 1, wherein the results of the virtual load test further comprise a representation of the respective observation value for each load-test variable in the set of load-test variables and a representation of the respective range of acceptable values for each load-test variable in the set of load-test variables.

14. The computing system of claim 1, wherein the results of the virtual load test further comprise, for at least one identified load-test variable, a prediction as to why the respective observation value in the most recent under-load report falls outside of the respective range of acceptable values.

15. The computing system of claim 1, wherein the results of the virtual load test further comprise the results of a trending analysis for each load-test variable in the set of load-test variables.

16. A non-transitory computer-readable medium having instructions stored thereon that are executable to cause a computing system to:

analyze historical under-load reports sent by a group of assets and thereby define a respective range of acceptable values for each load-test variable in a set of load-test variables included in the historical under-load reports;

receive one or more under-load reports from a given asset;

carry out a virtual load test for the given asset by;

accessing a most recent under-load report received from the given asset, wherein the most recent under-load report comprises a respective observation value for each load-test variable in the set of load-test variables;

accessing the respective range of acceptable values for each load-test variable in the set of load-test variables;

for each load-test variable in the set of load-test variables, performing a comparison between the respective observation value for the load-test variable included in the most recent under-load report and the respective range of acceptable values for the load-test variable; and

based on the comparisons, identifying any load-test variable in the set of load-test variables for which the respective observation value included in the most recent under-load report falls outside of the respective range of acceptable values; and

after carrying out the virtual load test for the given asset, cause a client station to present results of the virtual load test for the given asset, wherein the results comprise an indication of each identified load-test variable for which the respective observation value in the most recent under-load report falls outside of the respective range of acceptable values.

17. The non-transitory computer-readable medium of claim 16, wherein carrying out the virtual load test for the given asset comprises carrying out the virtual load test for the given asset in response to receiving a request triggered via a graphical user interface (GUI) being displayed on the client station.

18. The non-transitory computer-readable medium of claim 16, wherein carrying out the virtual load test for the given asset comprises carrying out the virtual load test for the given asset in response to receiving a user-triggered under-load report, wherein the user-triggered under-load report is received in response to operator input.

19. A method comprising:

analyzing, via a computing system, historical under-load reports sent by a group of assets and thereby defining a respective range of acceptable values for each load-test variable in a set of load-test variables included in the historical under-load reports;

receiving, via the computing system, one or more under-load reports from a given asset;

carrying out, via the computing system, a virtual load test for the given asset by;

accessing a most recent under-load report received from the given asset, wherein the most recent under-load report comprises a respective observation value for each load-test variable in the set of load-test variables;

accessing the respective range of acceptable values for each load-test variable in the set of load-test variables;

for each load-test variable in the set of load-test variables, performing a comparison between the respective observation value for the load-test variable included in the most recent under-load report and the respective range of acceptable values for the load-test variable; and

based on the comparisons, identifying any load-test variable in the set of load-test variables for which the respective observation value included in the most recent under-load report falls outside of the respective range of acceptable values; and

after carrying out the virtual load test for the given asset, causing, via the computing system, a client station to present results of the virtual load test for the given asset, wherein the results comprise an indication of each identified load-test variable for which the respective observation value in the most recent under-load report falls outside of the respective range of acceptable values.

20. The method of claim 19, wherein carrying out the virtual load test for the given asset comprises carrying out the virtual load test for the given asset in response to receiving, via the computing system, a request triggered via a graphical user interface (GUI) being displayed on the client station.