Method, Apparatus And System For Determining Software Performance

• US 20150244592A1
• Filed: 04/28/2015
• Published: 08/27/2015
• Est. Priority Date: 10/29/2012
• Status: Active Grant

• Current Assignee: Tencent Technology Shenzhen Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Shenzhen Company Limited (Tencent Holdings Limited)
• Inventors: ZHANG, Huajian
• Granted Patent: US 9,647,908 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters

Abstract

A method, apparatus and system for determining software performance. After the software is published, performance parameters of operation systems of running the software and performance parameters of run software are acquired from various user terminals. The performance parameters of the operation system of running the software and the performance parameters of the run software is processed to acquire a performance parameter processing result according to a preset method for processing a performance parameter. Performance of the software is determined according to the performance parameter processing result.

Claims

1. A method for determining software performance, comprising:

acquiring, by a server, performance parameters of operation systems of running the software and performance parameters of run software from various user terminals;

processing, by the server, the performance parameters of the operation system of running the software and the performance parameters of the run software to acquire a performance parameter processing result according to a preset method for processing a performance parameter; and

determining, by the server, performance of the software according to the performance parameter processing result.

2. The method according to claim 1, wherein acquiring the performance parameters of operation systems of running the software and the performance parameters of run software from various user terminals comprises:

acquiring, by the server, the performance parameters of operation systems of running the software of a same version and the performance parameters of run software of the same version from various user terminals;

processing the performance parameters of the operation system of running the software and the performance parameters of the run software to acquire the performance parameter processing result according to the preset method for processing a performance parameter comprises;

processing, by the server, the performance parameters of the operation system of running the software of the same version and the performance parameters of the run software of the same version to acquire the performance parameters processing result according to the preset method for processing a performance parameter;

determining the performance of the software according to the performance parameter processing result comprises;

determining, by the server, the performance of the software of the same version according to the performance parameter processing result.

3. The method according to claim 1, wherein acquiring the performance parameters of operation systems of running the software and the performance parameters of run software from various user terminals comprises:

acquiring, by the server, the performance parameters of operation systems of running the software of different versions and the performance parameters of run software of different versions from various user terminals;

processing the performance parameters of the operation system of running the software and the performance parameters of the run software to acquire the performance parameter processing result according to the preset method for processing a performance parameter comprises;

processing, by the server, the performance parameters of the operation system of running the software of different versions and the performance parameters of the run software of different versions to acquire the performance parameters processing result according to the preset method for processing a performance parameter;

determining the performance of the software according to the performance parameter processing result comprises;

determining, by the server, the performance of the software of different versions according to the performance parameter processing result.

4. The method according to claim 2, wherein processing the performance parameters of the operation systems of running the software and the performance parameters of the run software to acquire the performance parameter processing result comprises:

generating, by the server, a performance distribution state diagram for the software of the same version, wherein the performance parameter processing result comprises a performance distribution state curve of the software of the same version;

determining the performance of the software according to the performance parameter processing result comprises;

determining, by the server, that the performance of the software is poor when a ratio of an area value of a region among a performance distribution state curve, a horizontal axis and a right dividing line and an area of a region between the horizontal axis and the distribution state curve is larger than a first preset proportional value;

determining, by the server, that the performance of the software is unstable when a ratio of an area value of a target region and an area value of a region between the horizontal axis and the distribution state curve is less than a second preset proportional value.

5. The method according to claim 3, wherein processing the performance parameters of the operation systems of running the software and the performance parameters of the run software to acquire the performance parameter processing result comprises:

generating, by the server, a performance distribution state diagram for the software of different versions, wherein the performance parameter processing result comprises performance distribution state curves of the software of different versions;

determining the performance of the software according to the performance parameter processing result comprises;

determining, by the server, that the performance of the software is poor when a horizontal coordinate value of a peak on any one of the performance distribution state curves is larger than a threshold.

6. The method according to claim 3, wherein processing the performance parameters of the operation system of running the software and the performance parameters of the run software to acquire the performance parameter processing result comprises:

generating, by the server, a performance cumulative distribution state diagram for the software of different versions, wherein the performance parameter processing result comprises performance cumulative distribution state curves of the software of different versions;

determining the performance of the software according to the performance parameter processing result comprises;

determining, by the server, that the performance of the software is poor when a longitudinal coordinate value of a coordinate point on a performance cumulative distribution state curve in the generated performance cumulative distribution state diagram is less than a longitudinal coordinate value of a coordinate point on a preset basic performance cumulative distribution state curve, wherein the horizontal coordinate value of the coordinate point on the preset basic performance cumulative distribution state curve is the same as that of the coordinate point on the performance cumulative distribution state curve.

7. The method of claim 1, further comprising:

determining, by the server, whether the software continues being published according to the performance of the software.

8. A system for determining software performance, comprising:

a performance parameter acquiring module, to acquire performance parameters of operation systems of running the software and performance parameters of run software from various user terminals during a process of running the software on various user terminals after software is published.

a performance analyzing module, to process the performance parameters of the operation system of running the software and the performance parameters of the run software to acquire a performance parameters processing result according to a preset method for processing a performance parameter; and

a data analyzing module, to determine performance of the software according to the performance parameter processing result.

9. The system according to claim 8, wherein

the performance parameter acquiring module is to acquire the performance parameters of operation systems of running the software of a same version and the performance parameters of run software of the same version from various user terminals;

the performance analyzing module is to process the performance parameters of the operation system of running the software of the same version and the performance parameters of the run software of the same version to acquire the performance parameters processing result according to the preset method for processing a performance parameter;

the data analyzing module is to determine the performance of the software of the same version according to the performance parameter processing result.

10. The system according to claim 8, wherein

the performance parameter acquiring module is to acquire the performance parameters of operation systems of running the software of different versions and the performance parameters of run software of different versions from various user terminals;

the performance analyzing module is to process the performance parameters of the operation system of running the software of different versions and the performance parameters of the run software of different versions to acquire the performance parameters processing result according to the preset method for processing a performance parameter;

the data analyzing module is to determine the performance of the software of different versions according to the performance parameter processing result.

11. The system according to claim 9, wherein the performance analyzing module is to generate a performance distribution state diagram for the software of a same version, wherein the performance parameter processing result comprises a performance distribution state curve of the software of the same version;

the data analyzing module is to determine that the performance of the software is poor when a ratio of an area value of a region among a performance distribution state curve, a horizontal axis and a right dividing line and an area of a region between the horizontal axis and the distribution state curve is larger than a first preset proportional value, determine that the performance of the software is unstable when a ratio of an area value of a target region and an area value of a region between the horizontal axis and the distribution state curve is less than a second preset proportional value.

12. The system according to claim 10, wherein the performance analyzing module is to generate a performance distribution state diagram for the software of different versions, wherein the performance parameter processing result comprises performance distribution state curves of the software of different versions;

the data analyzing module is to determine that the performance of the software is poor when a horizontal coordinate value of a peak on any one of the performance distribution state curves is larger than a threshold.

13. The system according to claim 10, wherein the performance analyzing module is to generate a performance cumulative distribution state diagram for the software of different versions, wherein the performance parameter processing result comprises performance cumulative distribution state curves of the software of different versions;

the data analyzing module is to determine that the performance of the software is poor when a longitudinal coordinate value of a coordinate point on a performance cumulative distribution state curve in the generated performance cumulative distribution state diagram is less than a longitudinal coordinate value of a coordinate point on a preset basic performance cumulative distribution state curve, wherein the horizontal coordinate value of the coordinate point on the preset basic performance cumulative distribution state curve is the same as that of the coordinate point on the performance cumulative distribution state curve.

14. The system according to claim 8, further comprising:

a software publishing controller, to determine whether the software continues being published according to the performance of the software.

15. An apparatus for determining software performance, comprising:

a processor for executing instructions stored in a memory, the instructions comprising;

a performance parameter acquiring instruction, to acquire performance parameters of operation systems of running the software and performance parameters of run software from various user terminals during a process of running the software on various user terminals after software is published.

a performance analyzing instruction, to process the performance parameters of the operation system of running the software and the performance parameters of the run software to acquire a performance parameters processing result according to a preset method for processing a performance parameter; and

a data analyzing instruction, to determine performance of the software according to the performance parameter processing result.

16. The apparatus according to claim 15, wherein

the performance parameter acquiring instruction is to acquire the performance parameters of operation systems of running the software of a same version and the performance parameters of run software of the same version from various user terminals;

the performance analyzing instruction is to process the performance parameters of the operation system of running the software of the same version and the performance parameters of the run software of the same version to acquire the performance parameters processing result according to the preset method for processing a performance parameter;

the data analyzing instruction is to determine the performance of the software of the same version according to the performance parameter processing result.

17. The apparatus according to claim 15, wherein

the performance parameter acquiring instruction is to acquire the performance parameters of operation systems of running the software of different versions and the performance parameters of run software of different versions from various user terminals;

the performance analyzing instruction is to process the performance parameters of the operation system of running the software of different versions and the performance parameters of the run software of different versions to acquire the performance parameters processing result according to the preset method for processing a performance parameter;

the data analyzing instruction is to determine the performance of the software of different versions according to the performance parameter processing result.

18. The apparatus according to claim 16, wherein the performance analyzing instruction is to generate a performance distribution state diagram for the software of a same version, wherein the performance parameter processing result comprises a performance distribution state curve of the software of the same version;

the data analyzing instruction is to determine that the performance of the software is poor when a ratio of an area value of a region among a performance distribution state curve, a horizontal axis and a right dividing line and an area of a region between the horizontal axis and the distribution state curve is larger than a first preset proportional value, determine that the performance of the software is unstable when a ratio of an area value of a target region and an area value of a region between the horizontal axis and the distribution state curve is less than a second preset proportional value.

19. The apparatus according to claim 17, wherein the performance analyzing instruction is to generate a performance distribution state diagram for the software of different versions, wherein the performance parameter processing result comprises performance distribution state curves of the software of different versions;

the data analyzing instruction is to determine that the performance of the software is poor when a horizontal coordinate value of a peak on any one of the performance distribution state curves is larger than a threshold.

20. The apparatus according to claim 15, further comprising:

a software publishing controlling instruction, to determine whether the software continues being published according to the performance of the software.