Method, apparatus and system for determining software performance

• US 9,647,908 B2
• Filed: 04/28/2015
• Issued: 05/09/2017
• Est. Priority Date: 10/29/2012
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: Zhang, Huajian
• Primary Examiner(s): Nguyen, Quang N
• Application Number:
  US14/698,357
• Publication Number:
  US 20150244592A1
• Time in Patent Office: 742 Days
• Field of Search: 709203, 709217, 709219, 709223, 709224, 709227, 709228, 709232, 709238, 370252, 1 1
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters

Abstract

A method, apparatus and system for determining software performance. After the software is published, performance parameters of operation systems of running the software and performance parameters of run software are acquired from various user terminals. The performance parameters of the operation system of running the software and the performance parameters of the run software is processed to acquire a performance parameter processing result according to a preset method for processing a performance parameter. Performance of the software is determined according to the performance parameter processing result.

Claims

1. A method for determining software performance, comprising:

acquiring, by a server, performance parameters of operation system of running the software of a same version and performance parameters of run software of the same version from various user terminals;

processing, by the server, the performance parameters of the operation system of running the software of the same version and the performance parameters of the run software of the same version to acquire a performance parameters processing result according to a preset method for processing a performance parameter; and

determining, by the server, the performance of the software of the same version according to the performance parameters processing result;

wherein processing the performance parameters of the operation systems of running the software of the same version and the performance parameters of the run software of the same version to acquire the performance parameters processing result comprises;

generating, by the server, a performance distribution state diagram for the software of the same version, wherein the performance parameters processing result comprises a performance distribution state curve of the software of the same version;

wherein determining the performance of the software of the same version according to the performance parameters processing result comprises;

determining, by the server, that the performance of the software of the same version is poor when a ratio of an area value of a region among a performance distribution state curve, a horizontal axis and a right dividing line and an area of a region between the horizontal axis and the distribution state curve is larger than a first preset proportional value;

determining, by the server, that the performance of the software of the same version is unstable when a ratio of an area value of a target region and an area value of a region between the horizontal axis and the distribution state curve is less than a second preset proportional value.

2. The method of claim 1, further comprising:

determining, by the server, whether the software continues being published according to the performance of the software.

3. A method for determining software performance, comprising:

acquiring, by a server, performance parameters of operation systems of running the software of different versions and performance parameters of run software of different versions from various user terminals;

processing, by the server, the performance parameters of the operation system of running the software of different versions and the performance parameters of the run software of different versions to acquire a performance parameters processing result according to a preset method for processing a performance parameter; and

determining, by the server, the performance of the software of different versions according to the performance parameters processing result;

wherein processing the performance parameters of the operation systems of running the software of different version and the performance parameters of the run software of different versions to acquire the performance parameters processing result comprises;

generating, by the server, a performance distribution state diagram for the software of different versions, wherein the performance parameters processing result comprises a performance distribution state curve of the software of different versions;

wherein determining the performance of the software of different versions according to the performance parameters processing result comprises;

determining, by the server, that the performance of the software is poor when a horizontal coordinate value of a peak on any one of the performance distribution state curves is larger than a threshold.

4. The method according to claim 3, wherein processing the performance parameters of the operation system of running the software of different versions and the performance parameters of the run software of different versions to acquire the performance parameters processing result comprises:

generating, by the server, a performance cumulative distribution state diagram for the software of different versions, wherein the performance parameters processing result comprises performance cumulative distribution state curves of the software of different versions;

determining the performance of the software according to the performance parameters processing result comprises;

determining, by the server, that the performance of the software is poor when a longitudinal coordinate value of a coordinate point on a performance cumulative distribution state curve in the generated performance cumulative distribution state diagram is less than a longitudinal coordinate value of a coordinate point on a preset basic performance cumulative distribution state curve, wherein the horizontal coordinate value of the coordinate point on the preset basic performance cumulative distribution state curve is the same as that of the coordinate point on the performance cumulative distribution state curve.

5. A system for determining software performance, comprising:

a processor for executing instructions stored in a memory;

a performance parameter acquiring module, executed by the processor to acquire performance parameters of operation system of running the software of a same version and performance parameters of run software of the same version from various user terminals during a process of running the software of the same version on various user terminals after software is published;

a performance analyzing module, executed by the processor to process the performance parameters of the operation system of running the software of the same version and the performance parameters of the run software of the same version to acquire a performance parameters processing result according to a preset method for processing a performance parameter; and

a data analyzing module, executed by the processor to determine performance of the software of the same version according to the performance parameters processing result;

wherein the performance analyzing module is executed by the processor to generate a performance distribution state diagram for the software of the same version, wherein the performance parameters processing result comprises a performance distribution state curve of the software of the same version;

the data analyzing module is executed by the processor to determine that the performance of the software is poor when a ratio of an area value of a region among a performance distribution state curve, a horizontal axis and a right dividing line and an area of a region between the horizontal axis and the distribution state curve is larger than a first preset proportional value, determine that the performance of the software is unstable when a ratio of an area value of a target region and an area value of a region between the horizontal axis and the distribution state curve is less than a second preset proportional value.

6. The system according to claim 5, further comprising:

a software publishing controller, executed by the processor, to determine whether the software continues being published according to the performance of the software.

7. A system for determining software performance, comprising:

a processor for executing instructions stored in a memory;

a performance parameter acquiring module, executed by the processor to acquire performance parameters of operation system of running the software of different versions and performance parameters of run software of different versions from various user terminals during a process of running the software of different versions on various user terminals after software is published;

a performance analyzing module, executed by the processor to process the performance parameters of the operation system of running the software of different versions and the performance parameters of the run software of different versions to acquire a performance parameters processing result according to a preset method for processing a performance parameter; and

a data analyzing module, executed by the processor to determine performance of the software of different versions according to the performance parameters processing result;

wherein the performance analyzing module is executed by the processor to generate a performance distribution state diagram for the software of different versions, wherein the performance parameters processing result comprises performance distribution state curves of the software of different versions;

the data analyzing module is executed by the processor to determine that the performance of the software is poor when a horizontal coordinate value of a peak on any one of the performance distribution state curves is larger than a threshold.

8. The system according to claim 7, wherein the performance analyzing module is executed by the processor to generate a performance cumulative distribution state diagram for the software of different versions, wherein the performance parameters processing result comprises performance cumulative distribution state curves of the software of different versions;

the data analyzing module is executed by the processor to determine that the performance of the software is poor when a longitudinal coordinate value of a coordinate point on a performance cumulative distribution state curve in the generated performance cumulative distribution state diagram is less than a longitudinal coordinate value of a coordinate point on a preset basic performance cumulative distribution state curve, wherein the horizontal coordinate value of the coordinate point on the preset basic performance cumulative distribution state curve is the same as that of the coordinate point on the performance cumulative distribution state curve.

9. An apparatus for determining software performance, comprising:

a processor for executing instructions stored in a memory, the instructions comprising;

a performance parameter acquiring instruction, to acquire performance parameters of operation system of running the software of a same version and performance parameters of run software of the same version from various user terminals during a process of running the software on various user terminals after software is published;

a performance analyzing instruction, to process the performance parameters of the operation system of running the software of the same version and the performance parameters of the run software of the same version to acquire a performance parameters processing result according to a preset method for processing a performance parameter; and

a data analyzing instruction is to determine performance of the software of the same version according to the performance parameters processing result;

wherein the performance analyzing instruction is to generate a performance distribution state diagram for the software of the same version, wherein the performance parameter processing result comprises a performance distribution state curve of the software of the same version;

the data analyzing instruction is to determine that the performance of the software is poor when a ratio of an area value of a region among a performance distribution state curve, a horizontal axis and a right dividing line and an area of a region between the horizontal axis and the distribution state curve is larger than a first preset proportional value, determine that the performance of the software is unstable when a ratio of an area value of a target region and an area value of a region between the horizontal axis and the distribution state curve is less than a second preset proportional value.

10. The apparatus according to claim 9, further comprising:

a software publishing controlling instruction, to determine whether the software continues being published according to the performance of the software.

11. An apparatus for determining software performance, comprising:

a processor for executing instructions stored in a memory, the instructions comprising;

a performance parameter acquiring instruction, to acquire performance parameters of operation system of running the software of different versions and performance parameters of run software of different versions from various user terminals during a process of running the software on various user terminals after software is published;

a performance analyzing instruction, to process the performance parameters of the operation system of running the software of different versions and the performance parameters of the run software of different versions to acquire a performance parameters processing result according to a preset method for processing a performance parameter; and

a data analyzing instruction is to determine performance of the software of different versions according to the performance parameters processing result;

wherein the performance analyzing instruction is to generate a performance distribution state diagram for the software of different versions, wherein the performance parameters of processing result comprises performance distribution state curves of the software of different versions;

the data analyzing instruction is to determine that the performance of the software is poor when a horizontal coordinate value of a peak on any one of the performance distribution state curves is larger than a threshold.