Method and apparatus for acquiring quality of experience and method and apparatus for ensuring quality of experience

• US 9,258,200 B2
• Filed: 03/15/2013
• Issued: 02/09/2016
• Est. Priority Date: 03/15/2012
• Status: Expired due to Fees

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Wan, Qun, Dong, Jianming
• Primary Examiner(s): Jiang, Charles C
• Assistant Examiner(s): KAMARA, MOHAMED A
• Application Number:
  US13/838,222
• Publication Number:
  US 20130272150A1
• Time in Patent Office: 1,061 Days
• Field of Search: 370/252, 370/230, 370/235, 370328-332, 370/395.21, 709/213, 709223-226, 709/231, 709/233, 709/235, 455/422.1, 455/423, 455/452.2
• US Class Current: 1/1
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 43/55 Testing of service level quality, e.g. simulating service usage

Abstract

A method for acquiring quality of experience QOE of a telecommunication service is provided. The method includes: acquiring multiple groups of original KQI vectors and a QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors; analyzing a relationship between the multiple groups of original KQI vectors and QOE values corresponding to the multiple groups of original KQI vectors to establish a function relationship between KQI vectors and QOE values corresponding to the KQI vectors; acquiring a current KQI vector, and applying the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors to obtain a current QOE value corresponding to the current KQI vector.

Claims

1. A method for acquiring a current quality of experience (QOE) value of a telecommunication service, comprising a network apparatus monitoring a plurality of network elements respectively providing the telecommunication service, wherein the network apparatus comprises at least a processor which is configured to cause the network apparatus to perform functions, comprising:

acquiring multiple groups of original Key Quality Indicator (KQI) vectors and a respective QOE value corresponding to each group of the original KQI vectors in the multiple groups of the original KQI vectors, wherein the multiple groups of original KQI vectors correspond to the plurality of network elements respectively providing the telecommunication service,

wherein the acquiring of the multiple groups of the original KQI vectors and the respective QOE value corresponding to each group of the original KQI vectors in the multiple groups of the original KQI vectors, further comprises;

acquiring the multiple original KQI values of a particular class of the telecommunication service, wherein the multiple original KQI values constituting the multiple groups of the original KQI vectors;

standardizing each group of the original KQI vectors in the multiple groups of the original KQI vectors in order to form corresponding multiple groups of standardized KQI vectors, wherein each respective group of the standardized KQI vectors being corresponding to a corresponding Key Performance Index (KPI) state;

analyzing a relationship between the multiple groups of the original KQI vectors and the respective QOE values corresponding to the multiple groups of the original KQI vectors to establish a function relationship between the original KQI vectors which correspond to the plurality of network elements providing the respective telecommunication service, and the respective QOE values corresponding to the original KQI vectors;

acquiring a current KQI vector, and applying the function relationship between the original KQI vectors and the respective QOE values corresponding to the original KQI vectors, in order to obtain the current QOE value which corresponds to a respective network element which provides the telecommunication service corresponding to the current KQI vector; and

utilizing the obtained current QOE value to adjust service parameters of the respective network element to improve a respective particular class of telecommunication service, wherein the improving of the respective particular class of telecommunication service, comprises one or more of the following;

yielding higher caller connection success rate and better voice quality in voice service,

reducing caller access duration and call drop rate in voice service,

yielding higher access success rate, refresh success rate and average downloading speed in web browsing service,

reducing refresh duration and drop rate in web browsing service, and

yielding higher success rate and reducing delay in a short messaging service (SMS).

2. The method for acquiring the current QOE value of a telecommunication service according to claim 1, wherein,

acquiring original QOE values corresponding to the multiple groups of the standardized KQI vectors;

selecting standardized KQI vectors whose KPI states are approximate to form sample standardized KQI vectors; and

stabilizing a relationship between the original KQI vectors corresponding to the sample standardized KQI vectors and the original QOE values corresponding to the sample standardized KQI vectors to obtain stable original KQI vectors and stable QOE values;

accordingly, the analyzing the relationship between the multiple groups of original KQI vectors and the respective QOE values corresponding to the multiple groups of the original KQI vectors to establish the function relationship between the KQI vectors and the respective QOE values corresponding to the KQI vectors specifically comprises;

analyzing a relationship between the stable original KQI vectors and the stable QOE values to establish the function relationship.

3. The method for acquiring the current QOE value of a telecommunication service according to claim 2, wherein the acquiring of the original QOE values corresponding to the multiple groups of standardized KQI vectors specifically comprises:

selecting, from a vector space constituted by the standardized KQI vectors, a multi-dimensional space entity that comprises all the standardized KQI vectors, wherein each dimension of the multi-dimensional space entity comprises a minimum value, a maximum value, and a value between the minimum value and the maximum value that are in the standardized KQI vectors and fall on the dimension;

evenly dividing the multi-dimensional space entity along each dimension of the multi-dimensional space entity into adjacent space area blocks, and selecting the same quantity of standardized KQI vectors from each of the space area blocks; and

acquiring original QOE values corresponding to the standardized KQI vectors selected from each of the space area blocks;

accordingly, the selecting the standardized KQI vectors whose KPI states are approximate to form the sample standardized KQI vectors specifically comprises;

calculating distances between the standardized KQI vectors selected from each of the space area blocks; and

according to the calculated distances, selecting, for each of the selected standardized KQI vectors, multiple standardized KQI vectors that have shortest distances from the standardized KQI vector as the standardized KQI vectors whose KPI states are approximate to form the sample standardized KQI vectors.

4. The method for acquiring the current QOE value of a telecommunication service according to claim 1, wherein the acquiring of the multiple groups of original KQI vectors and the QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors specifically comprises:

selecting standardized KQI vectors whose KPI states are evenly distributed to form sample standardized KQI vectors;

acquiring original QOE values corresponding to the sample standardized KQI vectors; and

stabilizing a relationship between the original KQI vectors corresponding to the sample standardized KQI vectors and the original QOE values corresponding to the sample standardized KQI vectors to obtain stable original KQI vectors and stable QOE values;

accordingly, the analyzing the relationship between the multiple groups of the original KQI vectors and the QOE values corresponding to the multiple groups of the original KQI vectors to establish the function relationship between the KQI vectors and the corresponding QOE values specifically comprises;

analyzing a relationship between the stable original KQI vectors and the stable QOE values to establish the function relationship.

5. The method for acquiring the current QOE value of a telecommunication service according to claim 4, wherein the selecting of the standardized KQI vectors whose KPI states are evenly distributed to form the sample standardized KQI vectors specifically comprises:

selecting, from a vector space constituted by the standardized KQI vectors, a multi-dimensional space entity that comprises all the standardized KQI vectors, wherein each dimension of the multi-dimensional space entity comprises a minimum value, a maximum value, and a value between the minimum value and the maximum value that are in the standardized KQI vectors and fall on the dimension; and

evenly dividing the multi-dimensional space entity along each dimension of the multi-dimensional space entity into adjacent space area blocks, selecting at random, from each of the space area blocks that comprises not less than the preset number N of standardized KQI vectors, N standardized KQI vectors, and using the selected N standardized KQI vectors as the standardized KQI vectors whose KPI states are evenly distributed to form the sample standardized KQI vectors.

6. The method for acquiring the current QOE value of a telecommunication service according to claim 2, wherein the stabilizing of the relationship between the original KQI vectors corresponding to the sample standardized KQI vectors and the original QOE values corresponding to the sample standardized KQI vectors to obtain the stable original KQI vectors and stable QOE values specifically comprises:

calculating an average value or probability distribution of the original KQI vectors corresponding to the sample standardized KQI vectors as a stable original KQI vector, and calculating an average value or probability distribution of the original QOE values corresponding to the sample standardized KQI vectors as a stable QOE value.

7. The method for acquiring the current QOE value of a telecommunication service according to claim 1, wherein the standardizing of each group of original KQI vectors in the multiple groups of original KQI vectors to form the corresponding multiple groups of standardized KQI vectors specifically comprises:

converting original KQI values in each of the original KQI vectors through formula (a) into standard scores to acquire a standardized KQI vector corresponding to the original KQI vector;

8. The method for acquiring the current QOE value of a telecommunication service according to claim 2, wherein the analyzing of the relationship between the stable original KQI vectors and the stable QOE values to establish the function relationship specifically comprises:

analyzing the relationship between the stable original KQI vectors and the stable QOE values and using a multiple regression modeling method to establish the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors.

9. The method for acquiring the current QOE value of a telecommunication service according to claim 8, wherein the analyzing of the relationship between the stable original KQI vectors and the stable QOE values and using the multiple regression modeling method to establish the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors specifically comprises:

with a stable original KQI vector as an independent variable, and with a stable QOE value as a dependent variable, obtaining the function relationship between the stable QOE values and the stable original KQI vectors through multiple regression analysis; and

performing conversion for the obtained function relationship between the stable QOE values and the stable original KQI vectors to acquire the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors, so that a QOE value calculated through the acquired function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors is confined within a preset value range.

10. A method for ensuring a current quality of experience (QOE) of a telecommunication service, comprising a network apparatus monitoring a plurality of network elements respectively providing the telecommunication service, wherein the network apparatus comprises at least a processor which is configured to cause the network apparatus to perform functions, comprising:

acquiring multiple groups of original Key Quality Indicator (KQI) vectors and a QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors, wherein;

the multiple groups of original KQI vectors correspond to the plurality of network elements respectively providing the telecommunication service,

each group of original KQI vectors comprises original KQI values corresponding to different KQI classes of the telecommunication service,

the acquiring of the multiple groups of the original KQI vectors and the respective QOE value corresponding to each group of the original KQI vectors in the multiple groups of the original KQI vectors, further comprises;

acquiring the multiple original KQI values of a particular class of telecommunication service, wherein the multiple original KQI values constituting the multiple groups of the original KQI vectors;

standardizing each group of the original KQI vectors in the multiple groups of the original KQI vectors in order to form corresponding multiple groups of standardized KQI vectors, wherein each respective group of the standardized KQI vectors being corresponding to a Key Performance Index (KPI) state;

analyzing a relationship between original KQI values corresponding to a same KQI class in the multiple groups of original KQI vectors and QOE values corresponding to the original KQI vectors to establish a function relationship between the original KQI values corresponding to the same KQI class of the respective network elements which provide the telecommunication service, and the QOE values corresponding to the original KQI vectors;

according to a preset QOE threshold value, applying the function relationship to determine a KQI threshold value corresponding to a certain KQI class; and

according to the KQI threshold value corresponding to the certain KQI class, adjusting a current KQI value corresponding to the certain KQI class to ensure that a current QOE value of the telecommunication service complies with the preset QOE threshold value, wherein the current QOE value is obtained from the acquired current KQI vector, by applying the function relationship between the original KQI vectors and the QOE values corresponding to the original KQI vectors; and

utilizing the obtained current QOE value to adjust service parameters of the respective plurality of network elements to improve the telecommunication service, wherein the improving of the respective particular class of telecommunication service, comprises one or more of the following;

yielding higher caller connection success rate and better voice quality in voice service,

reducing caller access duration and call drop rate in voice service,

yielding higher access success rate, refresh success rate and average downloading speed in web browsing service,

reducing refresh duration and drop rate in web browsing service, and

yielding higher success rate and reducing delay in a short messaging service (SMS).

11. The method for ensuring the QOE of a telecommunication service according to claim 10, wherein,

the acquiring of the multiple groups of original KQI vectors and the QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors specifically comprises:

acquiring original QOE values corresponding to the multiple groups of standardized KQI vectors;

selecting standardized KQI vectors whose KPI states are approximate to form sample standardized KQI vectors; and

stabilizing a relationship between original KQI values corresponding to a same KQI class in the sample standardized KQI vectors and original QOE values corresponding to the sample standardized KQI vectors to obtain stable original KQI values and stable QOE values;

accordingly, the analyzing the relationship between the original KQI values corresponding to the same KQI class in the multiple groups of original KQI vectors and the QOE values corresponding to the original KQI vectors to establish the function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors comprises;

analyzing a relationship between the stable original KQI values corresponding to the same KQI class and the stable QOE values corresponding to the stable original KQI values corresponding to the same KQI class to establish the function relationship.

12. The method for ensuring the QOE of a telecommunication service according to claim 11, wherein the acquiring of the original QOE values corresponding to the multiple groups of standardized KQI vectors specifically comprises:

selecting, from a vector space constituted by the standardized KQI vectors, a multi-dimensional space entity that comprises all the standardized KQI vectors, wherein each dimension of the multi-dimensional space entity comprises a minimum value, a maximum value, and a value between the minimum value and the maximum value that are in the standardized KQI vectors and fall on the dimension;

evenly dividing the multi-dimensional space entity along each dimension of the multi-dimensional space entity into adjacent space area blocks, and selecting the same quantity of standardized KQI vectors from each of the space area blocks; and

acquiring original QOE values corresponding to the standardized KQI vectors selected from each of the space area blocks;

accordingly, the selecting the standardized KQI vectors whose KPI states are approximate to form the sample standardized KQI vectors comprises;

calculating distances between the standardized KQI vectors selected from each of the space area blocks; and

according to the calculated distances, selecting, for each of the selected standardized KQI vectors, multiple standardized KQI vectors that have shortest distances from the standardized KQI vector as the standardized KQI vectors whose KPI states are approximate to form the sample standardized KQI vectors.

13. The method for ensuring the QOE of a telecommunication service according to claim 10, wherein,

the acquiring of the multiple groups of the original KQI vectors and the QOE value corresponding to each group of the original KQI vectors in the multiple groups of original KQI vectors specifically comprises:

selecting standardized KQI vectors whose KPI states are evenly distributed to form sample standardized KQI vectors;

acquiring original QOE values corresponding to the sample standardized KQI vectors; and

stabilizing a relationship between original KQI values corresponding to a same KQI class in the sample standardized KQI vectors and original QOE values corresponding to the sample standardized KQI vectors to obtain stable original KQI values and stable QOE values;

accordingly, the analyzing the relationship between the KQI values corresponding to the same KQI class in the multiple groups of original KQI vectors and the QOE values corresponding to the original KQI vectors to establish the function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors specifically comprises;

analyzing a relationship between the stable original KQI values and the stable QOE values to establish the function relationship.

14. The method for ensuring the QOE of a telecommunication service according to claim 13, wherein,

the selecting the standardized KQI vectors whose KPI states are evenly distributed to form the sample standardized KQI vectors specifically comprises:

selecting, from a vector space constituted by the standardized KQI vectors, a multi-dimensional space entity that comprises all the standardized KQI vectors, wherein each dimension of the multi-dimensional space entity comprises a minimum value, a maximum value, and a value between the minimum value and the maximum value that are in the standardized KQI vectors and fall on the dimension; and

evenly dividing the multi-dimensional space entity along each dimension of the multi-dimensional space entity into adjacent space area blocks, selecting at random, from each of the space area blocks that comprises not less than the preset number N of standardized KQI vectors, N standardized KQI vectors, and using the selected N standardized KQI vectors as the standardized KQI vectors whose KPI states are evenly distributed to form the sample standardized KQI vectors.

15. The method for ensuring the QOE of a telecommunication service according to claim 11, wherein the stabilizing of the relationship between the original KQI values corresponding to the same KQI class in the sample standardized KQI vectors and the original QOE values corresponding to the sample standardized KQI vectors to obtain the stable original KQI values and stable QOE values specifically comprises:

sorting multiple original KQI values corresponding to multiple standardized KQI values corresponding to the same KQI class in the sample standardized KQI vectors to form an original KQI value sequence, and dividing the original KQI value sequence evenly into original KQI value sequence segments; and

calculating an average value or probability distribution of original KQI values in each of the original KQI value sequence segments as a stable original KQI value, and calculating an average value or probability distribution of the respective QOE values corresponding to sample standardized KQI vectors where standard KQI values corresponding to the original KQI values in each of the original KQI value sequence segments are located as a stable QOE value.

16. The method for ensuring the QOE of a telecommunication service according to claim 11, wherein the stabilizing of the relationship between the original KQI values corresponding to the same KQI class in the sample standardized KQI vectors and the original QOE values corresponding to the sample standardized KQI vectors to obtain the stable original KQI values and stable QOE values specifically comprises:

using same QOE values corresponding to the sample standardized KQI vectors as the stable QOE values; and

calculating an average value or probability distribution of original KQI values corresponding to multiple standardized KQI values corresponding to the same KQI class in the sample standardized KQI vectors that have the stable QOE values, as a stable original KQI value.

17. The method for ensuring the QOE of a telecommunication service according to claim 10 wherein the standardizing of each group of original KQI vectors in the multiple groups of original KQI vectors to form the corresponding multiple groups of standardized KQI vectors specifically comprises:

converting original KQI values in each of the original KQI vectors through formula (a) into standard scores to acquire a standardized KQI vector corresponding to the original KQI vector;

18. The method for ensuring the QOE value of a telecommunication service according to claim 11, wherein the analyzing of the relationship between the stable original KQI values and the stable QOE values to establish the function relationship specifically comprises:

analyzing the relationship between the stable original KQI values and the stable QOE values and applying a single regression modeling method to establish the function relationship between the original KQI values corresponding to the same KQI class and the respective QOE values corresponding to the original KQI vectors.

19. The method for ensuring the QOE of a telecommunication service according to claim 18, wherein the applying of the single regression modeling method to establish the function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors specifically comprises:

with the stable QOE values as independent variables, and with the stable original KQI values as dependent variables, obtaining the function relationship through regression analysis.

20. A method for ensuring quality of experience (QOE) of a telecommunication service, comprising a network apparatus monitoring a plurality of network elements respectively providing the telecommunication service, wherein the network apparatus comprises at least a processor which is configured to cause the network apparatus to perform functions, comprising:

acquiring multiple groups of original Key Quality Indicator (KQI) vectors and a QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors, wherein the multiple groups of original KQI vectors correspond to the plurality of network elements respectively providing the telecommunication service, and each group of original KQI vectors comprises original KQI values corresponding to different KQI classes, wherein the acquiring the multiple groups of the original KQI vectors and the respective QOE value corresponding to each group of the original KQI vectors in the multiple groups of the original KQI vectors, further comprises;

acquiring the multiple original KQI values of a particular class of the telecommunication service, wherein the multiple original KQI values constituting the multiple groups of the original KQI vectors;

standardizing each group of original KQI vectors in the multiple groups of the original KQI vectors in order to form corresponding multiple groups of standardized KQI vectors, wherein each respective group of the standardized KQI vectors being corresponding to a corresponding Key Performance Index (KPI) state;

analyzing a relationship between original KQI values corresponding to a same KQI class in the multiple groups of original KQI vectors and QOE values corresponding to the original KQI vectors to establish a function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors;

acquiring a current KQI value under a certain KQI class, and applying the function relationship to determine a pre-estimated QOE value corresponding to the current KQI value of the telecommunication service;

comparing the pre-estimated QOE value corresponding to the current KQI value against a preset QOE threshold value to determine whether the pre-estimated QOE value corresponding to the current KQI value is less than the QOE threshold value;

if the pre-estimated QOE value corresponding to the current KQI value is less than the QOE threshold value, determining a theoretical KQI value corresponding to the pre-estimated QOE value corresponding to the current KQI value under each KQI class by applying the function relationship between the KQI values corresponding to the same KQI class and the QOE values corresponding to the KQI vectors and according to the pre-estimated QOE value corresponding to the current KQI value;

comparing the determined theoretical KQI value corresponding to the pre-estimated QOE value corresponding to the current KQI value under each KQI class and a preset KQI threshold value in the KQI class, and determining a KQI class under which the theoretical KQI value is most approximate to the preset KQI threshold value as a key KQI factor for resulting in a case where the pre-estimated QOE value is less than the preset QOE threshold value; and

adjusting the determined key KQI factor to ensure that a current QOE value which corresponds to a respective network element which provides the respective telecommunication service complies with the preset QOE threshold value, wherein the current QOE value is obtained from the acquired current KQI vector, by applying the function relationship between the original KQI vectors and the QOE values corresponding to the original KQI vectors; and

utilizing the obtained current QOE value to adjust service parameters of the respective network element to improve a respective particular class of telecommunication service, wherein the improving of the respective particular class of telecommunication service, comprises one or more of the following;

yielding higher caller connection success rate and better voice quality in voice service,

reducing caller access duration and call drop rate in voice service,

yielding higher access success rate, refresh success rate and average downloading speed in web browsing service,

reducing refresh duration and drop rate in web browsing service, and

yielding higher success rate and reducing delay in a short messaging service (SMS).

21. The method for ensuring QOE of a telecommunication service according to claim 20, wherein,

the acquiring the multiple groups of original KQI vectors and the QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors specifically comprises:

acquiring original QOE values corresponding to the multiple groups of standardized KQI vectors;

selecting standardized KQI vectors whose Key Performance Index (KPI) states are approximate to form sample standardized KQI vectors; and

stabilizing a relationship between original KQI values corresponding to a same KQI class in the sample standardized KQI vectors and original QOE values corresponding to the sample standardized KQI vectors to obtain stable original KQI values and stable QOE values;

accordingly, the analyzing the relationship between the KQI values corresponding to the same KQI class in the multiple groups of original KQI vectors and the QOE values corresponding to the original KQI vectors to establish the function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors specifically comprises;

analyzing a relationship between the stable original KQI values and the stable QOE values to establish the function relationship.

22. The method for ensuring QOE of a telecommunication service according to claim 21, wherein the acquiring the original QOE values corresponding to the multiple groups of standardized KQI vectors specifically comprises:

selecting, from a vector space constituted by the standardized KQI vectors, a multi-dimensional space entity that comprises all the standardized KQI vectors, wherein each dimension of the multi-dimensional space entity comprises a minimum value, a maximum value, and a value between the minimum value and the maximum value that are in the standardized KQI vectors and fall on the dimension;

evenly dividing the multi-dimensional space entity along each dimension of the multi-dimensional space entity into adjacent space area blocks, and selecting the same quantity of standardized KQI vectors from each of the space area blocks; and

acquiring original QOE values corresponding to the standardized KQI vectors selected from each of the space area blocks;

accordingly, selecting the standardized KQI vectors whose KPI states are approximate to form sample standardized KQI vectors;

calculating distances between the standardized KQI vectors selected from each of the space area blocks; and

according to the calculated distances, selecting, for each of the selected standardized KQI vectors, multiple standardized KQI vectors that have shortest distances from the standardized KQI vector as the standardized KQI vectors whose KPI states are approximate to form the sample standardized KQI vectors.

23. The method for ensuring QOE of a telecommunication service according to claim 20, wherein,

the acquiring the multiple groups of original KQI vectors and the QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors specifically comprises:

selecting standardized KQI vectors whose KPI states are evenly distributed to form sample standardized KQI vectors;

acquiring original QOE values corresponding to the sample standardized KQI vectors; and

stabilizing a relationship between original KQI values corresponding to a same KQI class in the sample standardized KQI vectors and original QOE values corresponding to the sample standardized KQI vectors to obtain stable original KQI values and stable QOE values;

accordingly, the analyzing the relationship between the KQI values corresponding to the same KQI class in the multiple groups of original KQI vectors and the QOE values corresponding to the original KQI vectors to establish the function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors specifically comprises;

analyzing a relationship between the stable original KQI values and the stable QOE values to establish the function relationship.

24. The method for ensuring QOE of a telecommunication service according to claim 23, wherein,

the selecting the standardized KQI vectors whose KPI states are evenly distributed to form the sample standardized KQI vectors specifically comprises:

selecting, from a vector space constituted by the standardized KQI vectors, a multi-dimensional space entity that comprises all the standardized KQI vectors, wherein each dimension of the multi-dimensional space entity comprises a minimum value, a maximum value, and a value between the minimum value and the maximum value that are in the standardized KQI vectors and fall on the dimension; and

evenly dividing the multi-dimensional space entity along each dimension of the multi-dimensional space entity into adjacent space area blocks, selecting at random, from each of the space area blocks that comprises not less than the preset number N of standardized KQI vectors, N standardized KQI vectors, and using the selected N standardized KQI vectors as the standardized KQI vectors whose KPI states are evenly distributed to form the sample standardized KQI vectors.

25. The method for ensuring QOE of a telecommunication service according to any one of claim 21, wherein the stabilizing the relationship between the original KQI values corresponding to the same KQI class in the sample standardized KQI vectors and the original QOE values corresponding to the sample standardized KQI vectors to obtain the stable original KQI values and stable QOE values specifically comprises:

sorting multiple original KQI values corresponding to multiple standardized KQI values corresponding to the same KQI class in the sample standardized KQI vectors to form an original KQI value sequence, and dividing the original KQI value sequence evenly into original KQI value sequence segments; and

calculating an average value or probability distribution of original KQI values in each of the original KQI value sequence segments as a stable original KQI value, and calculating an average value or probability distribution of QOE values corresponding to the sample standardized KQI vectors where standard KQI values corresponding to the original KQI values in each of the original KQI value sequence segments are located as a stable QOE value.

26. The method for ensuring QOE of a telecommunication service according to any one of claim 21, wherein the stabilizing the relationship between the original KQI values corresponding to the same KQI class in the sample standardized KQI vectors and the original QOE values corresponding to the sample standardized KQI vectors to obtain the stable original KQI values and stable QOE values specifically comprises:

using same QOE values corresponding to the sample standardized KQI vectors as the stable QOE values; and

calculating an average value or probability distribution of original KQI values corresponding to multiple standardized KQI values corresponding to the same KQI class in the sample standardized KQI vectors that have the stable QOE values, as a stable original KQI value.

27. The method for ensuring QOE of a telecommunication service according to any one of claim 20, wherein the standardizing of each group of original KQI vectors in the multiple groups of original KQI vectors to form the corresponding multiple groups of standardized KQI vectors specifically comprises:

converting original KQI values in each of the original KQI vectors through formula (a) into standard scores to acquire a standardized KQI vector corresponding to the original KQI vector;

28. The method for ensuring QOE of a telecommunication service according to any one of claim 21, wherein the analyzing the relationship between the stable original KQI values and the stable QOE values to establish the function relationship specifically comprises:

analyzing the relationship between the stable original KQI values and the stable QOE values and applying a single regression modeling method to establish the function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors.

29. The method for ensuring QOE of a telecommunication service according to claim 28, wherein the applying the single regression modeling method to establish the function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors specifically comprises:

with a stable QOE value as an independent variable, and with a stable original KQI value as a dependent variable, obtaining the function relationship through regression analysis.

30. A network apparatus for acquiring a current quality of experience (QOE) value of a telecommunication service, comprising at least a processor which is configures the network apparatus to:

monitor a plurality of network elements respectively providing the telecommunication service;

acquire multiple groups of original Key Quality Indicator (KQI) vectors and a QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors, wherein the multiple groups of original KQI vectors correspond to the plurality of network elements respectively providing the telecommunication service;

acquire multiple original KQI values of a particular class of the telecommunication service, wherein the multiple original KQI values constituting the multiple groups of original KQI vectors;

standardize each group of the original KQI vectors in the multiple groups of original KQI vectors in order to form corresponding multiple groups of standardized KQI vectors, wherein each respective group of standardized KQI vectors being corresponding to a corresponding Key Performance Index (KPI) state;

analyze a relationship between the multiple groups of original KQI vectors and QOE values corresponding to the multiple groups of original KQI vectors to establish a function relationship between the original KQI vectors which correspond to the plurality of network elements providing the telecommunication service, and respective QOE values corresponding to the KQI vectors; and

acquire a current KQI vector, and apply the function relationship between the original KQI vectors and the respective QOE values corresponding to the KQI vectors, in order to obtain the current QOE value which corresponds to a respective network element which provides the respective telecommunication service corresponding to the current KQI vector; and

utilize the obtained current QOE value to adjust service parameters of the respective network element to improve a respective particular class of telecommunication service, wherein the improving of the respective particular class of telecommunication service comprises the respective network element configured to perform one or more of the following;

yield higher caller connection success rate and better voice quality in voice service,

reduce caller access duration and call drop rate in voice service,

yield higher access success rate, refresh success rate and average downloading speed in web browsing service,

reduce refresh duration and drop rate in web browsing service, and

yield higher success rate and reducing delay in a short messaging service (SMS).

31. The network apparatus for acquiring the QOE value of a telecommunication service according to claim 30, wherein the network apparatus is further configure to:

acquire original QOE values corresponding to the multiple groups of standardized KQI vectors;

select standardized KQI vectors whose KPI states are approximate to form sample standardized KQI vectors; and

stabilize a relationship between original KQI vectors corresponding to the sample standardized KQI vectors and original QOE values corresponding to the sample standardized KQI vectors to obtain stable original KQI vectors and stable QOE values;

accordingly, the analyzing of the relationship between the multiple groups of original KQI vectors and QOE values corresponding to the multiple groups of original KQI vectors establishes the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors comprises;

analyzing a relationship between the stable original KQI vectors and the stable QOE values to establish the function relationship.

32. The network apparatus for acquiring the QOE value of a telecommunication service according to claim 31, is further configured to:

select, from a vector space constituted by the standardized KQI vectors, a multi-dimensional space entity that comprises all the standardized KQI vectors, wherein each dimension of the multi-dimensional space entity comprises a minimum value, a maximum value, and a value between the minimum value and the maximum value that are in the standardized KQI vectors and fall on the dimension;

evenly divide the multi-dimensional space entity along each dimension of the multi-dimensional space entity into adjacent space area blocks, and select the same quantity of standardized KQI vectors from each of the space area blocks; and

acquire original QOE values corresponding to the standardized KQI vectors selected from each of the space area blocks;

calculate distances between the standardized KQI vectors selected from each of the space area blocks; and

according to the calculated distances, select, for each of the selected standardized KQI vectors, multiple standardized KQI vectors that have shortest distances from the standardized KQI vector as the standardized KQI vectors whose KPI states are approximate to form sample standardized KQI vectors.

33. The network apparatus for acquiring the QOE value of a telecommunication service according to claim 30, is further configured to:

select standardized KQI vectors whose KPI states are evenly distributed to form sample standardized KQI vectors; and

acquire original QOE values corresponding to the sample standardized KQI vectors; and

stabilize a relationship between original KQI vectors corresponding to the sample standardized KQI vectors and the original QOE values corresponding to the sample standardized KQI vectors to obtain stable original KQI vectors and stable QOE values;

analyze the relationship between the multiple groups of original KQI vectors and the QOE values corresponding to the multiple groups of original KQI vectors to establish the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors comprises;

analyze a relationship between the stable original KQI vectors and the stable QOE values to establish the function relationship.

34. The network apparatus for acquiring the QOE value of a telecommunication service according to claim 33, further configured to:

select, from a vector space constituted by the standardized KQI vectors, a multi-dimensional space entity that comprises all the standardized KQI vectors, wherein each dimension of the multi-dimensional space entity comprises a minimum value, a maximum value, and a value between the minimum value and the maximum value that are in the standardized KQI vectors and fall on the dimension; and

evenly divide the multi-dimensional space entity along each dimension of the multi-dimensional space entity into adjacent space area blocks, select at random, from each of the space area blocks that comprises not less than the preset number N of standardized KQI vectors, N standardized KQI vectors, and use the selected N standardized KQI vectors as the standardized KQI vectors whose KPI states are evenly distributed to form sample standardized KQI vectors.

35. The network apparatus for acquiring the QOE value of a telecommunication service according to claim 31, wherein the stabilizing of the relationship between the original KQI vectors corresponding to the sample standardized KQI vectors and the original QOE values corresponding to the sample standardized KQI vectors to obtain the stable original KQI vectors and the stable QOE values, specifically comprises:

calculating an average value or probability distribution of the original KQI vectors corresponding to the sample standardized KQI vectors as a stable original KQI vector, and calculating an average value or probability distribution of the original QOE values corresponding to the sample standardized KQI vectors as a stable QOE value.

36. The network apparatus for acquiring the QOE value of a telecommunication service according to claim 30, wherein the standardizing of each group of the original KQI vectors in the multiple groups of original KQI vectors to form corresponding multiple groups of standardized KQI vectors, specifically comprises:

converting original KQI values in each of the original KQI vectors through formula (a) into standard scores to acquire a standardized KQI vector corresponding to the original KQI vector;

37. The network apparatus for acquiring the QOE value of a telecommunication service according to any one of claim 31, wherein the analyzing of the relationship between the multiple groups of original KQI vectors and the QOE values corresponding to the multiple groups of original KQI vectors to establish the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors, specifically comprises:

analyzing a relationship between the stable original KQI vectors and the stable QOE values and using a multiple regression modeling method to establish the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors.

38. The network apparatus for acquiring the QOE value of a telecommunication service according to claim 37, wherein the analyzing the relationship between the stable original KQI vectors and the stable QOE values and using the multiple regression modeling method to establish the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors specifically comprises:

with a stable original KQI vector as an independent variable, and with a stable QOE value as a dependent variable, obtaining the function relationship between the stable QOE values and the stable original KQI vectors through multiple regression analysis; and

performing conversion for the obtained function relationship between the stable QOE values and the stable original KQI vectors to acquire the function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors, so that a QOE value calculated through the acquired function relationship between the KQI vectors and the QOE values corresponding to the KQI vectors is confined within a preset value range.

39. A network apparatus for ensuring quality of experience (QOE) of a telecommunication service, comprising at least a processor which configures the network apparatus to:

monitor a plurality of network elements respectively providing the telecommunication service;

acquire multiple groups of original Key Quality Indicator (KQI) vectors and a QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors, wherein the multiple groups of original KQI vectors correspond to the plurality of network elements respectively providing the telecommunication service, and each group of original KQI vectors comprises original KQI values corresponding to different KQI classes;

acquire multiple original KQI values of a particular class of the telecommunication service, wherein the multiple original KQI values constituting the multiple groups of original KQI vectors;

standardize each group of the original KQI vectors in the multiple groups of original KQI vectors in order to form corresponding multiple groups of standardized KQI vectors, wherein each respective group of standardized KQI vectors being corresponding to a corresponding Key Performance Index (KPI) state;

analyze a relationship between original KQI values corresponding to a same KQI class in the multiple groups of original KQI vectors and QOE values corresponding to the original KQI vectors to establish a function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors of the plurality of network elements which provide the telecommunication service;

according to a preset QOE threshold value, apply the function relationship to determine a KQI threshold value corresponding to a certain KQI class; and

according to the KQI threshold value corresponding to the certain KQI class, adjust a current KQI value corresponding to the certain KQI class to ensure that a current QOE value of the telecommunication service complies with the preset QOE threshold value, wherein the current QOE value is obtained from the acquired current KQI vector, by applying the function relationship between the original KQI vectors and the QOE values corresponding to the original KQI vectors; and

; and

utilize the current QOE value to adjust service parameters of the respective network element to improve a respective particular class of telecommunication service, wherein the improving of the respective particular class of telecommunication service comprises the respective network element configured to perform one or more of the following;

yield higher caller connection success rate and better voice quality in voice service,

reduce caller access duration and call drop rate in voice service,

yield higher access success rate, refresh success rate and average downloading speed in web browsing service,

reduce refresh duration and drop rate in web browsing service, and

yield higher success rate and reducing delay in a short messaging service (SMS).

40. A network apparatus for ensuring quality of experience (QOE) of a telecommunication service, comprising at least a processor which configures the network apparatus to:

monitor a plurality of network elements respectively providing the telecommunication service;

acquire multiple groups of original Key Quality Indicator (KQI) vectors and a QOE value corresponding to each group of original KQI vectors in the multiple groups of original KQI vectors, wherein the multiple groups of original KQI vectors correspond to the plurality of network elements respectively providing the telecommunication service, and each group of original KQI vectors comprises original KQI values corresponding to different KQI classes;

acquire multiple original KQI values of a particular class of the telecommunication service, wherein the multiple original KQI values constituting the multiple groups of original KQI vectors;

standardize each group of the original KQI vectors in the multiple groups of original KQI vectors in order to form corresponding multiple groups of standardized KQI vectors, wherein each respective group of standardized KQI vectors being corresponding to a corresponding Key Performance Index (KPI) state;

analyze a relationship between original KQI values corresponding to a same KQI class in the multiple groups of original KQI vectors and QOE values corresponding to the original KQI vectors to establish a function relationship between the original KQI values corresponding to the same KQI class and the QOE values corresponding to the original KQI vectors;

acquire a current KQI value under a certain KQI class, and apply the function relationship to determine a pre-estimated QOE value corresponding to the current KQI value;

compare the pre-estimated QOE value corresponding to the current KQI value against a preset QOE threshold value to determine whether the pre-estimated QOE value corresponding to the current KQI value is less than the QOE threshold value;

if the pre-estimated QOE value corresponding to the current KQI value is less than the QOE threshold value, determine a theoretical KQI value corresponding to the pre-estimated QOE value corresponding to the current KQI value under each KQI class by applying the function relationship between the KQI values corresponding to the same KQI class and the QOE values corresponding to the KQI vectors and according to the pre-estimated QOE value corresponding to the current KQI value;

compare the determined theoretical KQI value corresponding to the pre-estimated QOE value corresponding to the current KQI value under each KQI class and a preset KQI threshold value in the KQI class, and determine a KQI class under which the theoretical KQI value is most approximate to the preset KQI threshold value as a key KQI factor for resulting in a case where the pre-estimated QOE value is less than the preset QOE threshold value; and

adjust the determined key KQI factor to ensure that a current QOE value of the telecommunication service complies with the preset QOE threshold value, wherein the current QOE value is obtained from the acquired current KQI vector, by applying the function relationship between the original KQI vectors and the QOE values corresponding to the original KQI vectors; and

utilize the current QOE value to adjust service parameters of respective network element to improve a respective particular class of telecommunication service, wherein the improving of the respective particular class of telecommunication service comprises the respective network element configured to perform one or more of the following;

yield higher caller connection success rate and better voice quality in voice service,

reduce caller access duration and call drop rate in voice service,

yield higher access success rate, refresh success rate and average downloading speed in web browsing service,

reduce refresh duration and drop rate in web browsing service, and

yield higher success rate and reducing delay in a short messaging service (SMS).