Remote driving of mobile device diagnostic applications

• US 10,412,550 B2
• Filed: 12/29/2016
• Issued: 09/10/2019
• Est. Priority Date: 10/29/2012
• Status: Active Grant

• Current Assignee: T-Mobile USA, Inc. (Deutsche Telekom AG)
• Original Assignee: T-Mobile USA, Inc. (Deutsche Telekom AG)
• Inventors: Yoon, Jong Sung, Hui, Jie, Sontineni, Kranthi, Tran, Antoine
• Primary Examiner(s): Musa, Abdelnabi O
• Application Number:
  US15/394,502
• Publication Number:
  US 20170149626A1
• Time in Patent Office: 985 Days
• CPC Class Codes: H04L 41/0631 using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
• CPC Class Codes: H04L 41/064 involving time analysis
• CPC Class Codes: H04L 41/065 involving logical or physical relationship, e.g. grouping and hierarchies
• CPC Class Codes: H04L 41/069 using logs of notifications; Post-processing of notifications
• CPC Class Codes: H04L 41/5025 by proactively reacting to service quality change, e.g. by reconfiguration after service quality degradation or upgrade
• CPC Class Codes: H04L 41/5067 Customer-centric QoS measurements
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04W 24/04 Arrangements for maintaining operational condition
• CPC Class Codes: H04W 24/10 Scheduling measurement reports ; Arrangements for measurement reports
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

The remote analysis of mobile device quality of experience diagnostic files includes analyzing diagnostic files. A diagnostic driver application resident at the mobile device is remotely activated to generate and send diagnostic files to one or more network resident servers for analysis. The diagnostic files may be analyzed to determine the mobile device quality of experience, and to determine a root cause and geographic and/or network location of a problem, such as dropped calls or poor data connectivity. In some embodiments, the diagnostic files may be aggregated to form a database of aggregated diagnostics, which can be used to further analyze a telecommunications network to determine the root cause of a network problem.

Claims

1. A method for remotely diagnosing a quality of experience for a mobile communication device, comprising:

sending a command to a mobile device resident driver to at least one of configure or initiate a diagnostic process at a mobile device;

receiving diagnostic information from the mobile device that includes at least one operations log of the mobile device;

analyzing the diagnostic information to determine a level of quality of experience for the mobile device;

determining a degraded quality of experience event for the mobile device based on the level of the determined quality of experience, wherein determining the degraded quality of experience event for the mobile device comprises;

comparing the level of quality of experience for the mobile device with at least one of;

(a) at least one network key performance indicator (KPI) that is based on at least one trace file generated by one or more network nodes of a mobile telecommunication network, the at least one network KPI referring to a quality of service (QoS) of mobile telecommunication network, (b) aggregated device KPIs or quality of experience levels associated with the mobile device over time, or (c) aggregated device KPIs or quality of experience levels associated with a plurality of mobile devices;

determining a location of the degraded quality of experience event for the mobile device; and

analyzing the diagnostic information to determine a drop call rate for the mobile device;

determining a network drop call rate from the at least one network key performance indicator (KPI) that is based on the at least one trace file generated by one or more network nodes of the mobile telecommunication network; and

comparing the drop call rate and the network drop call rate to determine a drop call rate difference.

2. The method of claim 1, wherein the diagnostic information includes state information indicating a state of the mobile device for a voice communication and location information indicating a geographic location of the mobile device for the voice communication.

3. The method of claim 2, wherein the state information includes at least an error message provided by a dropped call and wherein the geographic location information includes the location of the mobile device at a time of the dropped call.

4. The method of claim 1, further comprising:

receiving diagnostic information from each of a plurality of mobile devices;

determining, for each of the plurality of mobile devices, the level of quality of experience;

aggregating the levels of quality of experience for the plurality of mobile devices; and

analyzing an aggregated levels of quality of experience to determine at least one quality of experience trend.

5. The method of claim 1, wherein determining the location of the degraded quality of experience event for the mobile device includes determining a geographic location for the mobile device where the degraded quality of experience event occurred.

6. The method of claim 1, wherein determining the location of the degraded quality of experience event for the mobile device includes determining a network location for the mobile device when the degraded quality of experience event occurred.

7. A non-transitory computer-readable media having computer-executable instructions stored thereon that, when executed by a computing device, cause the computing device to perform operations comprising:

sending a command to a mobile device resident driver to at least one of configure or initiate a diagnostic process at a mobile device;

receiving diagnostic information from the mobile device that includes at least an operations log of the mobile device;

analyzing the diagnostic information to determine a first drop call rate for the mobile device;

determining a network drop call rate based on at least one network key performance indicator (KPI) that is based on at least one trace file generated by one or more network nodes of a mobile telecommunication network, the at least one network KPI referring to a quality of service (QoS) of the mobile telecommunication network;

comparing the first drop call rate and the network drop call rate to determine a drop call rate difference;

analyzing the diagnostic information to determine a level of quality of experience for the mobile device;

determining a degraded quality of experience event for the mobile device based on the level of the determined quality of experience; and

determining a location of the degraded quality of experience event for the mobile device.

8. The non-transitory computer-readable media of claim 7, wherein the determining the location of the degraded quality of experience event for the mobile device includes determining a geographic location for the mobile device where the degraded quality of experience occurred.

9. The non-transitory computer-readable media of claim 7, wherein the determining the location of the degraded quality of experience event for the mobile device includes determining a network location for the mobile device when the degraded quality of experience occurred.

10. The non-transitory computer-readable media of claim 7, wherein the diagnostic information includes state information indicating a state of the mobile device for a voice communication and geographic location information indicating the location of the mobile device for the voice communication.

11. The non-transitory computer-readable media of claim 10, wherein the state information includes at least an error message provided by a dropped call and wherein the geographic location information includes the location of the mobile device at a time of the dropped call.

12. The non-transitory computer-readable media of claim 7, wherein the operations further comprise:

receiving diagnostic information from one or more of a plurality of mobile devices;

determining, for at least one mobile device of the plurality of mobile devices, a level of quality of experience;

aggregating the levels of quality of experience for at least one mobile device of the plurality of mobile devices; and

analyzing an aggregated levels of quality of experience to determine at least one quality of experience trend.

13. A server that remotely diagnose a quality of experience for a mobile communication device, comprising:

one or more processors;

memory including a plurality of computer-executable components that are executable by the one or more processors to perform a plurality of actions, the plurality of actions comprising;

sending a command across a telecommunication network, to multiple mobile device resident drivers of a plurality of mobile devices to at least one of configure or initiate diagnostic processes at the plurality of mobile devices;

receiving diagnostic information from multiple mobile devices of the plurality of mobile devices, wherein the diagnostic information includes call state information indicating at least one of;

a time at which a call was attempted by a respective mobile device, a time at which the call was established, a time at which the call was connected, and a time at which the call was disconnected;

determining levels of quality of experience for the multiple mobile devices based on corresponding diagnostic information;

aggregating the levels of quality of experience for the multiple mobile devices;

analyzing aggregated levels of quality of experience to determine at least one quality of experience trend for the multiple mobile devices, wherein the at least one quality of experience trend indicates the presence of a network issue with the telecommunication network;

analyzing the diagnostic information to determine a device drop call rate for each of the multiple mobile devices; and

aggregating device key performance indicators (KPIs) for the multiple mobile devices which indicate an increase in a respective device drop call rate.

14. The server of claim 13, wherein the sending the command to configure the diagnostic processes on the plurality of mobile devices includes sending the command to configure a mobile device to perform one or more diagnostic tests that are associated with a device group of the mobile device or a diagnostic test priority level to generate the diagnostic information for the mobile device.

15. The server of claim 14, wherein the device group has a device characteristic, a software characteristic, a hardware characteristic, or a network characteristic that is not present in other device groups.

16. The server of claim 14, wherein the one or more diagnostic tests are mapped to the device group of the mobile device in a data store that stores correlations between different sets of associated diagnostic tests and multiple device groups or diagnostic test priority levels.

17. The server of claim 14, wherein the diagnostic information for the mobile device include one or more of specific device state information, specific device key performance indicators, specific error logs of device error events, specific network stack trace data, specific device diagnostic logs.