Resource consumption estimation with out of norm determination in mobile devices

• US 9,986,450 B2
• Filed: 07/02/2013
• Issued: 05/29/2018
• Est. Priority Date: 07/02/2013
• Status: Expired due to Fees

• Current Assignee: AT&T Mobility LLC (AT&T, Inc.)
• Original Assignee: Carrier Iq
• Inventors: Gutierrez, Jr., Alberto, Wang, Chang Jia
• Primary Examiner(s): Lee, Thomas
• Assistant Examiner(s): Wang, Zhipeng
• Application Number:
  US13/933,126
• Publication Number:
  US 20150011177A1
• Time in Patent Office: 1,792 Days
• CPC Class Codes: H04W 24/08 Testing, supervising or monitoring using real traffic
• CPC Class Codes: H04W 4/60 Subscription-based services using application servers or record carriers, e.g. SIM application toolkits

Abstract

A method estimates resource consumption between applications within and among a population of wireless mobile devices. Aggregating and analyzing samples for each member of the population of devices provides comparable individual results. Subsequently aggregating and analyzing only summary information for each member of the population of devices provides cluster, crowd, and global comparisons. An apparatus determines out of norm behavior of an individual within a crowd, or relative differences between two crowds.

Claims

1. A method comprising:

estimating resource consumption attributable to one or more mobile wireless device applications, by performing the operations;

receiving, from each of a plurality of mobile wireless devices, a report of remaining resource availability of the mobile wireless device measured by the mobile wireless device at certain events in time, wherein the resource is a consumable resource, and the resource comprises mobile wireless device memory and mobile wireless device battery power;

receiving, recorded at each event-time, a list of applications of each mobile wireless device that have been active since the last measurement;

for each first application on each mobile wireless device, estimating an average resource consumption for each first application, wherein explicit knowledge and measurement of a battery drain rate by each first application is not available, and explicit knowledge and measurement of free memory remaining after memory usage by each first application is not available;

determining a mean, median, and standard deviation of resource consumption for each resource of each of a subset of mobile wireless devices which have a selected first application in the list of applications that have been active since the last measurement;

selecting the group of all mobile wireless devices in the population which have a selected first application in the list of applications;

determining a mean, median, and standard deviation of resource consumption for all mobile wireless devices in the population which have a selected first application in its respective list of applications recorded at each event-time;

ascribing the mean, median, and standard deviation of resource consumption to the selected first application; and

using the estimated resource consumption information to identify one or both of;

a resource of one of the mobile wireless devices that is being overconsumed by an application; and

the application that is overconsuming the resource.

2. The method of claim 1, further comprising:

for each second application on each mobile wireless device, estimating an average resource consumption for each second application;

determining a mean, median, standard deviation of resource consumption for each resource of each of a subset of mobile wireless devices which have a selected second application in the list of applications that have been active since the last measurement;

selecting the group of all mobile wireless devices in the population which has a selected second application in the list of applications;

determining a mean, median, standard deviation of resource consumption for all mobile wireless devices in the population which have a selected second application in its respective list of applications recorded at each event-time; and

ascribing the mean, median, standard deviation of resource consumption to the selected second application.

3. The method of claim 2, further comprising:

for each first or second application version on each mobile wireless device, estimating an average resource consumption for each first or second application version;

determining a mean, median, standard deviation of resource consumption for each resource of each of a subset of mobile wireless devices which have either selected first application or selected second application in the list of applications that have been active since the last measurement;

selecting the group of all mobile wireless devices in the population which has either one of or both selected first application and selected second application version in the list of applications;

determining a mean, median, standard deviation of resource consumption for all mobile wireless devices in the population which have one of or both first application and second application in its respective list of applications recorded at each event-time;

ascribing the mean, median, standard deviation of resource consumption to the set of first and second applications; and

determining if the differences among mean, median, standard deviations of resource consumption of first selected application and second selected application are statistically significant.

4. The method of claim 1 wherein the first application is a first version of a first application and the second application is a second version of the first application,

whereby regression testing determines either that a newer version of an application is an improvement or not an unintentional substantial degradation of a previous version of an application.

5. A method to identify Apps that over consume resources on all mobile wireless devices at a specified level of confidence comprising:

estimating resource consumption attributable to one or more mobile wireless device applications, by performing the operations;

receiving, from each of a plurality of mobile wireless devices, a report of remaining resource availability of the mobile wireless device measured by the mobile wireless device at certain events in time, wherein the resource is a consumable resource, and the resource comprises mobile wireless device memory and mobile wireless device battery power;

receiving, recorded at each event-time, a list of applications of each mobile wireless device that have been active since the last measurement;

for each first application on each mobile wireless device, estimating an average resource consumption for each first application, wherein explicit knowledge and measurement of a battery drain rate by each first application is not available, and explicit knowledge and measurement of free memory remaining after memory usage by each first application is not available;

determining a mean, median, and standard deviation of resource consumption for each resource of each of a subset of mobile wireless devices which have a selected first application in the list of applications that have been active since the last measurement;

selecting the group of all mobile wireless devices in the population which have a selected first application in the list of applications;

determining a mean, median, and standard deviation of resource consumption for all mobile wireless devices in the population which have a selected first application in its respective list of applications recorded at each event-time;

ascribing the mean, median, and standard deviation of resource consumption to the selected first application;

using the estimated resource consumption information to identify one or both of;

a resource of one of the mobile wireless devices that is being overconsumed by an application; and

the application that is overconsuming the resource;

receiving results of the resource consumption estimation;

testing if App X is in the top P-th percentile of resource consumption on all devices with 95% confidence; and

generating, for a specified crowd, a list of apps that over consume resources.

6. The method of claim 5 wherein the test is a 2-sample t-test since the key test is comparing two distributions.

11. The method of claim 5, wherein the top P-th percentile is the top 10%.

7. A method to find App-Device combinations where an App over consumes resources comprising:

estimating resource consumption attributable to one or more mobile wireless device applications, by performing the operations;

receiving, from each of a plurality of mobile wireless devices, a report of remaining resource availability of the mobile wireless device measured by the mobile wireless device at certain events in time, wherein the resource is a consumable resource, and the resource comprises mobile wireless device memory and mobile wireless device battery power;

receiving, recorded at each event-time, a list of applications of each mobile wireless device that have been active since the last measurement;

for each first application on each mobile wireless device, estimating an average resource consumption for each first application, wherein explicit knowledge and measurement of a battery drain rate by each first application is not available, and explicit knowledge and measurement of free memory remaining after memory usage by each first application is not available;

determining a mean, median, and standard deviation of resource consumption for each resource of each of a subset of mobile wireless devices which have a selected first application in the list of applications that have been active since the last measurement;

selecting the group of all mobile wireless devices in the population which have a selected first application in the list of applications;

determining a mean, median, and standard deviation of resource consumption for all mobile wireless devices in the population which have a selected first application in its respective list of applications recorded at each event-time;

ascribing the mean, median, and standard deviation of resource consumption to the selected first application; and

using the estimated resource consumption information to identify one or both of;

a resource of one of the mobile wireless devices that is being overconsumed by an application; and

the application that is overconsuming the resource;

testing an APP against a global set of applications and mobile wireless devices;

denoting an App-Device combination as high when the estimated resource consumption information indicates that the estimated resource consumption of the App-Device combination is in the top P-th percentile as compared to the statistics of the global set; and

generating a list of App-Device combinations where the App over consumes resources.

8. The method of claim 7 wherein the test is a 1-sample t-test.

12. The method as recited in claim 7 wherein consumption of the resource corresponds to a battery drain rate.

13. The method of claim 7, wherein the top P-th percentile is the top 10%.

9. A non-transitory storage device having stored therein computer-executable instructions which, when executed by one or more hardware processors of a computing system, perform:

estimating resource consumption attributable to one or more mobile wireless device applications, by performing the operations;

receiving, from each of a plurality of mobile wireless devices, a report of remaining resource availability of the mobile wireless device measured by the mobile wireless device at certain events in time, wherein the resource is a consumable resource, and the resource comprises mobile wireless device memory and mobile wireless device battery power;

receiving, recorded at each event-time, a list of applications of each mobile wireless device that have been active since the last measurement;

for each first application on each mobile wireless device, estimating an average resource consumption for each first application, wherein explicit knowledge and measurement of a battery drain rate by each first application is not available, and explicit knowledge and measurement of free memory remaining after memory usage by each first application is not available;

determining a mean, median, and standard deviation of resource consumption for each resource of each of a subset of mobile wireless devices which have a selected first application in the list of applications that have been active since the last measurement;

selecting the group of all mobile wireless devices in the population which have a selected first application in the list of applications;

determining a mean, median, and standard deviation of resource consumption for all mobile wireless devices in the population which have a selected first application in its respective list of applications recorded at each event-time;

ascribing the mean, median, and standard deviation of resource consumption to the selected first application; and

using the estimated resource consumption information to identify one or both of;

a resource of one of the mobile wireless devices that is being overconsumed by an application; and

the application that is overconsuming the resource.

10. A non-transitory storage device having stored therein computer-executable instructions which, when executed by one or more hardware processors of a computing system, perform:

receiving results of a resource consumption estimation;

testing if App X is in the top P-th percentile of resource consumption on all devices with 95% confidence; and

generating, for a specified crowd, a list of apps that over consume resources,

wherein the resource consumption estimation comprises the operations;

receiving, from each of a plurality of mobile wireless devices, a report of remaining resource availability of the mobile wireless device measured by the mobile wireless device at certain events in time, wherein the resource is a consumable resource, and the resource comprises mobile wireless device memory and mobile wireless device battery power;

receiving, recorded at each event-time, a list of applications of each mobile wireless device that have been active since the last measurement;

for each first application on each mobile wireless device, estimating an average resource consumption for each first application, wherein explicit knowledge and measurement of a battery drain rate by each first application is not available, and explicit knowledge and measurement of free memory remaining after memory usage by each first application is not available;

determining a mean, median, and standard deviation of resource consumption for each resource of each of a subset of mobile wireless devices which have a selected first application in the list of applications that have been active since the last measurement;

selecting the group of all mobile wireless devices in the population which have a selected first application in the list of applications;

determining a mean, median, and standard deviation of resource consumption for all mobile wireless devices in the population which have a selected first application in its respective list of applications recorded at each event-time;

ascribing the mean, median, and standard deviation of resource consumption to the selected first application; and

using the estimated resource consumption information to identify one or both of;

a resource of one of the mobile wireless devices that is being overconsumed by an application; and

the application that is overconsuming the resource.