Mobile application optimization platform

• US 9,454,364 B2
• Filed: 06/20/2014
• Issued: 09/27/2016
• Est. Priority Date: 07/17/2013
• Status: Active Grant

• Current Assignee: Accenture Global Services Limited (Accenture PLC)
• Original Assignee: Accenture Global Services Limited (Accenture PLC)
• Inventors: Williams, Murray
• Primary Examiner(s): Dao, Thuy
• Assistant Examiner(s): Sinha, Ravi K
• Application Number:
  US14/310,705
• Publication Number:
  US 20150026663A1
• Time in Patent Office: 830 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3668 Software testing software testing in telephone exchanges H04M3/242, testing of hardware G06F11/22
• CPC Class Codes: G06F 8/70 Software maintenance or management
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0246 Traffic
• CPC Class Codes: G06Q 30/0635 Processing of requisition or of purchase orders

Abstract

A device may receive configuration information for an experiment associated with optimizing an application. The configuration information may identify a group of experimental treatments and information identifying a target event. The device may identify an experimental treatment to be implemented in the application, and may implement the experimental treatment in the application. The device may collect response information based on implementing the experimental treatment. The device may detect the target event associated with the experiment, indicating that the response information is to be provided to an experiment server. The device may determine that the experiment server is unreachable and may store the response information. The response information may be stored to allow the response information to be provided to the experiment server at a later time. The response information may be provided to the experiment server to permit the experiment server to determine a result of the experiment.

Claims

1. A method, comprising:

receiving, by a device, experiment information,

the experiment information being associated with an experiment for optimizing an application, and

the experiment information including information associated with a group of attributes associated with the experiment;

generating, by the device, configuration information based on the group of attributes associated with the experiment information,

the configuration information including information that identifies a group of experimental treatments associated with the experiment;

providing, by the device, the configuration information,

the configuration information being provided to cause the group of experimental treatments to be implemented in the application by a group of test devices;

receiving, by the device, response information associated with the group of experimental treatments,

the response information being provided by the group of test devices;

receiving, by the device, descriptive information associated with users of the group of test devices;

receiving, by the device, outcome information associated with the group of experimental treatments;

receiving, by the device, financial information associated with the group of experimental treatments;

analyzing, by the device, the response information to determine a result associated with the experiment based on two or more of the descriptive information, the outcome information, or the financial information; and

providing, by the device, the result to allow the application to be optimized based on the result.

2. The method of claim 1, further comprising:

receiving, from a test device of the group of test devices, a request associated with identifying an experimental treatment to be implemented in the application by the test device;

determining, based on the configuration information, the experimental treatment to be implemented in the application by the test device; and

providing a response to the test device,

the response including information that identifies the experimental treatment to be implemented in the application by the test device.

3. The method of claim 1, further comprising:

receiving other response information associated with the group of experimental treatments,

the other response information being provided by a server device associated with the application; and

analyzing the other response information to determine another result associated with the experiment.

4. The method of claim 1, further comprising:

determining, based on the result, a particular experimental treatment of the group of experimental treatments; and

providing information associated with the particular experimental treatment to cause the group of test devices to implement the particular experimental treatment.

5. The method of claim 1, where the configuration information includes:

information indicating a start time for the experiment;

information indicating a stop time for the experiment;

information identifying a version of the application associated with starting the experiment;

or

information identifying a version of the application associated with stopping the experiment.

6. The method of claim 1,

where the configuration information further includes information identifying a target event associated with the experiment, and

where the target event comprises one of:

a purchase being completed using the application,

an interaction occurring with a particular user interface element via the application, or

a service being signed up for using the application.

7. A device, comprising:

a memory to store instructions; and

one or more processors that execute the instructions to cause the one or more processors to;

receive configuration information associated with an experiment associated with optimizing an application,

the configuration information identifying a group of experimental treatments associated with the experiment,

the configuration information including information identifying a target event associated with the experiment, and

the target event comprising one of;

a purchase being completed using the application, or

a service being signed up for using the application;

identify an experimental treatment, of the group of experimental treatments, to be implemented in the application;

implement the experimental treatment in the application;

collect response information, associated with the experimental treatment, based on implementing the experimental treatment,

the response information including information regarding an interaction of a user with a user interface of the application;

detect the target event associated with the experiment,

the target event being detected indicating that the response information is to be provided to an experiment server associated with the experiment;

determine, after detecting the target event, that the experiment server is unreachable; and

store the response information based on determining that the experiment server is unreachable,

the response information being stored to allow the response information to be provided to the experiment server at a later time, and

the response information being provided to the experiment server to permit the experiment server to analyze the response information to determine a result of the experiment.

8. The device of claim 7, where the one or more processors are further to:

wait for a period of time after determining that the experiment server is unreachable;

determine that the experiment server is reachable after waiting for the period of time; and

provide the response information to the experiment server after determining that the experiment server is reachable.

9. The device of claim 7, where, when identifying the experimental treatment to be implemented in the application, the one or more processors are to:

determine that the device is unable to communicate with the experiment server; and

select, based on determining that the device is unable to communicate with the experiment server, the experimental treatment to be implemented in the application,

the experimental treatment being selected based on the configuration information.

10. The device of claim 7, where the one or more processors are further to:

store information identifying the experimental treatment,

the information identifying the experimental treatment being stored to allow the information identifying the experimental treatment to be provided to the experiment server at the later time.

11. The device of claim 7,

where the one or more processors are further to:

determine that the device is able to communicate with the experiment server;

provide, to the experiment server, a request associated with identifying the experimental treatment; and

receive a response that identifies the experimental treatment to be implemented in the application; and

where the one or more processors, when identifying the experimental treatment to be implemented in the application, are to;

identify the experimental treatment based on the response that identifies the experimental treatment to be implemented in the application.

12. The device of claim 7, where the one or more processors, are further to:

determine descriptive information associated with the user; and

store the descriptive information associated with the user.

13. The device of claim 7, where the one or more processors are further to:

receive configuration information associated with multiple experiments,

the configuration information, associated with the multiple experiments, allowing the multiple experiments, associated with the application, to be conducted at the same time, and

the multiple experiments including the experiment.

14. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors, cause the one or more processors to;

receive configuration information associated with an experiment and an application,

the configuration information including information that identifies a group of experimental treatments associated with the experiment and information that identifies a target event associated with the experiment, and

the target event comprising one of;

a purchase being completed using the application, or

a service being signed up for using the application;

identify an experimental treatment, of the group of experimental treatments, to be implemented in the application;

cause the experimental treatment to be implemented in the application;

collect response information, associated with the experimental treatment, based on causing the experimental treatment to be implemented,

the response information including information regarding an interaction of a user with a user interface of the application;

receive an indication to provide the response information,

the indication being associated with an occurrence of the target event;

determine, after receiving the indication, that the response information cannot be provided to an experiment server; and

store, based on determining that the response information cannot be provided to the experiment server, the response information to allow the response information to be provided to the experiment server at a later time,

the response information being provided to the experiment server to permit the experiment server to analyze the response information and determine a result associated with experiment.

15. The non-transitory computer-readable medium of claim 14, where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

wait for a period of time after determining that the response information cannot be provided to the experiment server;

determine that the response information can be provided to the experiment server after waiting for the period of time; and

provide the response information to the experiment server after determining that the response information can be provided to the experiment server.

16. The non-transitory computer-readable medium of claim 14, where the one or more instructions, that cause the one or more processors to identify the experimental treatment to be implemented in the application, cause the one or more processors to:

determine that the experiment server cannot be reached; and

select, based on determining that the experiment server cannot be reached, the experimental treatment to be implemented in the application,

the experimental treatment being selected based on the configuration information.

17. The non-transitory computer-readable medium of claim 14, where the one or more instructions, that cause the one or more processors to store the response information, cause the one or more processors to:

store information identifying the experimental treatment,

the information identifying the experimental treatment being stored to allow the information identifying the experimental treatment to be provided to the experiment server at the later time.

18. The non-transitory computer-readable medium of claim 14,

where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

determine that the experiment server can be reached;

provide, to the experiment server, a request associated with identifying the experimental treatment to be implemented in the application; and

receive a response that identifies the experimental treatment to be implemented in the application; and

where the one or more instructions, that cause the one or more processors to identify the experimental treatment to be implemented in the application, cause the one or more processors to;

identify the experimental treatment based on the response that identifies the experimental treatment to be implemented in the application.

19. The non-transitory computer-readable medium of claim 14, where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

determine sensor information associated the application; and

store the sensor information associated with the application.

20. The non-transitory computer-readable medium of claim 14, where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:

receive configuration information associated with multiple experiments,

the configuration information, associated with the multiple experiments, allowing the multiple experiments, associated with the application, to be conducted at the same time, and

the multiple experiments including the experiment.