Method and apparatus for automatic processing of service requests on an electronic device

• US 10,394,577 B2
• Filed: 12/03/2018
• Issued: 08/27/2019
• Est. Priority Date: 09/30/2016
• Status: Active Grant

• Current Assignee: DeepAssist Inc.
• Original Assignee: DeepAssist Inc.
• Inventors: Wu, Xiaoyun
• Primary Examiner(s): Mudrick, Timothy A
• Application Number:
  US16/208,422
• Publication Number:
  US 20190102208A1
• Time in Patent Office: 267 Days
• Field of Search: 717121
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/44505 Configuring for program initiating, e.g. using registry, configuration files
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/60 Subscription-based services using application servers or record carriers, e.g. SIM application toolkits
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

Embodiments of the present application provides methods and apparatus capable of recording operation/display events on a mobile device used to fulfill a first service request entered via a user interface of the mobile device. A recorded sequence of operation/display events is used to build a script file, which is associated with the service request or a template extracted from the service request. When a second service request that is the same or similar to the first service request is received again on the same or different mobile device, the script file associated with the service request is retrieved and provided to the mobile device, which executes the script file to automatically brings up a series of operation/display events to fulfill the service request. Thus, a user of the mobile device does not need to manually navigate through the sequence of operation/display events again in order to fulfill the service request.

Claims

1. A method performed by a computer system in communication with mobile devices via a network, the computer system including or having access to a data store, the method comprising:

receiving information about a first service request from a first mobile device;

searching the data store for a script file including a set of operation/display events for execution by the first mobile device to fulfill the first service request;

in response to the scrip file not being found in the data store;

transmitting a signal to the first mobile device to notify the first mobile device that the first script file is not found;

receiving from the first mobile device a first sequence of operation/display events performed on the first mobile device to fulfill the first service request;

extracting a request template from the information about the first service request;

building a first script file for association with the request template using the first sequence of operation/display events and the information about the first service request; and

storing the request template and the associated first script file in the data store;

receiving information about a second service request from a second mobile device;

in response to the second service request being related to the request template, retrieving the first script file and the request template from the data store; and

transmitting the first script file and the request template to the second mobile device.

2. The method of claim 1, wherein the first sequence of operation/display events represents a series of user inputs received by the first mobile device and a series of displays provided by the first mobile device in response to respective ones of the series of inputs, wherein each of the series of displays includes an application interface for receiving at least one or more of a search query, a touch, and a swipe.

3. The method of claim 1, wherein the information about the first service request is represented at least in part by a text string, and wherein extracting a request template comprises parsing the text string into a general portion and a specific portion and replacing the specific portion with a variable.

4. The method of claim 1, wherein the information about the first service request is represented at least in part by a text string, and wherein extracting a request template comprises determining a category for the first service request that also includes similar service requests expressed with different text strings.

5. The method of claim 1, further comprising performing a similarity analysis of the second service request with a plurality of request templates to select a target request template having a similarity to the second service request with a similarity measure greater than a preset threshold.

6. The method of claim 1, further comprising:

parsing the second service request into a general portion and a specific portion;

extracting variable information from the specific portion; and

transmitting the request template and the variable information together with the first script file to the second mobile device.

7. The method of claim 1, wherein the computer system further includes or has access to a second data store storing therein information relevant to the second service request, the method further comprising:

obtaining the information relevant to the second service request from the second data store;

transmitting the information relevant to the second service request together with the first script file and the request template to the second mobile device.

8. A method performed by a computing device having a display/touch screen and operable to execute application programs in accordance with user inputs via the display/touch screen, each of the application programs when executed by the computing device causing the computing device to display certain application interfaces, the method comprising:

receiving a first user request;

determining if the first user request can be automatically fulfilled;

in response to determination that the first user request cannot be automatically fulfilled, prompting for user permission to enter a recording mode;

in response to receiving user permission to enter the recording mode, capturing a sequence of operation/display events occurring on the computing device as the computing device is operated to fulfill the first user request, and causing the sequence of operation/display events to be stored in association with the first user request or a request template corresponding to the first user request, the sequence of operation/display events including operation events and display events, each of the operation events corresponding to a user input via the display/touch screen, each of the display events corresponding to an application interface displayed on the display/touch screen;

receiving a second user request;

in response to the second user request is at least similar to the first user request or the request template, simulating a set of user inputs to cause the computing device to display one or more application interfaces in accordance with the sequence of operation/display events.

9. The method of claim 8, wherein capturing a sequence of operation/display events comprises:

providing a transparent user interface that overlays any application interface displayed on the display/touch screen;

using the transparent user interface to capture one or more user inputs on one or more application interfaces under the transparent user interface on the display/touch screen; and

for each user input of the one or more user inputs, generating an interpretation of the each user input based on an application interface under the transparent user interface at the time the each user input is made, and forming, based on the interpretation, a simulated user input to an application program providing the application interface displayed on the computing device at the time the each user input is made for inclusion in the sequence of operation/display events.

10. The method of claim 8, wherein the computing device is in communication with a server via a network, and wherein determining if the first user request can be automatically fulfilled comprises:

transmitting information about the first user request to the server;

receiving a response from the server;

determining if the response include information about a pre-stored sequence of operation/display events for fulfilling the user request.

11. The method of claim 10, wherein causing the sequence of operation/display events to be stored comprises transmitting the sequence of operation/display events together with the first user request or a request template corresponding to the first user request to the server.

12. The method of claim 10, wherein the information about the first user request includes a state of user interaction with the computing device or one or more application programs running on the computing device at the time of the first user request.

13. The method of claim 12, wherein the state of user interaction with the computing device includes one or more of:

a specified personal preference, one or more most frequent contacts, one or more favorite applications, previous purchase history, one or more previous service requests, a physical state of the computing device, and a geographical location of the computing device.

14. The method of claim 8, wherein the set of inputs include one or more touches and one or more swipes on the display/touch screen, wherein the computing device is configured to automatically simulate the set of inputs without an actual user making any of the one or more touches or one or more swipes.

15. The method of claim 8, wherein the application programs are based on an operating system of the computing device and wherein the operating system is configured to capture the sequence of operation/display events in the recording mode.

16. The method of claim 15, wherein the operating system is further configured to simulate the set of user inputs to cause the computing device to display the one or more application interfaces in accordance with the sequence of operation/display events.

17. A computing device, comprising:

a processor;

a display/touch screen;

first memory storing therein program codes for a plurality of application programs, wherein a respective application program when executed by the processor causes the computing device to display respective application interfaces; and

second memory storing therein an operating system, wherein the operating system includes functions which, when invoked by the processor, causes the computing device to;

capturing a sequence of operation/display events occurring on the computing device as the computing device is operated to fulfill a first user request, the sequence of operation/display events including operation events and display events, each of the operation events corresponding to a user input via the display/touch screen, each of the display events corresponding to an application interface displayed on the display/touch screen; and

simulating a set of user inputs to cause the computing device to display one or more application interfaces in accordance with the sequence of operation/display events to fulfill a second user request that is at least similar to the first user request.

18. The computing device of claim 17, wherein capturing a sequence of operation/display events comprises:

providing a transparent user interface that overlays any application interface displayed on the display/touch screen;

using the transparent user interface to capture one or more user inputs on one or more application interfaces under the transparent user interface on the display/touch screen; and

for each user input of the one or more user inputs, generating an interpretation of the each user input based on an application interface under the transparent user interface at the time the each user input is made, and forming, based on the interpretation, a simulated user input to an application program providing the application interface displayed on the computing device at the time the each user input is made for inclusion in the sequence of operation/display events.

19. The computing device of claim 17, wherein the first memory and the second memory are of different types.

20. The computing device of claim 17, wherein the set of inputs include one or more touches and one or more swipes on the display/touch screen, wherein the operating system is configured to enable the computing device to automatically simulate the set of inputs without an actual user making any of the one or more touches or one or more swipes.