System and methods for dynamically assigning control to one or more BOTs

• US 9,928,106 B2
• Filed: 03/30/2016
• Issued: 03/27/2018
• Est. Priority Date: 03/29/2016
• Status: Active Grant

• Current Assignee: Wipro Limited
• Original Assignee: Wipro Limited
• Inventors: Hosabettu, Raghavendra, Ramanna, Ramprasad Kanakatte, Mannopantar, Raghottam
• Primary Examiner(s): Truong, Camquy
• Application Number:
  US15/085,208
• Publication Number:
  US 20170286155A1
• Time in Patent Office: 727 Days
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 9/4843 by program, e.g. task dispatcher, supervisor, operating system
• CPC Class Codes: G06Q 10/063114 Status monitoring or status determination for a person or group
• CPC Class Codes: G06Q 10/06398 Performance of employee with respect to a job function

Abstract

Method and system for dynamically assigning control to one or more BOTs to execute at least one task are disclosed. The method comprises tracking user actions on at least one graphical user interface to obtain tracking data, and analyzing the at least one graphical user interface using one or more computerized image processing techniques to obtain screen data, and comparing the tracking data and the screen data with one or more confirmatory predictors. Upon comparing a list of tasks are identified, and the list of tasks comprise the at least one task being performed by the user. Upon determining number of tasks less than a predefined threshold value, the list of tasks is provided to a user. Further, one or more BOTs configured to perform the at least one task are assigned control to execute the at least one task.

Claims

1. A method for dynamically assigning control to one or more bots to execute at least one task, the method comprising:

tracking, via a hardware processor, user actions on at least one graphical user interface to obtain tracking data;

analyzing, via the hardware processor, the at least one graphical user interface using one or more computerized image processing techniques to obtain screen data;

comparing, via the hardware processor, the tracking data and the screen data with one or more confirmatory predictors obtained from a database;

identifying, via the hardware processor, a list of tasks based on the comparing wherein the list of tasks comprises the at least one task being performed by the user;

determining, via the hardware processor, whether number of tasks in the list of tasks is less than a predefined threshold value;

providing, via the hardware processor, the list of tasks to the user, based on the determining, to identify the at least one task;

ascertaining, via the hardware processor, the one or more bots configured to perform the at least one task; and

assigning, via the hardware processor, control to the one or more bots to execute the at least one task, wherein assigning the control to the one or more bots comprises;

seeking, via the hardware processor, a user permission to identify whether to provide the control to the one or more bots;

providing, via the hardware processor, the control to the one or more bots to perform the at least one task upon receiving the user permission from the user; and

providing, via the hardware processor, one or more optimum paths to the user to perform the at least one task in absence of the user permission.

2. The method of claim 1, wherein the tracking data comprise data related to actions performed, by the user, on the objects present in the at least one graphical user interface and sequence of the actions performed.

3. The method of claim 1, wherein the screen data comprise objects in the at least one graphical user interface, and wherein the objects is at least one of images, buttons, icons, shortcut keys, controls, textboxes, labels, dropdowns, or hyperlinks.

4. The method of claim 1, wherein each of the one or more confirmatory predictors comprise unique combinations of at least one of an event, a position, an order, objects, a relative timeline in the at least one graphical user interface of a display unit, or inputs from peripheral devices.

5. The method of claim 1, wherein providing the list of tasks to the user further comprises:

displaying, by the hardware processor, the list of tasks on the at least one graphical user interface of a display unit; and

receiving, by the hardware processor, a user selection indicating the at least one task being performed by the user.

6. The method of claim 1, wherein ascertaining the one or more bots further comprises identifying, by the hardware processor, at least one active bot based on availability and the at least one task to be performed, and wherein each of the at least one active bot has a predefined maturity level.

7. A system for adaptive process automation, comprising:

a hardware processor; and

a memory storing instructions executable by the hardware processor for;

tracking user actions on at least one graphical user interface to obtain tracking data;

analyzing the at least one graphical user interface using one or more computerized image processing techniques to obtain screen data;

comparing the tracking data and the screen data with one or more confirmatory predictors obtained from a database;

identifying a list of tasks based on the comparing, wherein the list of tasks comprises the at least one task being performed by the user;

determining whether number of tasks in the list of tasks is less than a predefined threshold value;

providing the list of tasks to the user, based on the determining, to identify the at least one task;

ascertaining the one or more bots configured to perform the at least one task; and

assigning control to the one or more bots to execute the at least one task, wherein the assigning control to one or more bots comprises;

seeking a user permission to identify whether to provide the control to the one or more bots;

providing the control to the one or more bots to perform the at least one task upon receiving the user permission from the user; and

providing one or more optimum paths to the user to perform the at least one task in absence of the user permission.

8. The method of claim 7, wherein the tracking data comprise data related to actions performed, by the user, on the objects present in the at least one graphical user interface and sequence of the actions performed.

9. The method of claim 7, wherein the screen data comprise objects in the at least one graphical user interface, and wherein the objects is at least one of images, buttons, icons, shortcut keys, controls, textboxes, labels, dropdowns, or hyperlinks.

10. The method of claim 7, wherein each of the one or more confirmatory predictors comprise unique combinations of at least one of an event, a position, an order, objects, a relative timeline in the at least one graphical user interface of a display unit, or inputs from peripheral devices.

11. The method of claim 7, wherein providing the list of tasks to the user further comprises:

displaying, by the hardware processor, the list of tasks on the at least one graphical user interface of a display unit; and

receiving, by the hardware processor, a user selection indicating the at least one task being performed by the user.

12. The method of claim 7, wherein ascertaining the one or more bots further comprises identifying, by the hardware processor, at least one active bot based on availability and the at least one task to be performed, and wherein each of the at least one active bot has a predefined maturity level.

13. A non-transitory computer-readable medium storing instructions for dynamically assigning control to one or more bots to execute at least one task, wherein upon execution of the instructions by one or more processors, the processors perform operations comprising:

tracking user actions on at least one graphical user interface to obtain tracking data;

analyzing the at least one graphical user interface using one or more computerized image processing techniques to obtain screen data;

comparing the tracking data and the screen data with one or more confirmatory predictors obtained from a database;

identifying a list of tasks based on the comparing, wherein the list of tasks comprises the at least one task being performed by the user;

determining whether number of tasks in the list of tasks is less than a predefined threshold value;

providing the list of tasks to the user, based on the determining, to identify the at least one task;

ascertaining the one or more bots configured to perform the at least one task; and

assigning control to the one or more bots to execute the at least one task, wherein assigning the control to the one or more bots comprises;

seeking a user permission to identify whether to provide the control to the one or more bots;

providing the control to the one or more bots to perform the at least one task upon receiving the user permission from the user; and

providing one or more optimum paths to the user to perform the at least one task in absence of the user permission.

14. The medium of claim 13, wherein the tracking data comprise data related to actions performed, by the user, on the objects present in the at least one graphical user interface and sequence of the actions performed and the screen data comprise objects in the at least one graphical user interface, and wherein the objects is at least one of images, buttons, icons, shortcut keys, controls, textboxes, labels, dropdowns, or hyperlinks.

15. The medium of claim 13, wherein each of the one or more confirmatory predictors comprise unique combinations of at least one of an event, a position, an order, objects, a relative timeline in the at least one graphical user interface of a display unit, or inputs from peripheral devices.

16. The medium of claim 13, wherein providing the list of tasks to the user further comprises:

displaying, by the hardware processor, the list of tasks on the at least one graphical user interface of a display unit; and

receiving, by the hardware processor, a user selection indicating the at least one task being performed by the user.

17. The medium of claim 13, wherein ascertaining the one or more bots further comprises identifying, by the hardware processor, at least one active bot based on availability and the at least one task to be performed, and wherein each of the at least one active bot has a predefined maturity level.