DISPLAY-INDEPENDENT COMPUTERIZED GUIDANCE

• US 20110047462A1
• Filed: 08/24/2009
• Published: 02/24/2011
• Est. Priority Date: 08/24/2009
• Status: Active Grant

• Current Assignee: Kryon Systems Ltd.
• Original Assignee: Kryon Systems Ltd.
• Inventors: Keinan, Oren, Butin, Emma
• Granted Patent: US 9,405,558 B2
• Time in Patent Office: Days
• US Class Current: 715/708
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting
• CPC Class Codes: G06F 9/453 Help systems

Abstract

A method for display-independent execution of a computerized guidance script, the method comprising capturing a screenshot of a graphical user interface (GUI) of a computerized application, analyzing the screenshot for matching a control of the screenshot with a control of the guidance script, and executing the guidance script, based on the matching, to operate the computerized application. Additionally, a display-independent computerized guidance engine, comprising a screenshot analysis engine and a guidance script execution engine.

Claims

1. A method for display-independent execution of a computerized guidance script, the method comprising:

capturing a screenshot of a graphical user interface (GUI) of a computerized application;

analyzing the screenshot for matching a control of the screenshot with a control of the guidance script; and

executing the guidance script, based on the matching, to operate the computerized application.

2. The method according to claim 1, wherein the matching is performed according to a pre-defined accuracy level.

3. The method according to claim 1, wherein the analyzing further comprises matching surroundings of the control of the screenshot with surroundings of the control of the guidance script.

4. The method according to claim 1, further comprising converting the screen shot to a 1-bit version.

5. The method according to claim 1, further comprising converting the screen shot to an inverted 1-bit version.

6. The method according to claim 1, wherein the executing further comprises activating a control of the computerized application.

7. The method according to claim 6, wherein the activating of the control comprises imitating a cursor click.

8. The method according to claim 6, wherein the activating of the control comprises imitating keyboard input.

9. The method according to claim 1, wherein the control is selected from a group consisting of:

an icon, a text, a button, an input box, a menu, a drop-down list, a slider, a scroll bar and a bar.

10. The method according to claim 1, further comprising activating a scroll bar for scrolling to a previously-invisible region of the computerized application.

11. A display-independent computerized guidance engine, comprising:

a screenshot analysis engine for matching a control of a GUI of a computerized application with a control of a guidance script; and

a guidance script execution engine for executing the guidance script, based on the matching, to operate the computerized application.

12. The guidance engine according to claim 11, wherein said screenshot analysis engine is set to a pre-defined accuracy level.

13. The guidance engine according to claim 11, wherein said screenshot analysis engine is adapted to match surroundings of the control of the GUI with surroundings of the control of the guidance script.

14. The guidance engine according to claim 11, wherein said screenshot analysis engine further comprises an image conversion module.

15. The guidance engine according to claim 14, wherein said image conversion module is adapted to convert a screenshot to a 1-bit version.

16. The guidance engine according to claim 14, wherein said image conversion module is adapted to convert a screenshot to an inverted 1-bit version.

17. The guidance engine according to claim 11, wherein said guidance script execution engine is adapted to activate a control of a computerized application.

18. The guidance engine according to claim 17, wherein said control is selected from a group consisting of:

an icon, a text, a button, an input box, a menu, a drop-down list, a scroll bar, a slider and a bar.

19. The guidance engine according to claim 11, wherein said screenshot analysis engine is adapted to activate a scroll bar for scrolling to a previously-invisible region of a computerized application.