Methods for User Interface Generation and Application Modification

• US 20080222618A1
• Filed: 08/09/2006
• Published: 09/11/2008
• Est. Priority Date: 08/25/2005
• Status: Active Grant

• Current Assignee: Versata FZ-LLC (ESW Capital, LLC)
• Original Assignee: Corizon Ltd. (ESW Capital, LLC)
• Inventors: Valtchev, Plamen Ivanov
• Granted Patent: US 10,210,000 B2
• Time in Patent Office: Days
• US Class Current: 717/139
• CPC Class Codes: G06F 2209/541 Client-server
• CPC Class Codes: G06F 2209/545 Gui
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 8/30 Creation or generation of source code
• CPC Class Codes: G06F 8/33 Intelligent editors
• CPC Class Codes: G06F 8/34 Graphical or visual programming
• CPC Class Codes: G06F 8/35 model driven
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: G06F 8/54 Link editing before load time
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06F 9/454 Multi-language systems; Localisation; Internationalisation
• CPC Class Codes: G06F 9/45508 Runtime interpretation or emulation, e g. emulator loops, bytecode interpretation
• CPC Class Codes: G06F 9/45516 Runtime code conversion or optimisation
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications

Abstract

A method of generating a user interface for presentation to a user. The method comprises executing a first application computer program to provide a user interface, executing agent computer program code to interrogate and modify said user interface during execution of said first application computer program, and presenting said modified user interface. The first application computer program may be run on a server, while the modified user interface may be presented to a user at a client connected to said server.

Claims

1. A method of modifying a source application, the method comprising:

running said source application;

modifying computer program code associated with said source application at runtime, said modifying causing a link to be established between said source application and an interpreter;

interpreting predetermined modification computer program code in said interpreter, said modification computer program code being configured to modify said source application.

2. A method according to claim 1, wherein modifying said source application comprises modifying a user interface provided by said source application.

3. A method according to claim 1, wherein modifying said computer program code comprises modifying a first predetermined function within said computer program code.

4. A method according to claim 3, wherein said first predetermined function is called in response to a user interface manipulation operation.

5. A method according to claim 3, wherein modifying said computer program code comprises inserting a function call to a second predetermined function in said computer program code.

6. A method according to claim 5, wherein said second predetermined function causes a call to be made to a third predetermined function provided by said modification computer program code provided by said interpreter.

7. A method according to claim 6, wherein said third predetermined function is configured to call a fourth function provided by said modification computer program code, said fourth function being selected based upon said first predetermined function.

8. A method according to claim 7, wherein said fourth function is configured to cause modification of said source application.

9. A method according to claim 8, wherein said fourth function is configured to provide notification to a client.

10. A method according to claim 9, further comprising associating said client with said call to said fourth function.

11. A method according to claim 9, wherein said client is configured to perform an action in response to said notification.

12. A method according to claim 10, further comprising:

defining a model of said user interface using a plurality of objects.

13. A method according to claim 10, wherein said client is one of said objects.

14. A method according to claim 12, wherein said model further comprises a plurality of action objects, said action objects defining actions to be carried out in response to received notifications.

15. A method according to claim 1, further comprising:

establishing a communications link between a server computer running said source application and a client computer configured to access said source application;

providing access to said modified application to said client computer.

16. A data carrier carrying computer readable program code configured to cause a computer to carry out a method according to claim 1.

17. A computer apparatus for modifying a source application, the apparatus comprising:

a program memory storing processor readable instructions; and

a processor configured to read and execute instructions stored in said program memory;

wherein said processor readable instructions comprise instructions controlling the processor to carry out the method of any one of claim 1.

18. A method of generating a user interface for presentation to a user, the method comprising:

executing a first application computer program to provide a user interface;

executing agent computer program code to modify said user interface during execution of said first application computer program;

and presenting said modified user interface.

19. A method according to claim 18, wherein said first application computer program is executed on a server, the server is in communication with a client, and said modified user interface is provided for presentation at said client.

20. A method according to claim 19, wherein executing said agent computer program code comprises executing said agent computer program code at said server.

21. A method according to claim 20, wherein said agent computer program code provides said modified user interface to said client.

22. A method according to claim 18, wherein executing said first application computer program comprises:

creating an application process in which said application computer program is to execute; and

creating a first thread within said application process to execute said application computer program.

23. A method according to claim 22, further comprising:

creating a second thread within said application process to execute said agent computer program code.

24. A method according to claim 23, wherein creating said second thread comprises:

creating a launcher thread within said application process, said launcher thread being configured to create said second thread.

25. A method according to claim 22, wherein creating said application process comprises:

running a launcher application to create said application process and said first thread.

26. A method according to claim 25, wherein running said launcher application further comprises:

creating a launcher thread within said application process.

27. A method according to claim 26, wherein said launcher application causes said launcher thread to call a function within program code associated with said application computer program code.

28. A method according to claim 27, wherein said called function is provided by a standard library used by said application computer program.

29. A method according to one of claim 18, wherein said agent computer program code comprises computer program code defining an interpreter.

30. A method according to claim 29, further comprising:

interpreting commands using said interpreter to modify said user interface.

31. A method according to claim 30, wherein interpreting commands using said interpreter, comprises interpreting commands making calls to functions provided by said application computer program.

32. A method according to claim 18, wherein modifying said user interface comprises:

inserting modification computer program code within a memory space associated with said application computer program code;

locating first computer program code within said memory space;

and modifying said first computer program code so as to redirect control to said modification computer program code.

33. A method according to claim 32, wherein modifying said first computer program code comprises:

copying at least part of said first computer program code to an area of memory having an associated start address;

and replacing said copied computer program code with an instruction directing control to said modification computer program code.

34. A method according to claim 32, wherein said modification computer program code is configured to access stack parameters used by said first computer program code.

35. A method according to claim 32, wherein said modification computer program code overrides code provide by said first application computer program.

36. A method according to claim 18, wherein modifying said user interface comprises:

modifying program code of said first application computer program to include a function call to a predetermined function.

37. A method according to claim 36, wherein said predetermined function is configured to cause computer program to run within an interpreter, said computer program code being configured to perform said modification.

38. A method according to claim 18, wherein presenting said user interface comprises presenting said user interface using a web browser.

39. A method according to claim 38, further comprising:

executing browser agent computer program code using said web browser, browser agent being in communication with said agent.

40. A method according to claim 19, wherein running said application computer program comprises running said application computer program within a desktop session on said server.

41. A method according to claim 40, wherein a plurality of clients are in communication with said server, and wherein the server provides a plurality of desktop sessions, one desktop session being accessed by each of said plurality of clients.

42. A method according to claim 18, wherein said agent computer program code monitors said application program for at least one predetermined event, and initiates processing based upon detection of said predetermined event.

43. A method according to claim 18, wherein modifying said user interface comprises generating a modified user interface comprising a subset of elements taken from the user interface associated with said source application.

44. A method according to claim 18, further comprising:

executing a further application computer program having an associated further user interface;

wherein said modified user interface comprises user interface elements taken from said user interface, and user interface elements taken from said further user interface.

45. A method according to claim 44, further comprising executing further agent computer program code, said further agent computer program code being configured to modify said further user interface.

46. A method according to claim 44, wherein said first application computer program is executed on a server, the server is in communication with a client, said modified user interface is provided for presentation at said client and said further application computer program is executed on said server.

47. A method according to claim 44 wherein said first application computer program is executed on a server, the server is in communication with a client, said modified user interface is provided for presentation at said client and said further application computer program is executed on a further server.

48. A method according to claim 45, further comprising:

executing computer program code configured to communicate with said agent computer program code and said further agent computer program code to generate said modified user interface.

49. A data carrier carrying computer readable program code configured to cause a computer to carry out a method according to claim 18.

50. A computer apparatus for generating a user interface, the apparatus comprising:

a program memory storing processor readable instructions; and

a processor configured to read and execute instructions stored in said program memory;

wherein said processor readable instructions comprise instructions controlling the processor to carry out the method of claim 18.

51. A method of generating a user interface, the method comprising:

reading first program code defining said user interface;

reading second program code defining at least one modification to said user interface;

executing said first program code within an operating system process having an associated memory space;

and executing said second program code within said same operating system process to generate a modified user interface.

52. A method according to claim 51, wherein executing said second program code comprises:

executing computer program code configured to cause an interpreter to run within said operating systems process.

53. A method according to claim 52, further comprising:

interpreting commands using said interpreter, said commands being configured to generate said modified user interface.

54. A method according to claim 51, wherein generating said modified user interface comprises modifying said user interface defined by said first program code.

55. A method according to 51, wherein said operating system process has a plurality of associated threads, and the method further comprises:

executing said first program code in a first thread of said operating system process;

and executing said second program code in a second thread of said operating system process.

56. A data carrier carrying computer readable program code configured to cause a computer to carry out a method according to claim 51.

57. A computer apparatus for generating a user interface, the apparatus comprising:

a program memory storing processor readable instructions; and

a processor configured to read and execute instructions stored in said program memory;

wherein said processor readable instructions comprise instructions controlling the processor to carry out the method of claim 51.

58. A method of affecting operation of a computer program, the method comprising:

causing further computer program code to execute within a memory space of said computer program, said further computer program code causing execution of an interpreter configured to interpret instructions to affect operation of the computer program.

59. A method according to claim 58, wherein said interpreted instructions are configured to modify a user interface associated with said computer program.

60. A method according to claim 58, wherein said interpreter calls functions used by said computer program to affect operation of the computer program.

61. A data carrier carrying computer readable program code configured to cause a computer to carry out a method according to claim 58.

62. A computer apparatus for affecting operation of a computer program, the apparatus comprising:

a program memory storing processor readable instructions; and

a processor configured to read and execute instructions stored in said program memory;

wherein said processor readable instructions comprise instructions controlling the processor to carry out the method of claim 58.

63. A method of affecting operation of a user interface associated with a computer program during execution of the computer program, the computer program having an associated memory space, the method comprising:

determining a memory location within said memory space at which predetermined computer program code is stored;

and replacing at least pail of said predetermined computer program code with further predetermined program code, such that said user interface associated with said computer program is modified.

64. A method according to claim 63, further comprising:

adding modification computer program code to said memory space of said computer program.

65. A method according to claim 64, wherein said further predetermined program comprises an instruction directing control to said modification computer program code.

66. A method according to claim 65 wherein the at least part of said predetermined computer program code which is replaced comprises a number of bytes determined by said instruction directing control to said modification computer program code.

67. A method according to claim 66, further comprising copying said predetermined computer program code to an area within said memory space, before said replacing.

68. A method according to claim 67, further comprising appending an instruction redirecting control back to a start of a portion of said predetermined computer program code which is not replaced by said further predetermined program code.

69. A method according to claim 68, wherein said modification computer program code determines whether modification of said user interface is required.

70. A method according to claim 69, wherein if said modification computer program code determines that modification is not required, said modification computer program code causes control to pass to said copy of said predetermined computer program code.

71. A data carrier carrying computer readable program code configured to cause a computer to carry out a method according to claim 63.

72. A computer apparatus for affecting operation of a user interface, the apparatus comprising:

a program memory storing processor readable instructions;

and a processor configured to read and execute instructions stored in said program memory;

wherein said processor readable instructions comprise instructions controlling the processor to carry out the method of claim 63.

73. A method of affecting operation of a computer program, the method comprising:

associating an interpreter with said computer program; and

affecting operation of said computer program by interpreting commands using said interpreter.

74. A method according to claim 73, wherein said computer program has an associated memory space, and said interpreter shares said memory space.

75. A method according to claim 73, wherein said computer program has an associated process, said computer program runs within a thread in said process, and said interpreter runs within a further thread in said process.

76. A method of affecting behaviour of a user interface comprising a plurality of user interface elements, the method comprising:

defining a model of said user interface using a plurality of communicating objects, each object representing one of said user interface elements;

receiving a notification of an event based on activity within said user interface at one of said objects;

and processing said notification at said one of said objects, said processing causing behaviour of said user interface to be modified.

77. A method according to claim 76, further comprising:

transmitting a message from said one of said object to at least one further object in response to said event.

78. A method according to claim 76, wherein at least some of said objects have associated action objects, said action objects defining behaviour of said model in response to predetermined events.

79. A method according to claim 76, wherein said notification is received from a program code running to provide said user interface.

80. A method according to claim 79, wherein said program code calls a predetermined function, and said call to said predetermined function generates said notification.

81. A method according to claim 80, wherein said predetermined function is called when a function associated with a predetermined user interface manipulation is called.

82. A method according to claim 80, further comprising:

modifying said program code running to provide said user interface to insert said function call to said predetermined function.

83. A method according to claim 76, wherein said objects are implemented in an object orientated interpreted programming language running within an interpreter.

84. A method according to claim 83, further comprising:

establishing a link between said user interface and said interpreter.

85. A method according to claim 83, wherein said program code calls a predetermined function, said call to said predetermined function generates said notification and said predetermined function call calls a function provided by code running in said interpreter.

86. A data carrier carrying computer readable program code configured to cause a computer to carry out a method according to claim 76.

87. Computer apparatus for affecting behaviour of a user interface, the apparatus comprising:

a program memory storing processor readable instructions; and

a processor configured to read and execute instructions stored in said program memory;

wherein said processor readable instructions comprise instructions controlling the processor to carry out the method of claim 76.

88. A method of modifying a user interface provided by a source application, the method comprising:

running said source application;

modifying computer program code associated with said source application at runtime, said modification causing a link to be established between said source application and an interpreter;

providing modification computer program code to said interpreter, said modification computer program code being configured to modify said user interface.

89. Apparatus for generating a user interface for presentation to a user, the apparatus comprising:

means for executing a first application computer program to provide a user interface;

means for executing agent computer program code, the agent computer program code being configured to modify said user interface during execution of said first application computer program;

and means for presenting said modified user interface.

90. Apparatus for generating a user interface, the apparatus comprising:

means for reading first computer program code defining said user interface;

means for reading second computer program code defining at least one modification to said user interface;

means for executing said first program code within an operating system process having an associated memory space; and

means for executing said second program code within said same operating system process to generate a modified user interface.

91. Apparatus for affecting operation of a computer program, the apparatus comprising:

means for causing further computer program to execute within a memory space of said computer program, said further computer program code being configured to cause execution of an interpreter configured to interpret instructions to affect operation of the computer program.

92. Apparatus for affecting operation of a user interface associated with a computer program during execution of the computer program, the computer program having an associated memory space, the apparatus comprising:

means for determining a memory location within said memory space at which predetermined computer program code is stored;

and means for replacing at least part of said predetermined computer program code with further predetermined program code, such that said user interface associated with said computer program is modified.

93. Apparatus for affecting operation of a computer program, the apparatus comprising:

means for associating an interpreter with said computer program; and

means for affecting operation of said computer program by interpreting commands using said interpreter.

94. Apparatus for affecting behaviour of a user interface comprising a plurality of user interface elements, the apparatus comprising:

means for defining a model of said user interface using a plurality of communicating objects, each object representing one of said user interface elements;

means for receiving a notification of an event base on activity within said user interface at one of said objects;

means for processing said notification at said one of said objects, said processing causing behaviour of said user interface to be modified.