Graphical user interface with gesture recognition in a multiapplication environment
First Claim
1. An advanced user interface, for use with an integrated operating environment and an operating system capable of running a plurality of application programs simultaneously on a computer system, only one of which is active at a given time, the computer system having a central processor, a random access memory, a display and at least one input device which transmits input signals to the advanced user interface in response to actions performed by a user, comprising:
- interface profiles which contain mappings of input messages representative of the input signals against corresponding commands useable by at least one of the plurality of application programs; and
,an environment link module coupled to the interface profiles, the integrated operating environment and the operating system, the environment link module receiving the input messages, determining a first window of a plurality of windows belonging to one of the plurality of application programs in which a key feature of a gesture was made by pointing device, matching the input messages against the corresponding commands contained in the interface profiles according to the application program which owns the first window, and sending the corresponding commands to an appropriate computer module in the random access memory;
the computer system performing a given action in response to user actions different from those user actions for which the owning application program was originally written without change to the owning application program.
1 Assignment
0 Petitions
Accused Products
Abstract
An advanced user interface for use with a computer system operating on an integrated operating environment. The integrated operating environment allows a plurality of application programs to be running simultaneously, one of which is designated the active application program to which all input data is directed. The advanced user interface allows a user to select among user-friendly input devices to operate any application program according to his individual preferences without change to the application program code. The advanced user interface includes alternate input modules which translate the input signals transmitted from the various input devices into input messages useable by the rest of the interface. The advanced user interface also includes interface profiles which contain mappings of the input messages against corresponding commands useable by the application programs, the integrated operating environment or other modules of the advanced user interface itself. An environment link module refers to the interface profiles and matches the input message against the corresponding command for the application program active at the time the input signal was transmitted and send the corresponding command to that application program. The environment link module matches the input message against a corresponding command for an application which owns a window in which a key feature of a gesture is made.
-
Citations
45 Claims
-
1. An advanced user interface, for use with an integrated operating environment and an operating system capable of running a plurality of application programs simultaneously on a computer system, only one of which is active at a given time, the computer system having a central processor, a random access memory, a display and at least one input device which transmits input signals to the advanced user interface in response to actions performed by a user, comprising:
-
interface profiles which contain mappings of input messages representative of the input signals against corresponding commands useable by at least one of the plurality of application programs; and
,an environment link module coupled to the interface profiles, the integrated operating environment and the operating system, the environment link module receiving the input messages, determining a first window of a plurality of windows belonging to one of the plurality of application programs in which a key feature of a gesture was made by pointing device, matching the input messages against the corresponding commands contained in the interface profiles according to the application program which owns the first window, and sending the corresponding commands to an appropriate computer module in the random access memory; the computer system performing a given action in response to user actions different from those user actions for which the owning application program was originally written without change to the owning application program. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer system having a central processor and a random access memory having an advanced user interface, an integrated operating environment and an operating system resident in the memory capable of running a plurality of application programs simultaneously, only one of which is active at a given time, comprising:
- a plurality of input devices which transmit input signals to the advanced user interface in response to actions performed by the user;
translating means coupled to the plurality of input devices to translate the input signals to input messages; interface profiles which contain mappings of the input messages against corresponding commands useable by at least one of the plurality of application programs; an environment link module coupled to the translating means input subsystem, the interface profiles and the integrated operating environment, the environment link module receiving the input messages, determining a first window belonging to one of the application programs in which a key feature of a gesture was made by a pointing device, matching the input messages against the corresponding commands contained in the interface profiles for the application program which owns the first window and sending the corresponding commands to an appropriate computer module in the random access memory; and
,a display that presents information concerning the status, results, choices and other items associated with the plurality of application programs; the computer system performing a given action in response to user actions different from those user actions for which the owning application program was originally written without change to the owning application program. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28)
- a plurality of input devices which transmit input signals to the advanced user interface in response to actions performed by the user;
- 29. A set of interface profiles for use with an advanced user interface in combination with an integrated operating environment and an operating system capable of running a plurality of application programs simultaneously on a computer system only one of which is active at a given time, the set of interface profiles comprising mappings of input messages representative of the input signals of an input device coupled to the advanced user interface mapped against corresponding commands useable by at least one of the plurality of application programs, the advanced user interface referring to the interface profiles responsive to a determination of a first window belonging to one of the plurality of application programs in which a key feature of a gesture by a pointing device made so that the computer system performs a given action in response to user actions different from user actions for which at least one of the application programs was originally written without change to the application.
-
37. A method of operating a computer system with an integrated operating environment and an operating system capable of running a plurality of application programs simultaneously only one of which is active at a given time by the use of an advanced user interface, the computer system having a central processor, a random access memory, a display and at least one input device which transmits input signals to the advanced user interface, comprising the steps of:
-
determining which one of the application programs owns a first window in which a key feature of a gesture was made by a pointing device; fining a corresponding command to the input message representative of the input signals in a set of interface profiles for the application program which owns the first window interface profiles comprising mappings of the input messages against corresponding commands; and
,sending the corresponding command to an appropriate computer module in the random access memory; the computer system performing a given action in response to user actions different from those user actions for which the owning application program was originally written without change to the owning application program. - View Dependent Claims (38, 39, 40, 41, 42, 43, 45)
-
-
44. A method of operating a computer system with an integrated operating environment and an operating system capable of running a plurality of application programs simultaneously only one of which is active at a given time by the use of an advanced user interface, comprising the steps of:
-
receiving input signals transmitted from at least one input device in response to actions performed by a user; translating the input signals into an input message compatible with the integrated operating environment; intercepting the compatible input message before receipt by an application program; determining whether the compatible input message is a true input message; determining which one of the application programs owns a first window in which a key feature of a gesture was made; finding a corresponding command to the true input message in a set of interface profiles for the active application program which owns the first window, the interface profiles comprising mappings of the true input messages against corresponding commands; and
,sending the corresponding command to an appropriate computer module in the random access memory; the computer system performing a given action in response to user actions different from those user actions for which the owning application program was originally written without change to the owning application program.
-
Specification