Handling multiple command recognition inputs in a multi-tasking graphical environment

• US 5,442,376 A
• Filed: 10/26/1992
• Issued: 08/15/1995
• Est. Priority Date: 10/26/1992
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Tannenbaum, Alan R., Zetts, John M.
• Primary Examiner(s): Weldon, Ulysses
• Assistant Examiner(s): GOON, GIN F
• Application Number:
  US07/966,206
• Time in Patent Office: 1,023 Days
• Field of Search: 340/703, 340/706, 340/710, 340/711, 341/20, 341/22, 345/156, 345/157, 345/163, 345/168, 345/200
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

A method and system to recognize input events from a plurality of input devices. Each input device is coupled to a device driver or similar device specific code and a recognition provider. Upon attachment to the system, the recognition provider registers the known input events which the input device is capable of transmitting at the recognition subsystem. The recognition subsystem sends an identifier back to the recognition provider for each registered input event. When the recognition provider receives one or more input signals from the input device which are recognized as an input event, the provider sends the identifier to the recognition subsystem. The input event is transmitted to a process running on the system which may interpret the input event or request translation by the recognition subsystem. The invention is useful to introduce new input devices to a system without requiring modification of the existing processes.

Claims

1. A method for registering a first input device to a system, the system having a memory, a processor and a display coupled to a system bus, the method comprising the steps of:

allocating a first or normal channel in the memory for a presentation manager and a second channel in the memory for a recognition subsystem, each channel being a separate and independent program path in the memory;

transmitting a first set of input events for the first input device to the recognition subsystem in the memory;

assigning a corresponding identifier to each of the input events with the recognition subsystem; and

,

storing the first set of input events and the corresponding identifiers at the recognition subsystem and at a first recognition provider coupled to the recognition subsystem and to the first input device;

transmitting a first input signal from the first input device through the second channel including an extended information queue to the first recognition provider, bypassing the presentation manager;

recognizing the first input signal as a first input event with the first recognition provider; and

,

transmitting the corresponding identifier of the first input event from the first recognition provider to the recognition subsystem.

2. The method as recited in claim 1 which further comprises the steps of:

comparing the corresponding identifier of the first input event to the identifiers corresponding to the first set of input events; and

,

transmitting the first input event directly to a first application in memory from the recognition subsystem.

3. The method as recited in claim 2 which further comprises the steps of:

sending the first input event to a translation agent in memory which translates the first input event to a first message understood by a first process running in memory; and

,

transmitting the first message to the first application.

4. The method as recited in claim 2 which further comprises the steps of:

determining a system state when the first input signal was transmitted;

transmitting the first input event to the first application according to the system state.

5. The method as recited in claim 2 which further comprises the steps of:

determining a system state when the first input signal was transmitted; and

,

transmitting the system state to the first application with the first input event.

6. The method as recited in claim 1 which further comprises the steps of:

generating a false input signal corresponding to the first input signal;

transmitting the false input signal to an operating system for transmission to a first application and transmitting the first input signal to an extended information queue;

intercepting a false input signal before receipt by the first application; and

,

retrieving the first input signal from the extended information queue.

7. The method as recited in claim 1 which further comprises the steps of:

transmitting an indicia that the first input event is to be sent to a first application with the identifier which corresponds to the first input event; and

,

transmitting the first input event to the first application according to the indicia.

8. The method as recited in claim 1 which further comprises the steps of:

transmitting a second set of input events for a second input device to the recognition subsystem in the memory;

assigning a corresponding identifier to each of the input events in the second set with the recognition subsystem; and

,

storing the second set of input events and the corresponding identifiers at the recognition subsystem and at a second recognition provider coupled to the second input device.

9. The method as recited in claim 8 which further comprises the steps of:

transmitting a first input signal from the first input device; and

a second input signal from the second input device;

recognizing the first input signal as a first input event with the first recognition provider and the second input signal as a second input event with the second recognition provider; and

,

transmitting the corresponding identifiers of the first and second input events to the recognition subsystem.

10. The method as recited in claim 9 which further comprises the steps of:

comparing the corresponding identifiers of the first and second input events to the identifiers corresponding to the first and second sets of input events respectively; and

,

transmitting the first and second input events to a first application in memory from the recognition subsystem.

11. The method as recited in claim 9 which further comprises the steps of:

comparing the corresponding identifiers of the first and second input events to the identifiers corresponding to the first and second sets of input events respectively; and

,

transmitting the first input event to a first application in memory and the second input event to a second application in memory from the recognition subsystem.

12. A system for registering a first input device, the system having a memory, a processor and a display coupled to a system bus, the system comprising:

a first or normal channel in the memory for a presentation manager and a second or channel in the memory for a recognition subsystem, each channel being a separate and independent program path in the memory;

means for transmitting a first set of input events for the first input device to the recognition subsystem in the memory;

means for assigning a corresponding identifier to each of the input events with the recognition subsystem; and

,

means for storing the first set of input events and the corresponding identifiers at the recognition subsystem and at a first recognition provider coupled to the recognition subsystem and to the first input;

device;

means for transmitting a first input signal from the first input device through the second channel to the first recognition provider, bypassing the presentation manager;

means for recognizing the first input signal as a first input event with the first recognition provider; and

,

means for transmitting the corresponding identifier of the first input event from the first recognition provider to the recognition subsystem.

13. The system as recited in claim 12 which further comprises:

means for comparing the corresponding identifier of the first input event to the identifiers corresponding to the first set of input events; and

,

means for transmitting the first input event directly to a first application in memory from the recognition subsystem.

14. The system as recited in claim 13 which further comprises:

means for sending the first input event to a translation agent in memory which translates the first input event to a first message understood by a first process running in memory; and

,

means for transmitting the first message to the first application.

15. The system as recited in claim 13 which further comprises:

means for determining a system state when the first input signal was transmitted;

means for transmitting the first input event to the first application according to the system state.

16. The system as recited in claim 13 which further comprises:

means for determining a system state when the first input signal was transmitted; and

,

means for transmitting the system state to the first application with the first input event.

17. The system as recited in claim 12 which further comprises:

means for generating a false input signal corresponding to the first input signal;

means for transmitting the false input signal to an operating system for transmission to a first application and transmitting the first input signal to an extended information queue;

means for intercepting a false input signal before receipt by the first application; and

,

means for retrieving the first input signal from the extended information queue.

18. The system as recited in claim 12 which further comprises:

means for transmitting an indicia that the first input event is to be sent to a first application with the identifier which corresponds to the first input event; and

,

means for transmitting the first input event to the first application according to the indicia.

19. The system as recited in claim 12 which further comprises:

means for transmitting a second set of input events for a second input device to the recognition subsystem in the memory;

means for assigning a corresponding identifier to each of the input events in the second set with the recognition subsystem; and

,

means for storing the second set of input events and the corresponding identifiers at the recognition subsystem and at a second recognition provider coupled to the second input device.

20. The system as recited in claim 19 which further comprises:

means for transmitting a first input signal from the first input device and a second input signal from the second input device;

means for recognizing the first input signal as a first input event with the first recognition provider and the second input signal as a second input event with the second recognition provider; and

,

means for transmitting the corresponding identifiers of the first and second input events to the recognition subsystem.

21. The system as recited in claim 20 which further comprises:

means for comparing the corresponding identifiers of the first and second input events to the identifiers corresponding to the first and second sets of input events respectively; and

,

means for transmitting the first and second input events to a first application in memory from the recognition subsystem.

22. The system as recited in claim 20 which further comprises:

means for comparing the corresponding identifiers of the first and second input events to the identifiers corresponding to the first and second sets of input events respectively; and

,

means for transmitting the first input event to a first application in memory and the second input event to a second application in memory from the recognition subsystem.

23. A computer program product for registering a first input device executable on a computer system, the system having a memory, a processor and a display coupled to a system bus, the product comprising:

program code means for allocating a first or normal channel in the memory for a presentation manager and a second channel in the memory for a recognition subsystem, each channel being a separate and independent program path in the memory;

program code means for transmitting a first set of input events for the first input device to the recognition subsystem in the memory;

program code means for assigning a corresponding identifier to each of the input events with the recognition subsystem; and

,

program code means for storing the first set of input events and the corresponding identifiers at the recognition subsystem and at a first recognition provider to the recognition subsystem and coupled to the first input device;

program code means for transmitting a first input signal from the first input device to the first recognition provider, by passing the presentation manager;

program code means for recognizing the first input signal as a first input event with the first recognition provider; and

,

program code means for transmitting the corresponding identifier of the first input event from the first recognition provider to the recognition subsystem.

24. The product as recited in claim 23 which further comprises:

program code means for comparing the corresponding identifier of the first input event to the identifiers corresponding to the first set of input events; and

,

program code means for transmitting the first input event to a first application in memory from the recognition subsystem.

25. The product as recited in claim 24 which further comprises:

program code means for determining a system state when the first input signal was transmitted;

program code means for transmitting the first input event to the first application according to the system state.

26. The product as recited in claim 24 which further comprises:

program code means for determining a system state when the first input signal was transmitted; and

,

program code means for transmitting the system state to the first application with the first input event.

27. The system as recited in claim 23 which further comprises:

program code means for sending the first input event to a translation agent in memory which translates the first input event to a first message understood by a first process running in memory; and

,

program code means for transmitting the first message to the first application.

28. The product as recited in claim 23 which further comprises:

program code means for generating a false input signal corresponding to the first input signal;

program code means for transmitting the false input signal to an operating system for transmission to a first application and transmitting the first input signal to an extended information queue;

program code means for intercepting a false input signal before receipt by the first application; and

,

program code means for retrieving the first input signal from the extended information queue.

29. The product as recited in claim 23 which further comprises:

program code means for transmitting an indicia that the first input event is to be sent to a first application with the identifier which corresponds to the first input event; and

,

program code means for transmitting the first input event to the first application according to the indicia.

30. The product as recited in claim 23 which further comprises:

program code means for transmitting a second set of input events for a second input device to the recognition subsystem in the memory;

program code means for assigning a corresponding identifier to each of the input events in the second set with the recognition subsystem; and

,

program code means for storing the second set of input events and the corresponding identifiers at the recognition subsystem and at a second recognition provider coupled to the second input device.

31. The product as recited in claim 30 which further comprises:

program code means for transmitting a first input signal from the first input device and a second input signal from the second input device;

program code means for recognizing the first input signal as a first input event with the first recognition provider and the second input signal as a second input event with the second recognition provider; and

,

program code means for transmitting the corresponding identifiers of the first and second input events to the recognition subsystem.

32. The product as recited in claim 31 which further comprises:

program code means for comparing the corresponding identifiers of the first and second input events to the identifiers corresponding to the first and second sets of input events respectively; and

,

program code means for transmitting the first and second input events to a first application in memory from the recognition subsystem.

33. The product as recited in claim 31 which further comprises:

program code means for comparing the corresponding identifiers of the first and second input events to the identifiers corresponding to the first and second sets of input events respectively; and

,

program code means for transmitting the first input event to a first application in memory and the second input event to a second application in memory from the recognition subsystem.