Multimodal Input System
First Claim
1. In a computing environment, a method performed at least in part on at least one processor, comprising, receiving sets of input data corresponding to a plurality of input modalities, determining that a first set of input data is related to a second set of input data, and using the second set of input data to interpret an intent of the first set of input data.
2 Assignments
0 Petitions
Accused Products
Abstract
The subject disclosure relates to user input into a computer system, and a technology by which one or more users interact with a computer system via a combination of input modalities. When the input data of two or more input modalities are related, they are combined to interpret an intended meaning of the input. For example, speech when combined with one input gesture has one intended meaning, e.g., convert the speech to verbatim text for consumption by a program, while the exact speech when combined with a different input gesture has a different meaning, e.g., convert the speech to a command that controls the operation of that same program.
-
Citations
20 Claims
- 1. In a computing environment, a method performed at least in part on at least one processor, comprising, receiving sets of input data corresponding to a plurality of input modalities, determining that a first set of input data is related to a second set of input data, and using the second set of input data to interpret an intent of the first set of input data.
-
8. In a computing environment, a system, comprising:
-
a plurality of input devices that each input raw data corresponding to an input modality; an input processor configured to process the raw data into input events; and a recommendation engine configured to evaluate the input events and to determine a user-intended meaning of a combination of at least two of the input events. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16, 17, 20)
-
-
18. One or more computer-readable media having computer-executable instructions, which when executed perform steps, comprising:
-
receiving input data from a plurality of input devices; accessing at least one dictionary to determine a combined meaning of the input data; and providing output data for input by a program, the output data corresponding to the combined meaning of the input data. - View Dependent Claims (19)
-
Specification