System and Method for Multi-Modal Input Synchronization and Disambiguation
First Claim
1. A computer-implemented method in a dialog system, comprising:
- receiving input from a plurality of input modalities;
synchronizing the inputs based on the temporal order of events associated with the input;
generating an initial hypothesis for an input for an event;
receiving constraints for the input based on one or more other inputs of the plurality of inputs;
combining the constraints with the initial hypothesis; and
deriving a new hypothesis to interpret the input.
1 Assignment
0 Petitions
Accused Products
Abstract
Embodiments of a dialog system that utilizes a multi-modal input interface for recognizing user input in human-machine interaction (HMI) systems are described. Embodiments include a component that receives user input from a plurality of different user input mechanisms (multi-modal input) and performs certain synchronization and disambiguation processes. The multi-modal input components synchronizes and integrates the information obtained from different modalities, disambiguates the input, and recovers from any errors that might be produced with respect to any of the user inputs. Such a system effectively addresses any ambiguity associated with the user input and corrects for errors in the human-machine interaction.
-
Citations
20 Claims
-
1. A computer-implemented method in a dialog system, comprising:
-
receiving input from a plurality of input modalities; synchronizing the inputs based on the temporal order of events associated with the input; generating an initial hypothesis for an input for an event; receiving constraints for the input based on one or more other inputs of the plurality of inputs; combining the constraints with the initial hypothesis; and deriving a new hypothesis to interpret the input. - View Dependent Claims (2, 3, 4, 5, 6, 7, 10, 11)
-
-
8. A dialog system, comprising:
-
an input stage receiving input from a plurality of input modalities; a synchronization module synchronizing the inputs based on the temporal order of events associated with the input; a dialog manager generating an initial hypothesis for an input for an event; a disambiguation module receiving constraints for the input based on one or more other inputs of the plurality of inputs, wherein the dialog manager combines the constraints with the initial hypothesis and derives a new hypothesis to interpret the input. - View Dependent Claims (9, 12, 13, 14, 15, 16)
-
-
17. A computer readable medium containing a plurality of program instructions, which when executed by a processor, cause the processor to perform the steps of:
-
receiving input from a plurality of input modalities; synchronizing the inputs based on the temporal order of events associated with the input; generating an initial hypothesis for an input for an event; receiving constraints for the input based on one or more other inputs of the plurality of inputs; combining the constraints with the initial hypothesis; and deriving a new hypothesis to interpret the input. - View Dependent Claims (18, 19, 20)
-
Specification