Systems and methods for generating markup-language based expressions from multi-modal and unimodal inputs
First Claim
1. A method comprising:
- generating an input lattice representing input data having a first modality input and a second modality input;
using a finite-state device to perform a function using the input lattice, the finite-state device having symbols based on markup-language semantics, wherein performing the function comprises mapping a first markup-language expression to a second markup-language expression using a transducer relating the first-markup-language expression to the second-markup-language expression based on a level of coincidence between the first modality input and the second modality input;
generating a result finite-state device representing a result of the function, wherein the result finite-state device relates a set of input symbols to a set of output symbols;
concatenating output symbols in the set of output symbols of the result finite-state device, to yield a markup-language expression; and
outputting the markup-language expression.
4 Assignments
0 Petitions
Accused Products
Abstract
When using finite-state devices to perform various functions, it is beneficial to use finite state devices representing regular grammars with terminals having markup-language-based semantics. By using markup-language-based symbols in the finite state devices, it is possible to generate valid markup-language expressions by concatenating the symbols representing the result of the performed function. The markup-language expression can be used by other applications and/or devices. Finite-state devices are used to convert strings of words and gestures into valid markup-language, for example, XML, expressions that can be used, for example, to provide an application program interface to underlying system applications.
24 Citations
20 Claims
-
1. A method comprising:
-
generating an input lattice representing input data having a first modality input and a second modality input; using a finite-state device to perform a function using the input lattice, the finite-state device having symbols based on markup-language semantics, wherein performing the function comprises mapping a first markup-language expression to a second markup-language expression using a transducer relating the first-markup-language expression to the second-markup-language expression based on a level of coincidence between the first modality input and the second modality input; generating a result finite-state device representing a result of the function, wherein the result finite-state device relates a set of input symbols to a set of output symbols; concatenating output symbols in the set of output symbols of the result finite-state device, to yield a markup-language expression; and outputting the markup-language expression. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system comprising:
-
a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising; generating an input lattice representing input data having a first modality input and a second modality input; using a finite-state device to perform a function using the input lattice, the finite-state device having symbols based on markup-language semantics, wherein performing the function comprises mapping a first markup-language expression to a second markup-language expression using a transducer relating the first-markup-language expression to the second-markup-language expression based on a level of coincidence between the first modality input and the second modality input; generating a result finite-state device representing a result of the function, wherein the result finite-state device relates a set of input symbols to a set of output symbols; concatenating output symbols in the set of output symbols of the result finite-state device, to yield a markup-language expression; and outputting the markup-language expression. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:
-
generating an input lattice representing input data having a first modality input and a second modality input; using a finite-state device to perform a function using the input lattice, the finite-state device having symbols based on markup-language semantics, wherein performing the function comprises mapping a first markup-language expression to a second markup-language expression using a transducer relating the first-markup-language expression to the second-markup-language expression based on a level of coincidence between the first modality input and the second modality input; generating a result finite-state device representing a result of the function, wherein the result finite-state device relates a set of input symbols to a set of output symbols; concatenating output symbols in the set of output symbols of the result finite-state device, to yield a markup-language expression; and outputting the markup-language expression. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification