SYSTEM AND METHOD FOR PROCESSING MULTI-MODAL DEVICE INTERACTIONS IN A NATURAL LANGUAGE VOICE SERVICES ENVIRONMENT
10 Assignments
0 Petitions
Accused Products
Abstract
A system and method for processing multi-modal device interactions in a natural language voice services environment may be provided. In particular, one or more multi-modal device interactions may be received in a natural language voice services environment that includes one or more electronic devices. The multi-modal device interactions may include a non-voice interaction with at least one of the electronic devices or an application associated therewith, and may further include a natural language utterance relating to the non-voice interaction. Context relating to the non-voice interaction and the natural language utterance may be extracted and combined to determine an intent of the multi-modal device interaction, and a request may then be routed to one or more of the electronic devices based on the determined intent of the multi-modal device interaction.
-
Citations
38 Claims
-
1-18. -18. (canceled)
-
19. A method for processing a natural language utterance via multiple input modes, comprising:
-
receiving, at one or more processors, a first input via a first input mode and a second input via a second input mode, wherein the first input mode is different than the second input mode, wherein one of the first input or the second input identifies a query and the other of the first or second input provides context information for the query; identifying the query from the one of the first input or the second input; identifying the context information from the other of the first input or the second input; and generating a response to the identified query based on the context information for the query. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
34. A device for processing a natural language utterance via multiple input modes, comprising:
-
one or more processors configured to; receive a first input via a first input mode and a second input via a second input mode, wherein the first input mode is different than the second input mode, wherein one of the first input or the second input identifies a query and the other of the first or second input provides context information for the query, identify the query from the one of the first input or the second input; identify the context information from the other of the first input or the second input; and generate a response to the identified query based on the context information for the query.
-
-
35. A non-transitory computer-readable medium for processing a natural language utterance via multiple input modes, the non-transitory computer-readable medium comprising one or more instructions that, when executed by one or more processors, cause the one or more processors to:
-
receive a first input via a first input mode and a second input via a second input mode, wherein the first input mode is different than the second input mode, wherein one of the first input or the second input identifies a query and the other of the first or second input provides context information for the query, identify the query from the one of the first input or the second input; identify the context information from the other of the first input or the second input; and generate a response to the identified query based on the context information for the query.
-
-
36. A method for processing a natural language utterance via multiple input modes, comprising:
-
receiving, at one or more processors, a first input via a first input mode and a second input via second input mode, wherein the first input mode is different than the second input mode, wherein one of the first input or the second input identifies a command, and the other of the first or second input provides context information for the command; identifying the command from the one of the first input or the second input; identifying the context information from the other of the first input or the second input; and generating a command signal based on the context information for the query. - View Dependent Claims (37, 38)
-
Specification