Intelligent assistant for home automation
First Claim
1. A method for controlling electronic devices using a virtual assistant on a user device having a memory and at least one processor, the method comprising:
- at the user device;
receiving, an audio input comprising user speech;
transmitting data corresponding to the audio input to one or more servers;
receiving, from the one or more servers;
an identification of a first electronic device determined by the one or more servers based on the data corresponding to the audio input; and
a first command to be performed by the first electronic device determined by the one or more servers based on the data corresponding to the audio input;
transmitting the first command to the first electronic device;
receiving, after transmitting the first command to the first electronic device, a second audio input;
transmitting a state query to the first electronic device in accordance with the second audio input;
receiving, from the first electronic device, a current state of the first electronic device; and
transmitting the current state of the first electronic device to the one or more servers to be stored as at least a portion of a configuration, wherein the configuration defines a plurality of states of a plurality of corresponding electronic devices to use in response to a command that references the configuration.
1 Assignment
0 Petitions
Accused Products
Abstract
This relates to systems and processes for using a virtual assistant to control electronic devices. In one example process, a user can speak an input in natural language form to a user device to control one or more electronic devices. The user device can transmit the user speech to a server to be converted into a textual representation. The server can identify the one or more electronic devices and appropriate commands to be performed by the one or more electronic devices based on the textual representation. The identified one or more devices and commands to be performed can be transmitted back to the user device, which can forward the commands to the appropriate one or more electronic devices for execution. In response to receiving the commands, the one or more electronic devices can perform the commands and transmit their current states to the user device.
3026 Citations
36 Claims
-
1. A method for controlling electronic devices using a virtual assistant on a user device having a memory and at least one processor, the method comprising:
- at the user device;
receiving, an audio input comprising user speech; transmitting data corresponding to the audio input to one or more servers; receiving, from the one or more servers; an identification of a first electronic device determined by the one or more servers based on the data corresponding to the audio input; and a first command to be performed by the first electronic device determined by the one or more servers based on the data corresponding to the audio input; transmitting the first command to the first electronic device; receiving, after transmitting the first command to the first electronic device, a second audio input; transmitting a state query to the first electronic device in accordance with the second audio input; receiving, from the first electronic device, a current state of the first electronic device; and transmitting the current state of the first electronic device to the one or more servers to be stored as at least a portion of a configuration, wherein the configuration defines a plurality of states of a plurality of corresponding electronic devices to use in response to a command that references the configuration. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27)
- at the user device;
-
28. A non-transitory computer-readable storage medium comprising one or more programs for execution by one or more processors of a user device, the one or more programs including instructions which, when executed by the one or more processors, cause the user device to perform the method of:
-
receiving an audio input comprising user speech; transmitting data corresponding to the audio input to one or more servers; receiving, from the one or more servers; an identification of a first electronic device determined by the one or more servers based on the data corresponding to the audio input; and a first command to be performed by the first electronic device determined by the one or more servers based on the data corresponding to the audio input; transmitting the first command to the first electronic device; receiving, after transmitting the first command to the first electronic device, a second audio input; transmitting a state query to the first electronic device in accordance with the second audio input; receiving, from the first electronic device, a current state of the first electronic device; and transmitting the current state of the first electronic device to the one or more servers to be stored as at least a portion of a configuration, wherein the configuration defines a plurality of states of a plurality of corresponding electronic devices to use in response to a command that references the configuration. - View Dependent Claims (29, 30, 31)
-
-
32. A system comprising:
-
one or more processors; memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for; receiving an audio input comprising user speech; transmitting data corresponding to the audio input to one or more servers;
receiving, from the one or more servers;an identification of a first electronic device determined by the one or more servers based on the data corresponding to the audio input; and a first command to be performed by the first electronic device determined by the one or more servers based on the data corresponding to the audio input; transmitting the first command to the first electronic device; receiving, after transmitting the first command to the first electronic device, a second audio input; transmitting a state query to the first electronic device in accordance with the second audio input; receiving, from the first electronic device, a current state of the first electronic device; and transmitting the current state of the first electronic device to the one or more servers to be stored as at least a portion of a configuration, wherein the configuration defines a plurality of states of a plurality of corresponding electronic devices to use in response to a command that references the configuration. - View Dependent Claims (33, 34, 35, 36)
-
Specification