Troubleshooting voice-enabled home setup
First Claim
Patent Images
1. A method for a home assistant device with artificial intelligence (AI) to facilitate setup of a device within a home environment, comprising:
- determining, by a processor, that the device is to be set up within the home environment;
receiving a first image data depicting a user in the home environment;
receiving a first audio data representing speech of the user in the home environment;
determining a technical aptitude of the user related to setting up the device based on the first image data and the first image data;
identifying a set of instructions for setting up the device within the home environment based on the device and the technical aptitude, wherein the set of instructions include a first setup instruction and a second setup instruction representing a corresponding sequence of steps to be performed to set up the device to operate within the home environment;
providing the first setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device;
receiving a second image data depicting the user in the home environment representing the user performing the first setup instruction of the set of instructions;
receiving a second audio data representing speech of the user associated with performing the first setup instruction of the set of instructions;
determining that the first setup instruction is completed;
updating the technical aptitude of the user based on the second image data and the second audio data, wherein updating includes;
if the second image data and the second audio data indicates frustration with the first setup instruction being too difficult, setting the technical aptitude of the user to a novice technical aptitude;
if the second image data and the second audio data indicates no frustration with the first setup instruction, setting the technical aptitude of the user to an average technical aptitude; and
if the second image data and the second audio data indicates frustration with the first setup instruction being too easy, setting the technical aptitude of the user to an advanced technical aptitude;
providing the second setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device, the second setup instruction being associated with the set technical aptitude, wherein each the novice technical aptitude, the advanced technical aptitude, and the average technical aptitude are associated with different second setup instructions; and
determining that the second setup instruction is completed and the device is connected to the home assistant device resulting in the home assistant device being configured to control the device to provide a response to voice instructions receive by the home assistant device.
1 Assignment
0 Petitions
Accused Products
Abstract
A home assistant device assisting with the setup and troubleshooting of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined the technical aptitude of the user and assistant the user with setting up devices within their own technical abilities. The setup instructions can then be provided.
-
Citations
24 Claims
-
1. A method for a home assistant device with artificial intelligence (AI) to facilitate setup of a device within a home environment, comprising:
-
determining, by a processor, that the device is to be set up within the home environment; receiving a first image data depicting a user in the home environment; receiving a first audio data representing speech of the user in the home environment; determining a technical aptitude of the user related to setting up the device based on the first image data and the first image data; identifying a set of instructions for setting up the device within the home environment based on the device and the technical aptitude, wherein the set of instructions include a first setup instruction and a second setup instruction representing a corresponding sequence of steps to be performed to set up the device to operate within the home environment; providing the first setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device; receiving a second image data depicting the user in the home environment representing the user performing the first setup instruction of the set of instructions; receiving a second audio data representing speech of the user associated with performing the first setup instruction of the set of instructions; determining that the first setup instruction is completed; updating the technical aptitude of the user based on the second image data and the second audio data, wherein updating includes; if the second image data and the second audio data indicates frustration with the first setup instruction being too difficult, setting the technical aptitude of the user to a novice technical aptitude; if the second image data and the second audio data indicates no frustration with the first setup instruction, setting the technical aptitude of the user to an average technical aptitude; and if the second image data and the second audio data indicates frustration with the first setup instruction being too easy, setting the technical aptitude of the user to an advanced technical aptitude; providing the second setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device, the second setup instruction being associated with the set technical aptitude, wherein each the novice technical aptitude, the advanced technical aptitude, and the average technical aptitude are associated with different second setup instructions; and determining that the second setup instruction is completed and the device is connected to the home assistant device resulting in the home assistant device being configured to control the device to provide a response to voice instructions receive by the home assistant device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system comprising:
-
a processor; and a memory storing instructions, execution of which by the processor causes the system to; determine that a device is to be set up within an environment; receive a first image data depicting a user in the environment; receive a first audio data representing speech of the user in the environment; determine a technical aptitude of the user related to setting up the device based on the first image data and the first image data; identify a set of instructions for setting up the device within the environment based on the device and the technical aptitude, wherein the set of instructions include a first setup instruction and a second setup instruction representing a corresponding sequence of steps to be performed to set up the device to operate within the environment; provide the first setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device; receive a second image data depicting the user in the environment representing the user performing the first setup instruction of the set of instructions; receive a second audio data representing speech of the user associated with performing the first setup instruction of the set of instructions; determine that the first setup instruction is completed; update the technical aptitude of the user based on the second image data and the second audio data, wherein updating includes; if the second image data and the second audio data indicates frustration with the first setup instruction being too difficult, setting the technical aptitude of the user to a novice technical aptitude; if the second image data and the second audio data indicates no frustration with the first setup instruction, setting the technical aptitude of the user to an average technical aptitude; and if the second image data and the second audio data indicates frustration with the first setup instruction being too easy, setting the technical aptitude of the user to an advanced technical aptitude; provide the second setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device, the second setup instruction being associated with the set technical aptitude, wherein each the novice technical aptitude, the advanced technical aptitude, and the average technical aptitude are associated with different second setup instructions; and determine that the second setup instruction is completed and the device is connected to an assistant device resulting in the assistant device being configured to control the device to provide a response to voice instructions received by the assistant device. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A computer program product including non-transitory computer-readable media storing computer program instructions, execution of which by a processor causes a processing system to perform operations comprising:
-
determining that a device is to be set up within an environment; receiving a first image data depicting a user in the environment; receiving a first audio data representing speech of the user in the environment; determining a technical aptitude of the user related to setting up the device based on the first image data and the first image data; identifying a set of instructions for setting up the device within the environment based on the device and the technical aptitude, wherein the set of instructions include a first setup instruction and a second setup instruction representing a corresponding sequence of steps to be performed to set up the device to operate within the environment; providing the first setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device; receiving a second image data depicting the user in the environment representing the user performing the first setup instruction of the set of instructions; receiving a second audio data representing speech of the user associated with performing the first setup instruction of the set of instructions; determining that the first setup instruction is completed; updating the technical aptitude of the user based on the second image data and the Second audio data, wherein updating includes; if the second image data and the second audio data indicates frustration with the first setup instruction being too difficult, setting the technical aptitude of the user to a novice technical aptitude; if the second image data and the second audio data indicates no frustration with the first setup instruction, setting the technical aptitude of the user to an average technical aptitude; and if the second image data and the second audio data indicates frustration with the first setup instruction being too easy, setting the technical aptitude of the user to an advanced technical aptitude; providing the second setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device, the second setup instruction being associated with the set technical aptitude, wherein each the novice technical aptitude, the advanced technical aptitude, and the average technical aptitude are associated with different second setup instructions; and determining that the second setup instruction is completed and the device is connected to an assistant device resulting in the assistant device being configured to control the device to provide a response to voice instructions received by the assistant device. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
Specification