×

Troubleshooting voice-enabled home setup

  • US 10,212,040 B2
  • Filed: 01/26/2018
  • Issued: 02/19/2019
  • Est. Priority Date: 04/17/2017
  • Status: Active Grant
First Claim
Patent Images

1. A method for a home assistant device with artificial intelligence (AI) to facilitate setup of a device within a home environment, comprising:

  • determining, by a processor, that the device is to be set up within the home environment;

    receiving a first image data depicting a user in the home environment;

    receiving a first audio data representing speech of the user in the home environment;

    determining a technical aptitude of the user related to setting up the device based on the first image data and the first image data;

    identifying a set of instructions for setting up the device within the home environment based on the device and the technical aptitude, wherein the set of instructions include a first setup instruction and a second setup instruction representing a corresponding sequence of steps to be performed to set up the device to operate within the home environment;

    providing the first setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device;

    receiving a second image data depicting the user in the home environment representing the user performing the first setup instruction of the set of instructions;

    receiving a second audio data representing speech of the user associated with performing the first setup instruction of the set of instructions;

    determining that the first setup instruction is completed;

    updating the technical aptitude of the user based on the second image data and the second audio data, wherein updating includes;

    if the second image data and the second audio data indicates frustration with the first setup instruction being too difficult, setting the technical aptitude of the user to a novice technical aptitude;

    if the second image data and the second audio data indicates no frustration with the first setup instruction, setting the technical aptitude of the user to an average technical aptitude; and

    if the second image data and the second audio data indicates frustration with the first setup instruction being too easy, setting the technical aptitude of the user to an advanced technical aptitude;

    providing the second setup instruction of the set of instructions to the user representing steps to be performed by the user to set up the device, the second setup instruction being associated with the set technical aptitude, wherein each the novice technical aptitude, the advanced technical aptitude, and the average technical aptitude are associated with different second setup instructions; and

    determining that the second setup instruction is completed and the device is connected to the home assistant device resulting in the home assistant device being configured to control the device to provide a response to voice instructions receive by the home assistant device.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×