DISCOVERING CAPABILITIES OF THIRD-PARTY VOICE-ENABLED RESOURCES

• US 20180005634A1
• Filed: 09/14/2017
• Published: 01/04/2018
• Est. Priority Date: 12/30/2014
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Kannan, Vishwac Sena, Uzelac, Aleksandar, Campbell, Jonathan, Hwang, Daniel J.
• Application Number:
  US15/705,037
• Publication Number:
  US 20180005634A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces

Abstract

Techniques are described for discovering capabilities of voice-enabled resources. A voice-controlled digital personal assistant can respond to user requests to list available voice-enabled resources that are capable of performing a specific task using voice input. The voice-controlled digital personal assistant can also respond to user requests to list the tasks that a particular voice-enabled resource can perform using voice input. The voice-controlled digital personal assistant can also support a practice mode in which users practice voice commands for performing tasks supported by voice-enabled resources.

Claims

1. A computing device comprising:

a processing unit;

memory; and

one or more microphones;

the computing device configured with a voice-controlled digital personal assistant to perform operations, the operations comprising;

receiving, via the one or more microphones, a digital voice input generated by a user;

performing natural language processing using the digital voice input to determine a user voice request, wherein the user voice request is a request for available third-party voice-enabled resources that are capable of performing a task;

identifying one or more third-party voice-enabled resources that are capable of performing the task using voice input, wherein the one or more third-party voice-enabled resources are identified using a data structure that defines tasks supported by available third-party voice-enabled resources using voice input, wherein the data structure comprises;

information identifying voice commands supported by the available third-party voice-enabled resources; and

information identifying voice command variations supported by the available third-party voice-enabled resources;

providing a response to the user identifying the one or more third-party voice-enabled resources that are capable of performing the task; and

performing a user-initiated command to delete a voice command of a specific third-party voice-enabled resource from the data structure, and to delete all of the voice command'"'"'s corresponding voice command variations from the data structure that are associated with the voice command in the data structure, wherein the deleted voice command, and corresponding voice command variations, cannot be performed by user voice input.

2. The computing device of claim 1 wherein the identifying the one or more third-party voice-enabled resources that are capable of performing the task comprises:

evaluating third-party voice-enabled applications installed on the computing device.

3. The computing device of claim 1 wherein the identifying the one or more third-party voice-enabled resources that are capable of performing the task comprises:

evaluating third-party voice-enabled resources available from a remote web service.

4. The computing device of claim 1 wherein the data structure comprises:

information identifying voice command examples supported by the available third-party voice-enabled resources.

5. The computing device of claim 1 wherein the data structure comprises, for each of the one or more third-part voice-enabled resources:

information identifying one or more voice commands supported by the third-party voice-enabled resource; and

for each of the one or more voice commands supported by the third-party voice-enabled resource;

information defining one or more voice command variations, wherein the one or more voice command variations define one or more variations of user voice input that will perform the voice command; and

information identifying one or more voice command examples, wherein the one or more voice command examples are examples of user voice input that will perform the voice command.

6. The computing device of claim 1 wherein providing the response to the user comprises, for each of the one or more third-party voice-enabled resources that are capable of performing the task:

displaying an indication of at least one voice command variation supported by the third-party voice-enabled resource that will perform the task; and

displaying an indication of at least one voice command example for performing the task.

8. The computing device of claim 1 the operations further comprising:

receiving a user-initiated command, wherein the user-initiated command identifies a specific third-party voice-enabled resource from the one or more third-party voice-enabled resources and a request to practice tasks supported by the specific third-party voice-enabled resource.

9. The computing device of claim 1 the operations further comprising:

receiving a user-initiated command, wherein the user-initiated command identifies a specific third-party voice-enabled resource from the one or more third-party voice-enabled resources and a request to practice a specific voice command variation for performing a specific task supported by the specific third-party voice-enabled resource.

10. The computing device of claim 1 wherein the task is a task for playing a movie, wherein the one or more third-party voice-enabled resources are capable of playing a movie on the computing device, and wherein the response to the user lists the one or more third-party voice-enabled resources that are capable of playing a movie.

21. The computing device of claim 1 the operations further comprising:

receiving a second digital voice input from the user practicing a voice command for performing a task of the specific third-party voice-enabled resource;

providing a response to the user indicating whether the second digital voice input would have performed the task;

wherein the voice-controlled digital personal assistant determines whether the second digital voice input would have performed the task without communicating the voice command to the specific third-party voice-enabled resource, and wherein the specific third-party voice-enabled resource does not perform the task.

7. (canceled)

11. A method, implemented by a computing device comprising a microphone, the method comprising:

receiving, by a voice-controlled digital personal assistant, a digital voice input generated by a user, wherein the digital voice input is received via the microphone

performing natural language processing using the digital voice input to determine a user voice request, wherein the user voice request is a request for available tasks capable of being performed by a specific third-party voice-enabled resource;

identifying, by the voice-controlled digital personal assistant, the available tasks capable of being performed by the specific third-party voice-enabled resource, wherein the available tasks are identified using a data structure that defines the available tasks supported by the specific third-party voice-enabled resource using voice input, wherein the data structure comprises;

information identifying each of the available tasks supported by the specific third-party voice-enabled resource; and

information identifying voice command variations supported by the specific third-party voice-enabled resource that will perform the task;

providing, by the voice-controlled digital personal assistant, a response to the user identifying each of the available tasks capable of being performed by the specific third-party voice-enabled resource; and

performing a user-initiated command to delete a specific task of the specific third-party voice-enabled resource from the data structure, and to delete all of the specific task'"'"'s corresponding voice command variations from the data structure that are associated with the specific task in the data structure, wherein the deleted task, and corresponding voice command variations, cannot be performed by user voice input.

12. The method of claim 11 wherein the specific third-party voice-enabled resource is a specific third-party voice-enabled application, and wherein the data structure comprises:

information identifying voice command examples supported by the specific third-party voice-enabled application.

13. The method of claim 11 wherein the specific third-party voice-enabled resource is a remote web resource, the method further comprising:

retrieving the data structure from a remote web site.

14. The method of claim 11 wherein providing the response to the user comprises, for each of one or more tasks of the available tasks capable of being performed by the specific third-party voice-enabled resource:

displaying, by the voice-controlled digital personal assistant, an indication of at least one voice command variation supported by the specific third-party voice-enabled resource that will perform the task; and

displaying, by the voice-controlled digital personal assistant, an indication of at least one voice command example for performing the task.

15. (canceled)

16. A computer-readable storage medium storing computer-executable instructions for causing a computing device to perform operations, the operations comprising:

receiving, by a voice-controlled digital personal assistant, a user request to practice voice commands provided by a third-party voice-enabled resource;

receiving, by the voice-controlled digital personal assistant, a digital voice input generated by the user, wherein the digital voice input is received via a microphone of the computing device;

performing natural language processing using the digital voice input to determine a user voice request;

determining, by the voice-controlled digital personal assistant, whether the user voice request matches a voice command variation associated with a task of the third-party voice-enabled resource, wherein a data structure defines available tasks supported by the voice-controlled digital personal assistant using voice input, the data structure comprising;

information identifying each of the available tasks supported by the voice-controlled digital personal assistant; and

information identifying voice command variations supported by the voice-controlled digital personal assistant that define variations of user voice input that will perform the task;

providing, by the voice-controlled digital personal assistant, a response to the user indicating whether the user voice request matches a voice command variation associated with the task; and

performing a user-initiated command to delete a specific task of the third-party voice-enabled resource from the data structure, and to delete all of the specific task'"'"'s corresponding voice command variations from the data structure that are associated with the specific task in the data structure, wherein the deleted task, and corresponding voice command variations, cannot be performed by user voice input.

17. The computer-readable storage medium of claim 16 the operations further comprising:

presenting, by the voice-controlled digital personal assistant, a list of available tasks supported by the third-party voice-enabled resource, wherein the task is one of the list of available tasks.

18. The computer-readable storage medium of claim 16 wherein the user voice request matches a voice command variation associated with the task, and wherein the response provided to the user indicates that the user has successfully spoken the user voice request that would perform the task.

19. The computer-readable storage medium of claim 16 wherein the user voice request matches a voice command variation associated with the task, and wherein providing the response to the user comprises:

providing, by the voice-controlled digital personal assistant, a voice response comprising an emulated response of the third-party voice-enabled resource to the user voice request, wherein the emulated response is obtained from the data structure maintained by the voice-controlled digital personal assistant that defines supported tasks and their associated emulated voice responses, and wherein the voice-controlled digital personal assistant provides the emulated response without involvement of the third-party voice-enabled resource.

20. The computer-readable storage medium of claim 16 wherein the user voice request does not match a voice command variation associated with the task, and wherein providing the response to the user comprises:

providing, by the voice-controlled digital personal assistant, a response comprising one or more voice command examples for performing the task, wherein the one or more voice command examples are obtained from the data structure maintained by the voice-controlled digital personal assistant that defines supported tasks and their associated voice command examples.

22. The computer-readable storage medium of claim 16 wherein the voice-controlled digital personal assistant determines whether the voice request matches a voice command variation associated with the task without communicating the voice command to the third-party voice-enabled resource, and wherein the third-party voice-enabled resource does not perform the task.