Language agnostic command-understanding digital assistant

• US 10,176,171 B1
• Filed: 05/24/2018
• Issued: 01/08/2019
• Est. Priority Date: 12/29/2017
• Status: Active Grant

• Current Assignee: Peloton Interactive, Inc.
• Original Assignee: Aiqudo, Inc.
• Inventors: Patterson, David, Dobrynin, Vladimir, Marrs, Gary Russell
• Primary Examiner(s): Albertalli, Brian L
• Application Number:
  US15/988,620
• Time in Patent Office: 229 Days
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G06F 9/454 Multi-language systems; Localisation; Internationalisation

Abstract

Systems, methods, and non-transitory computer-readable storage media are provided for crowdsourcing actions and commands of a digital assistant application, irrespective of the languages spoken by users of the digital assistant application. Techniques described herein enable the on-boarding of actions datasets, which include defined commands and actions that result therefrom, from client devices to a remote server device. More specifically, the described techniques facilitate the proper on-boarding, distribution, and retrieval of action datasets regardless of the command language employed by users of the digital assistant application to invoke a properly-determined corresponding action.

Claims

1. A computer-implemented method for language agnostic maintenance of actions for a crowd-sourced digital assistant, the method comprising:

receiving, by a server device, an action dataset generated by a remote client device having the crowd-sourced digital assistant executing thereon, the received action dataset referencing a corresponding set of inputs and including at least a corresponding command template transcribed in a foreign language;

querying, by the server device in the foreign language, at least one of an Internet search engine and a third-party data repository for pieces of electronic content determined relevant to at least the corresponding command template;

employing, by the server device, a translation service to translate at least the corresponding command template and the determined relevant pieces of electronic content to a defined core language;

adding, by the server device, the translated relevant pieces of electronic content mapped to at least the translated command template of the received action dataset to a repository, the repository being searchable to identify the action dataset based on a received command representation transcribed in one of the foreign language or another foreign language.

2. The computer-implemented method of claim 1, wherein the corresponding command template includes a defined set of parameter fields, wherein the translated command template is mapped to the corresponding command template including the defined set of parameter fields.

3. The computer-implemented method of claim 1, further comprising:

translating, by the server device, the received command representation from one of the foreign language or the other foreign language to the core language, the translated command representation being employed to search the repository and identify the action dataset.

4. The computer-implemented method of claim 1, wherein the command representation is received from one of a plurality of remote client devices having the digital assistant application executing thereon.

5. The computer-implemented method of claim 1, wherein the translated relevant pieces of electronic content are further mapped to the command template transcribed in the foreign language.

6. The computer-implemented method of claim 1, wherein each piece of the translated relevant pieces of electronic content is mapped to the translated command template by modifying or adding a title to the piece to recite at least a portion of the translated command template.

7. The computer-implemented method of claim 1, further comprising employing a foreign language application to identify the foreign language employed in the query.

8. The computer-implemented method of claim 1, wherein the digital assistant application is configured to emulate the set of inputs in response to a determination that a received command representation corresponds to one of a set of command templates indexed by at least one of the remote client device and the server device.

9. A non-transitory computer storage medium storing computer-useable instructions that, when used by at least one computing device, cause the at least one computing device to perform operations to communicate action datasets indexed in a core language based on commands received in a foreign language, comprising:

receiving, by a server, a command representation from a digital assistant application installed on a remote client computing device, the command representation being transcribed in the foreign language;

translating, by the server, the received command representation into the core language;

querying, by the server, a plurality of indexed action datasets stored thereon, the plurality of action datasets being indexed in at least the core language, each action dataset including a corresponding set of command templates and inputs associated with one of a plurality of applications;

selecting, by the server, at least one action dataset from the plurality of indexed action datasets determined to be most relevant to the translated command representation; and

communicating, by the server, the selected at least one action dataset to the remote client computing device to invoke thereon the corresponding set of inputs associated with one of the plurality of applications.

10. The non-transitory computer storage medium of claim 9, wherein each action dataset in at least a portion of the plurality of indexed action datasets is mapped to a corresponding set of electronic content pieces transcribed in the core language, the corresponding set of electronic content pieces having been retrieved in one of a plurality of foreign languages and translated to the core language when the action dataset was on-boarded to the server, and wherein each corresponding set of electronic content pieces is queried based on the plurality of indexed action datasets being queried.

11. The non-transitory computer storage medium of claim 10, wherein querying the plurality of indexed action datasets includes a search of the plurality of corresponding sets of electronic content pieces.

12. The non-transitory computer storage medium of claim 9, wherein the received command representation includes at least one parameter, and wherein the selected at least one action dataset includes at least one corresponding parameter field, the operations further comprising:

extracting the at least one parameter from the received command representation based on the at least one corresponding parameter field.

13. The non-transitory computer storage medium of claim 12, further communicating the extracted at least one parameter to the remote client computing device to invoke thereon the corresponding set of inputs associated with one of the plurality of applications.

14. The non-transitory computer storage medium of claim 9, wherein each action dataset in at least a portion of the plurality of indexed action datasets is further mapped to a corresponding foreign language command template, the corresponding foreign language command template having been included in the action dataset when it was on-boarded to the server.

15. The non-transitory computer storage medium of claim 9, wherein only a set of action datasets from the plurality of action datasets is queried based on a determination that a corresponding set of applications from the plurality of applications is installed on the remote client computing device.

16. A computer-implemented method for receiving action datasets indexed in a core language based upon command representations received in a foreign language, comprising:

receiving, by a digital assistant application executing on a client computing device, a command representation transcribed in a foreign language and corresponding to a particular application installed on the client computing device;

communicating, by the digital assistant application, the foreign language command representation to a server having a plurality of action datasets indexed in the core language, each of the plurality of action datasets including at least a corresponding set of inputs and a corresponding set of command templates;

receiving, by the digital assistant application and from the server, one or more action datasets, selected from the plurality of indexed action datasets, based on a determination that at least one core language command template included in one or more action datasets is most relevant to at least a core language translation of the received command representation.

17. The computer-implemented method of claim 16, wherein the one or more action datasets is received based further on a determination that at least one translated set of electronic content pieces, retrieved based at least in part on a foreign language command template included in the one or more action datasets when each was on-boarded, is most relevant to the core language translation of the received command representation.

18. The computer-implemented method of claim 17, wherein the at least one translated set of electronic content pieces is mapped to the selected one or more action datasets.

19. The computer-implemented method of claim 16, wherein the command representation includes at least one parameter, and wherein at least one command template in the corresponding set of command templates includes at least one parameter field that corresponds to the at least one parameter.

20. The computer-implemented method of claim 16, wherein at least a portion of the plurality of action datasets indexed in the core language was on-boarded thereto including at least one command template transcribed in one of a plurality of foreign languages.