Rapid development of virtual personal assistant applications

• US 9,489,625 B2
• Filed: 05/10/2013
• Issued: 11/08/2016
• Est. Priority Date: 05/10/2013
• Status: Active Grant

• Current Assignee: SRI International, Inc.
• Original Assignee: SRI International, Inc.
• Inventors: Kalns, Edgar T., Freitag, Dayne B., Mark, William S., Ayan, Necip Fazil, Wolverton, Michael J., Lee, Thomas J.
• Primary Examiner(s): Wong, Lut
• Application Number:
  US13/891,864
• Publication Number:
  US 20140337266A1
• Time in Patent Office: 1,278 Days
• Field of Search: 706/46
• US Class Current: 1/1
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation

Abstract

A platform for developing a virtual personal assistant (“VPA”) application includes an ontology that defines a computerized structure for representing knowledge relating to one or more domains. A domain may refer to a category of information and/or activities in relation to which the VPA application may engage in a conversational natural language dialog with a computing device user. Re-usable VPA components may be linked to or included in the ontology. An ontology populating agent may at least partially automate the process of populating the ontology with domain-specific information. The re-usable VPA components may be linked with the domain-specific information through the ontology. A VPA application created with the platform may include domain-adapted re-usable VPA components that may be called upon by an executable VPA engine to determine a likely intended meaning of conversational natural language input of the user and/or initiate an appropriate system response to the input.

Claims

1. A method for creating a virtual personal assistant (“

VPA”

) computer application for a domain of interest, the method comprising, with a computing system;

determining the domain of interest;

accessing a computerized ontology defining a structure for representing knowledge relating to a plurality of domains including the domain of interest, each domain referring to a category of information and/or activities in relation to which the VPA computer application may conduct a conversational natural language dialog with a computing device user,

the ontology having linked thereto a plurality of re-usable VPA components, each of the re-usable VPA components being accessible by an executable VPA engine to, during operation of the VPA, determine a likely intended goal of the computing device user based on a determined meaning of explicit and implicit conversational natural language input of the computing device user, execute a task on behalf of the computing device user, and/or generate a likely appropriate system output in response to the conversational natural language input;

determining a data relationship between the domain of interest and at least a portion of the ontology; and

suggesting a re-usable VPA component to use to create the VPA computer application for the domain of interest based on the data relationship between the domain of interest and the ontology.

2. The method of claim 1, wherein the ontology comprises an hierarchical structure of ontological concepts each representing a portion of the knowledge relating to the plurality of domains,

the re-usable VPA component is linked with one of the ontological concepts in the hierarchical structure,

the data relationship between the domain of interest and the ontology comprises a data relationship between the domain of interest and another of the ontological concepts in the hierarchical structure, and

the method comprises identifying the re-usable VPA component in an automated fashion based on an inheritance relationship between the one of the ontological concepts and the other of the ontological concepts in the hierarchical structure.

3. The method of claim 1, comprising creating a customized version of the suggested re-usable VPA component for the domain of interest.

4. The method of claim 3, comprising replacing a parameter of the suggested re-usable VPA component with content associated with the domain of interest.

5. The method of claim 3, comprising updating the ontology to include a link between the ontology and the customized version of the suggested re-usable VPA component.

6. The method of claim 1, comprising suggesting another re-usable VPA component to use to create the VPA computer application for the domain of interest based on the link between the re-usable VPA component and the ontology and a link between the ontology and the other re-usable VPA component.

7. The method of claim 1, wherein the suggested re-usable VPA component comprises a default task flow executable by the VPA computer application in response to the conversational natural language input, and the method comprises mapping data from an Internet web page that supports electronic transactions with computing device users relating to the domain of interest to the default task flow using the ontology.

8. The method of claim 1, wherein the suggested re-usable VPA component comprises a natural language dialog component usable by the VPA computer application to determine the likely intended meaning of the conversational natural language input, and the method comprises mapping data from an Internet web page that supports electronic transactions with computing device users relating to the domain of interest to the natural language dialog component through the ontology.

9. The method of claim 1, wherein the suggested re-usable VPA component comprises a natural language dialog component usable by the VPA computer application to generate the likely appropriate system output to the conversational natural language input, and the method comprises mapping data from an Internet web page that supports electronic transactions with computing device users relating to the domain of interest to the natural language dialog component using the ontology.

10. A system for creating a virtual personal assistant (“

VPA”

) computer application for a domain of interest, the system comprising one or more computing devices configured to;

access a computerized ontology defining a structure for representing knowledge relating to a plurality of domains, each domain referring to a category of information and/or activities in relation to which the VPA computer application may conduct a conversational spoken natural language dialog with a computing device user,

the ontology having linked thereto a plurality of re-usable VPA components, each of the re-usable VPA components being accessible by an executable VPA engine to, during operation of the VPA, determine a likely intended goal of the computing device user based on a determined meaning of explicit and implicit conversational natural language input of the computing device user, execute a task on behalf of the computing device user, and/or generate a likely appropriate system output in response to the conversational natural language input;

determine a data relationship between the domain of interest and at least a portion of the ontology; and

responsive to the determination of the data relationship, suggest a re-usable VPA component to use to create the VPA computer application for the domain of interest based on the data relationship between the domain of interest and the ontology.

11. The system of claim 10, wherein the ontology comprises an hierarchical structure of ontological concepts each representing a portion of the knowledge relating to the plurality of domains,

the re-usable VPA component is linked with one of the ontological concepts in the hierarchical structure,

the data relationship between the domain of interest and the ontology comprises a data relationship between the domain of interest and another of the ontological concepts in the hierarchical structure, and

the system is configured to identify the re-usable VPA component in an automated fashion based on an inheritance relationship between the one of the ontological concepts and the other of the ontological concepts in the hierarchical structure.

12. The system of claim 10, configured to create a customized version of the suggested re-usable VPA component for the domain of interest.

13. The system of claim 10, configured to replace a parameter of the suggested re-usable VPA component with content associated with the domain of interest.

14. The system of claim 10, configured to update the ontology to include a link between the ontology and the customized version of the suggested re-usable VPA component.

15. The system of claim 10, configured to suggest another re-usable VPA component to use to create the VPA computer application for the domain of interest based on the link between the re-usable VPA component and the ontology and a link between the ontology and the other re-usable VPA component.

16. The system of claim 10, wherein the suggested re-usable VPA component comprises a default task flow executable by the VPA computer application in response to the conversational natural language input, and the system is configured to map data from an Internet web page that supports electronic transactions with computing device users relating to the domain of interest to the default task flow using the ontology.

17. The system of claim 10, wherein the suggested re-usable VPA component comprises a natural language dialog component usable by the VPA computer application to determine the likely intended meaning of the conversational natural language input, and the system is configured to map data from an Internet web page that supports electronic transactions with computing device users relating to the domain of interest to the natural language dialog component through the ontology.

18. The system of claim 10, wherein the suggested re-usable VPA component comprises a natural language dialog component usable by the VPA computer application to generate the likely appropriate system output to the conversational natural language input, and the system is configured to map data from an Internet web page that supports electronic transactions with computing device users relating to the domain of interest to the natural language dialog component using the ontology.

19. An application, embodied in one or more non-transitory computer readable storage media, to facilitate creation of a virtual personal assistant (“

VPA”

) computer application for a domain of interest, the application comprising instructions executable by one or more computing devices to;

access a computerized ontology defining a structure for representing knowledge relating to a plurality of domains, each domain referring to a category of information and/or activities in relation to which the VPA computer application may conduct a conversational spoken natural language dialog with a computing device user,

the ontology having linked thereto a plurality of re-usable VPA components, each of the re-usable VPA components being accessible by an executable VPA engine to, during operation of the VPA, determine a likely intended goal of the computing device user based on determined meaning of explicit and implicit conversational natural language input of the computing device user, execute a task on behalf of the computing device user, and/or generate a likely appropriate system output in response to the conversational natural language input; and

based on at least a portion of the ontology, suggest a re-usable VPA component to use to create the VPA computer application for the domain of interest.

20. The application of claim 19, comprising instructions executable by one or more computing devices to cause a domain-specific version of the suggested re-usable VPA component to be incorporated into the VPA computer application for the domain of interest.