Method and Apparatus for Building an Intelligent Automated Assistant

• US 20140108303A1
• Filed: 12/26/2013
• Published: 04/17/2014
• Est. Priority Date: 09/08/2005
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Cheyer, Adam, Guzzoni, Didier
• Granted Patent: US 9,501,741 B2
• Time in Patent Office: Days
• US Class Current: 706/11
• CPC Class Codes: G06F 9/54 Interprogram communication
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation
• CPC Class Codes: G06N 5/022 Knowledge engineering; Knowledge acquisition
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G09B 23/28 for medicine

Abstract

A method and apparatus are provided for building an intelligent automated assistant. Embodiments of the present invention rely on the concept of “active ontologies” (e.g., execution environments constructed in an ontology-like manner) to build and run applications for use by intelligent automated assistants. In one specific embodiment, a method for building an automated assistant includes interfacing a service-oriented architecture that includes a plurality of remote services to an active ontology, where the active ontology includes at least one active processing element that models a domain. At least one of the remote services is then registered for use in the domain.

Claims

1. A method for building an automated assistant, the method comprising:

registering a service for use in conjunction with an active ontology by specifying at least one of;

one or more active processing elements that the service can accept; and

one or more active processing elements that the service cannot accept;

wherein;

the active ontology comprises a plurality of active processing elements;

the registering is performed using a processor; and

the active ontology filters requests for services to the service in accordance with the one or more active processing elements specified by the service.

2. The method of claim 1, wherein the active ontology models a domain, and wherein each active processing element of the plurality of active processing elements represents at least one of:

an object in the domain and a task to be accomplished in the domain.

3. The method of claim 1, wherein at least two of the plurality of active processing elements communicate through message passing.

4. The method of claim 1, wherein each active processing element of the plurality of active processing elements is configured for at least one of:

service registration, language recognition, activity recognition, time recognition and task automation.

5. The method of claim 1, wherein the service is part of a service-oriented architecture, the method further comprising interfacing the service-oriented architecture to an execution environment including the active ontology.

6. The method of claim 5, wherein the service-oriented architecture is interfaced to the active ontology via a service broker.

7. The method of claim 6, wherein the service broker is configured for at least one of:

remote service selection, task delegation, query issuance, update issuance and service request monitoring.

8. The method of claim 7, wherein the service broker selects remote services for registration based on meta-data relating to the remote services.

9. The method of claim 1, wherein the service is invoked by the automated assistant to accomplish one or more tasks.

10. The method of claim 1, wherein each active processing element of the plurality of active processing elements is configured to receive at least one fact and to perform at least one action responsive to the at least one fact, and wherein the at least one fact relates to at least one event collected from a user'"'"'s environment.

11. The method of claim 1, wherein at least one of the plurality of active processing elements is configured to send at least one fact to at least one other active processing element.

12. The method of claim 1, wherein at least one of the plurality of active processing elements is configured to receive at least one fact from at least one other active processing element.

13. An electronic device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

registering a service for use in conjunction with an active ontology by specifying at least one of;

one or more active processing elements that the service can accept; and

one or more active processing elements that the service cannot accept;

wherein;

the active ontology comprises a plurality of active processing elements;

the registering is performed using a processor; and

the active ontology filters requests for services to the service in accordance with the one or more active processing elements specified by the service.

14. The electronic device of claim 13, wherein the active ontology models a domain, and wherein each active processing element of the plurality of active processing elements represents at least one of:

an object in the domain and a task to be accomplished in the domain.

15. The electronic device of claim 13, wherein at least two of the plurality of active processing elements communicate through message passing.

16. The electronic device of claim 13, wherein each active processing element of the plurality of active processing elements is configured for at least one of:

service registration, language recognition, activity recognition, time recognition and task automation.

17. The electronic device of claim 13, wherein the service is part of a service-oriented architecture, the one or more programs further comprising instructions for interfacing the service-oriented architecture to an execution environment including the active ontology.

18. The electronic device of claim 17, wherein the service-oriented architecture is interfaced to the active ontology via a service broker.

19. The electronic device of claim 18, wherein the service broker is configured for at least one of:

remote service selection, task delegation, query issuance, update issuance and service request monitoring.

20. The electronic device of claim 19, wherein the service broker selects remote services for registration based on meta-data relating to the remote services.

21. The electronic device of claim 13, wherein the service is invoked by the automated assistant to accomplish one or more tasks.

22. The electronic device of claim 13, wherein each active processing element of the plurality of active processing elements is configured to receive at least one fact and to perform at least one action responsive to the at least one fact, and wherein the at least one fact relates to at least one event collected from a user'"'"'s environment.

23. The electronic device of claim 13, wherein at least one of the plurality of active processing elements is configured to send at least one fact to at least one other active processing element.

24. The electronic device of claim 13, wherein at least one of the plurality of active processing elements is configured to receive at least one fact from at least one other active processing element.

25. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device, cause the device to:

register a service for use in conjunction with an active ontology by specifying at least one of;

one or more active processing elements that the service can accept; and

one or more active processing elements that the service cannot accept;

wherein;

the active ontology comprises a plurality of active processing elements;

the registering is performed using a processor; and

the active ontology filters requests for services to the service in accordance with the one or more active processing elements specified by the service.