Intelligent Automated Assistant

• US 20130275164A1
• Filed: 06/07/2013
• Published: 10/17/2013
• Est. Priority Date: 01/18/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Gruber, Thomas R., Cheyer, Adam J., Keen, Daniel
• Granted Patent: US 10,276,170 B2
• Time in Patent Office: Days
• US Class Current: 705/5
• CPC Class Codes: G06F 16/2457 with adaptation to user needs
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 10/02 Reservations, e.g. for tickets, services or events
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/226 using non-speech characteristics

Abstract

The intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Claims

1. A method for providing assistance with search and reservation requests using a digital assistant, comprising:

at an electronic device comprising a processor and memory storing instructions for execution by the processor;

receiving a search request from a user through a dialogue interface of the digital assistant, the search request including at least a speech input and specifying one or more search criteria for identifying reservable items offered by one or more third-party providers;

in response to receiving the search request, presenting a plurality of search results to the user through the dialogue interface, each search result corresponding to a respective reservable item identified in accordance with the search request;

through the dialogue interface of the digital assistant, receiving a reservation request for a first search result of the plurality of search results from the user; and

in response to receiving the reservation request, executing a reservation procedure to reserve a respective reservable item corresponding to the first search result, while maintaining the dialogue interface to receive subsequent user input.

2. The method of claim 1, wherein the search request is a restaurant search request, the plurality of search results correspond to a plurality of restaurants identified in accordance the restaurant search request, and the reservation procedure reserves a table at a respective restaurant corresponding to the first search result.

3. The method of claim 1, wherein the search request is an entertainment search request, the plurality of search results correspond to a plurality of entertainment events identified in accordance the entertainment search request, and the reservation procedure purchases or reserves one or more tickets for a respective entertainment event corresponding to the first search result.

4. The method of claim 1, wherein the search request further includes context information associated with the speech input and wherein the method further comprises:

identifying at least one of the one or more search criteria based at least in part on the context information; and

identifying a plurality of reservable items in accordance with the one or more search criteria to generate the plurality of search results.

5. The method of claim 4, further comprising:

maintaining the context information based on one or more prior user interactions between the user and the digital assistant through the dialogue interface.

6. The method of claim 4, wherein the context information includes one or more of a current location, a current time, user preferences, calendar information, and contacts associated with the user.

7. The method of claim 1, further comprising:

for each of the plurality of search results, presenting respective one or more properties of the respective reservable item corresponding to the search result, each respective property corresponding to a respective one of the search criteria used in identifying the plurality of search results.

8. The method of claim 1, further comprising:

presenting one or more user interface elements in the dialogue interface along with the plurality of search results, wherein selection of at least one of the user interface elements causes presentation of additional information related to one or more of the search results in the dialogue interface.

9. The method of claim 8, wherein selection of the at least one of the user interface elements causes presentation of one or more of a review, a map, a trailer, an availability summary, and a rating associated with one or more of the plurality of search results.

10. The method of claim 1, further comprising:

presenting one or more user interface elements in the dialogue interface along with the plurality of search results, wherein selection of at least one of the user interface elements causes a follow-on action associated with one or more of the plurality of search results to be executed by the digital assistant.

11. The method of claim 10, wherein selection of the at least one of the user interface elements causes one or more of the follow-on actions:

initiating a telephonic call to a third party, submitting a review, saving a link, sharing a link, requesting directions, making a reservation, and purchasing one or more tickets, to be executed by the digital assistant with regard to one or more of the plurality of search results.

12. The method of claim 1, further comprising:

providing a speech output through the dialogue interface, the speech output paraphrasing the search request received from the user.

13. The method of claim 1, further comprising:

providing a speech output concurrently with the plurality of search results, the speech output announcing the one or more search criteria used to identify the plurality of search results.

14. The method of claim 1, further comprising:

providing a speech output through the dialogue interface, the speech output requesting at least one additional search criterion for the received search request;

in response to providing the speech output, receiving additional input from the user through the dialogue interface; and

supplementing the search request with the additional user input.

15. The method of claim 1, further comprising:

generating and storing a reminder or calendar entry in accordance with the reservation.

16. The method of claim 1, further comprising:

generating an invitation for another user in accordance with the reservation.

17. A system, comprising:

one or more processors; and

memory storing instructions, the instructions configured to be executed by the one or more processors and cause the one or more processors to perform operations comprising;

receiving a search request from a user through a dialogue interface of a digital assistant, the search request including at least a speech input and specifying one or more search criteria for identifying reservable items offered by one or more third-party providers;

in response to receiving the search request, presenting a plurality of search results to the user through the dialogue interface, each search result corresponding to a respective reservable item identified in accordance with the search request;

through the dialogue interface of the digital assistant, receiving a reservation request for a first search result of the plurality of search results from the user; and

in response to receiving the reservation request, executing a reservation procedure to reserve a respective reservable item corresponding to the first search result, while maintaining the dialogue interface to receive subsequent user input.

18. The system of claim 17, wherein the search request is a restaurant search request, the plurality of search results correspond to a plurality of restaurants identified in accordance the restaurant search request, and the reservation procedure reserves a table at a respective restaurant corresponding to the first search result.

19. The system of claim 17, wherein the search request is an entertainment search request, the plurality of search results correspond to a plurality of entertainment events identified in accordance the entertainment search request, and the reservation procedure purchases or reserves one or more tickets for a respective entertainment events corresponding to the first search result.

20. The system of claim 17, wherein the search request further includes context information associated with the speech input and wherein the operations further comprise:

identifying at least one of the one or more search criteria based at least in part on the context information; and

identifying a plurality of reservable items in accordance with the one or more search criteria to generate the plurality of search results.

21. The system of claim 17, wherein the operations further comprise:

providing a speech output through the dialogue interface, the speech output paraphrasing the search request received from the user.

22. The system of claim 17, wherein the operations further comprise:

providing a speech output along with the plurality of search results, the speech output announcing the one or more search criteria used to identify the plurality of search results.

23. The system of claim 17, wherein the operations further comprise:

providing a speech output through the dialogue interface, the speech output requesting at least one additional search criterion for the received search request;

in response to providing the speech output, receiving additional input from the user through the dialogue interface; and

supplementing the search request with the additional user input.

24. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device, cause the device to:

receive a search request from a user through a dialogue interface of a digital assistant, the search request including at least a speech input and specifying one or more search criteria for identifying reservable items offered by one or more third-party providers;

in response to receiving the search request, present a plurality of search results to the user through the dialogue interface, each search result corresponding to a respective reservable item identified in accordance with the search request;

through the dialogue interface of the digital assistant, receive a reservation request for a first search result of the plurality of search results from the user; and

in response to receiving the reservation request, execute a reservation procedure to reserve a respective reservable item corresponding to the first search result, while maintaining the dialogue interface to receive subsequent user input.

25. The computer readable storage medium of claim 24, wherein the search request is a restaurant search request, the plurality of search results correspond to a plurality of restaurants identified in accordance the restaurant search request, and the reservation procedure reserves a table at a respective restaurant corresponding to the first search result.

26. The computer readable storage medium of claim 24, wherein the search request is an entertainment search request, the plurality of search results correspond to a plurality of entertainment events identified in accordance the entertainment search request, and the reservation procedure purchases or reserves one or more tickets for a respective entertainment events corresponding to the first search result.

27. The computer readable storage medium of claim 24, wherein the search request further includes context information associated with the speech input and wherein the instructions further cause the device to:

identify at least one of the one or more search criteria based at least in part on the context information; and

identify a plurality of reservable items in accordance with the one or more search criteria to generate the plurality of search results.

28. The computer readable storage medium of claim 24, wherein the instructions further cause the device to:

provide a speech output through the dialogue interface, the speech output paraphrasing the search request received from the user.

29. The computer readable storage medium of claim 24, wherein the instructions further cause the device to:

provide a speech output concurrently with the plurality of search results, the speech output announcing the one or more search criteria used to identify the plurality of search results.

30. The computer readable storage medium of claim 24, wherein the instructions further cause the device to:

provide a speech output through the dialogue interface, the speech output requesting at least one additional search criterion for the received search request;

in response to providing the speech output, receive additional input from the user through the dialogue interface; and

supplement the search request with the additional user input.