Virtual assistant in a communication session

• US 10,460,227 B2
• Filed: 05/15/2015
• Issued: 10/29/2019
• Est. Priority Date: 05/15/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Sanghavi, Mehul K., Schwerdtfeger, Jeffrey P.
• Primary Examiner(s): Smith, Paulinho E
• Application Number:
  US14/713,410
• Publication Number:
  US 20160335532A1
• Time in Patent Office: 1,628 Days
• Field of Search: None
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06F 40/35 Discourse or dialogue representation
• CPC Class Codes: G06N 3/006 based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04L 51/02 using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 51/212 using filtering or selective blocking

Abstract

Disclosed are systems, methods, and non-transitory computer-readable storage media for utilizing a virtual assistant as part of a communication session. One or more of the participant users can select to utilize a virtual assistant to assist the participant users with tasks during the communication session. A user can use a communication application to enter a message directed to the virtual assistant. The virtual assistant can analyze the entered message and determine that the message was directed to the virtual assistant rather than to the other participants of the communication session. As a result, the message will not be transmitted to the other participants of the communication session and the virtual assistant will assist the user with the identified task. A virtual assistant can assist a user with a variety of different tasks.

Claims

1. A method comprising:

receiving, by a first client device, as part of a communication session that takes place within a text-messaging communication application between a first user operating the first client device and at least a second user, a first message prepared by the first user;

determining, by a virtual assistant of the first client device based on a semantic analysis of the first message, whether the first message is directed to the virtual assistant or to the set of participant users;

determining, by the virtual assistant of the first client device, based on the semantic analysis of the first message, that the first message is directed to the virtual assistant and that the first message identifies a first task with which the virtual assistant can assist the first user; and

in response to determining that the first message is directed to the virtual assistant, assisting, by the first client device, the first user with the first task, wherein the first message is displayed within the text-messaging communication application of the first client device and the first message is not transmitted to at least the second user.

2. The method of claim 1, further comprising:

receiving a second message prepared by the first user as part of the communication session;

determining, by the virtual assistant of the first client device, based on a semantic analysis of the second message, whether the second message is directed to the virtual assistant or to the set of participant users;

determining, by the virtual assistant of the first client device, based on the semantic analysis of the second message, that the second message is directed to at least the second user; and

in response to determining that the second message is directed to at least the second user, transmitting, by the first client device, the second message to at least the second user as part of the communication session.

3. The method of claim 2, further comprising:

identifying, by the virtual assistant of the first client device, based on the semantic analysis of the second message, a second task with which the virtual assistant can assist the first user; and

in response to identifying the second task, assisting, by the virtual assistant of the first client device, the first user with the second task.

4. The method of claim 3, further comprising:

presenting, on the first client device and as part of the communication session, a request message asking the first user whether the first user would like the virtual assistant to assist the first user with the second task; and

receiving an input indicating that the first user would like the virtual assistant to assist the first user with the second task.

5. The method of claim 1, further comprising:

transmitting, to a second client device and as part of the communication session, a notification message indicating that the virtual assistant is being utilized in relation to the communication session, wherein the second client device is associated with the second user.

6. The method of claim 1, wherein the first task is performing a financial transaction between the first user and at least the second user.

7. The method of claim 6, further comprising:

identifying, by the virtual assistant of the first client device, a set of financial applications installed on both the first client device and a second client device that are capable of completing the financial transaction, wherein the second client device is associated with the second user;

transmitting, to the second client device, a second message as part of the communication session, the second message prompting the second user to select a financial application from the set of financial applications to complete the financial transaction;

receiving, from the second client device, a first reply message identifying the financial application selected from the set of financial applications selected by the second user to complete the financial transaction; and

executing the financial application.

8. A client device comprising:

a computer processor; and

a memory containing instructions that, when executed, cause the computer processor to;

receive, as part of a communication session that takes place within a text-messaging communication application between a first user operating the client device and at least a second user, a first message prepared by the first user;

determine, by a virtual assistant of the client device, based on a semantic analysis of the first message, whether the first message is directed to the virtual assistant or to the set of participant users;

determine, by the virtual assistant of the client device, based on the semantic analysis of the first message, that the first message is directed to the virtual assistant and that the first message identifies a first task with which the virtual assistant can assist the first user; and

in response to determining that the first message is directed to the virtual assistant, assist the first user with the first task, wherein the first message is a text message displayed within the text-messaging communication application of the client device and the first message is not transmitted to at least the second user.

9. The client device of claim 8, wherein the instructions further cause the computer processor to:

receive a second message prepared by the first user as part of the communication session;

determine, by the virtual assistant of the client device, based on a semantic analysis of the second message, whether the second message is directed to the virtual assistant or to the set of participant users;

determine, by the virtual assistant of the client device, based on the semantic analysis of the second message, that the second message is directed to at least the second user; and

in response to determining that the second message is directed to at least the second user, transmit the second message to at least the second user as part of the communication session.

10. The client device of claim 9, wherein the instructions further cause the computer processor to:

identify, by the virtual assistant of the client device, based on the semantic analysis of the second message, a second task with which the virtual assistant can assist the first user; and

in response to identifying the second task, assist, by the virtual assistant of the client device, the first user with the second task.

11. The client device of claim 10, wherein the instructions further cause the computer processor to:

present, on the client device and as part of the communication session, a request message asking the first user whether the first user would like the virtual assistant to assist the first user with the second task; and

receive an input indicating that the first user would like the virtual assistant to assist the first user with the second task.

12. The client device of claim 8, wherein the instructions further cause the computer processor to:

transmit, to a second client device and as part of the communication session, a notification message indicating that the virtual assistant is being utilized in relation to the communication session, wherein the second client device is associated with the second user.

13. The client device of claim 8, wherein the first task is performing a financial transaction between the first user and at least the second user.

14. The client device of claim 13, wherein the instructions further cause the computer processor to:

identify, by the virtual assistant of the client device, a set of financial applications installed on both the client device and a second client device that are capable of completing the financial transaction, wherein the second client device is associated with the second user;

transmit, to the second client device, a second message as part of the communication session, the second message prompting the second user to select a financial application from the set of financial applications to complete the financial transaction;

receive, from the second client device, a first reply message identifying the financial application selected from the set of financial applications selected by the second user to complete the financial transaction; and

execute the financial application.

15. A non-transitory computer-readable medium containing instructions that, when executed by a computer processor of a client device, cause the computer processor to:

receive, as part of a communication session that takes place within a text-messaging communication application between a first user operating the client device and at least a second user, a first message prepared by the first user;

determine, by a virtual assistant of the client device, based on a semantic analysis of the first message, whether the first message is directed to the virtual assistant or to the set of participant users;

determine, based on the semantic analysis of the first message, that the first message is directed to the virtual assistant and that the first message identifies a first task with which the virtual assistant can assist the first user; and

in response to determining that the first message is directed to the virtual assistant, assist the first user with the first task, wherein the first message is a text message displayed within the text-messaging communication application of the client device and the first message is not transmitted to at least the second user.

16. The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the computer processor to:

receive a second message prepared by the first user as part of the communication session;

determine, by the virtual assistant of the client device, based on a semantic analysis of the second message, whether the second message is directed to the virtual assistant or to the set of participant users;

determine, by the virtual assistant of the client device, based on the semantic analysis of the second message, that the second message is directed to at least the second user; and

in response to determining that the second message is directed to at least the second user, transmit the second message to at least the second user as part of the communication session.

17. The non-transitory computer-readable medium of claim 16, wherein the instructions further cause the computer processor to:

identify, by the virtual assistant of the client device, based on the semantic analysis of the second message, a second task with which the virtual assistant can assist the first user; and

in response to identifying the second task, assist, by the virtual assistant of the client device, the first user with the second task.

18. The non-transitory computer-readable medium of claim 17, wherein the instructions further cause the computer processor to:

present, on the client device and as part of the communication session, a request message asking the first user whether the first user would like the virtual assistant to assist the first user with the second task; and

receive an input indicating that the first user would like the virtual assistant to assist the first user with the second task.

19. The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the computer processor to:

transmit, to a second client device and as part of the communication session, a notification message indicating that the virtual assistant is being utilized in relation to the communication session, wherein the second client device is associated with the second user.

20. The non-transitory computer-readable medium of claim 15, wherein the first task is scheduling a meeting including the first user and at least the second user.

21. The non-transitory computer-readable medium of claim 20, wherein the instructions further cause the computer processor to:

identify, based on calendar data for the first user and at least the second user, a set of candidate times for the meeting;

place a temporary hold on the set of candidate times, wherein the set of candidate times appear booked in calendars of the first user and at least the second user while the temporary hold is in place;

present the first user and at least the second user with a poll to select from the set of candidate times, the poll presented as part of the communication session; and

schedule the meeting during one of the candidate times based on response data received from the first user and at least the second user to the poll.