VIRTUAL ASSISTANT IN A COMMUNICATION SESSION

• US 20160335532A1
• Filed: 05/15/2015
• Published: 11/17/2016
• Est. Priority Date: 05/15/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Schwerdtfeger, Jeffrey P., Sanghavi, Mehul K.
• Granted Patent: US 10,460,227 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06F 40/35 Discourse or dialogue representation
• CPC Class Codes: G06N 3/006 based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04L 51/02 using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 51/212 using filtering or selective blocking

Abstract

Disclosed are systems, methods, and non-transitory computer-readable storage media for utilizing a virtual assistant as part of a communication session. One or more of the participant users can select to utilize a virtual assistant to assist the participant users with tasks during the communication session. A user can use a communication application to enter a message directed to the virtual assistant. The virtual assistant can analyze the entered message and determine that the message was directed to the virtual assistant rather than to the other participants of the communication session. As a result, the message will not be transmitted to the other participants of the communication session and the virtual assistant will assist the user with the identified task. A virtual assistant can assist a user with a variety of different tasks.

Claims

1. A method comprising:

receiving, by a first client device, a first input indicating that a first user operating the first client device would like to utilize a virtual assistant in relation to a communication session between the first user and a set of participant users, wherein the virtual assistant utilizes semantic analysis to identify tasks with which the virtual assistant can assist the first user;

receiving, by the first client device, a first message prepared by the first user as part of the communication session;

determining, by the first client device, based on a semantic analysis of the first message, that the first message is directed to the virtual assistant and that the first message identifies a first task with which the virtual assistant can assist the first user; and

in response to determining that the first message is directed to the virtual assistant, assisting the first user with the first task, wherein the first message is not transmitted to the set of participant users.

2. The method of claim 1, further comprising:

receiving a second message prepared by the first user as part of the communication session;

determining, based on a semantic analysis of the second message, that the second message is directed to the set of participant users; and

in response to determining that the second message is directed to the set of participant users, transmitting the second message to the set of participant users as part of the communication session.

3. The method of claim 2, further comprising:

identifying, based on the semantic analysis of the second message, a second task with which the personal assistant can assist the first user; and

in response to identifying the second task, assisting the first user with the second task.

4. The method of claim 3, further comprising:

presenting, on the first client device and as part of the communication session, a request message asking the first user whether the first user would like the virtual assistant to assist the first user with the second task; and

receiving a second input indicating that the first user would like the virtual assistant to assist the first user with the second task.

5. The method of claim 1, further comprising:

transmitting, to a second client device and as part of the communication session, a notification message indicating that the virtual assistant is being utilized in relation to the communication session, wherein the second client device is associated with a second user of the set of participant users.

6. The method of claim 1, wherein the first task is performing a financial transaction between the first user and at least a second user from the set of participant users.

7. The method of claim 6, further comprising:

identifying a set of financial applications installed on both the first client device and a second client device that are capable of completing the financial transaction, wherein the second client device is associated with the second user of the set of participants;

transmitting, to the second client device, a second message as part of the communication session, the second message prompting the second human user to select a financial application from the set of financial applications to complete the financial transaction;

receiving, from the second client device, a first reply message identifying the financial application selected from the set of financial applications selected by the second user to complete the financial transaction; and

executing the financial application.

8. A client device comprising:

a computer processor; and

a memory containing instructions that, when executed, cause the computer processor to;

receive a first input indicating that a first user operating the client device would like to utilize a virtual assistant in relation to a communication session between the first user and a set of participant users, wherein the virtual assistant utilizes semantic analysis to identify tasks with which the virtual assistant can assist the first user;

receive a first message prepared by the first user as part of the communication session;

determine, based on a semantic analysis of the first message, that the first message is directed to the virtual assistant and that the first message identifies a first task with which the virtual assistant can assist the first user; and

in response to determining that the first message is directed to the virtual assistant, assisting the first user with the first task, wherein the first message is not transmitted to the set of participant users.

9. The client device of claim 8, wherein the instructions further cause the computer processor to:

receive a second message prepared by the first user as part of the communication session;

determine, based on a semantic analysis of the second message, that the second message is directed to the set of participant users; and

in response to determining that the second message is directed to the set of participant users, transmit the second message to the set of participant users as part of the communication session.

10. The client device of claim 9, wherein the instructions further cause the computer processor to:

identify, based on the semantic analysis of the second message, a second task with which the personal assistant can assist the first user; and

in response to identifying the second task, assist the first user with the second task.

11. The client device of claim 10, wherein the instructions further cause the computer processor to:

present, on the client device and as part of the communication session, a request message asking the first user whether the first user would like the virtual assistant to assist the first user with the second task; and

receive a second input indicating that the first user would like the virtual assistant to assist the first user with the second task.

12. The client device of claim 8, wherein the instructions further cause the computer processor to:

transmit, to a second client device and as part of the communication session, a notification message indicating that the virtual assistant is being utilized in relation to the communication session, wherein the second client device is associated with a second user of the set of participant users.

13. The client device of claim 8, wherein the first task is performing a financial transaction between the first user and at least a second user from the set of participant users.

14. The client device of claim 13, wherein the instructions further cause the computer processor to:

identify a set of financial applications installed on both the client device and a second client device that are capable of completing the financial transaction, wherein the second client device is associated with the second user of the set of participants;

transmit, to the second client device, a second message as part of the communication session, the second message prompting the second human user to select a financial application from the set of financial applications to complete the financial transaction;

receive, from the second client device, a first reply message identifying the financial application selected from the set of financial applications selected by the second user to complete the financial transaction; and

execute the financial application.

15. A non-transitory computer-readable medium containing instructions that, when executed by a computer processor of a client device, cause the computer processor to:

receive a first input indicating that a first user operating the client device would like to utilize a virtual assistant in relation to a communication session between the first user and a set of participant users, wherein the virtual assistant utilizes semantic analysis to identify tasks with which the virtual assistant can assist the first user;

receive a first message prepared by the first user as part of the communication session;

determine, based on a semantic analysis of the first message, that the first message is directed to the virtual assistant and that the first message identifies a first task with which the virtual assistant can assist the first user; and

in response to determining that the first message is directed to the virtual assistant, assisting the first user with the first task, wherein the first message is not transmitted to the set of participant users.

16. The non-transitory computer-readable medium of claim 15 wherein the instructions further cause the computer processor to:

receive a second message prepared by the first user as part of the communication session;

determine, based on a semantic analysis of the second message, that the second message is directed to the set of participant users; and

in response to determining that the second message is directed to the set of participant users, transmit the second message to the set of participant users as part of the communication session.

17. The non-transitory computer-readable medium of claim 16, wherein the instructions further cause the computer processor to:

identify, based on the semantic analysis of the second message, a second task with which the personal assistant can assist the first user; and

in response to identifying the second task, assist the first user with the second task.

18. The non-transitory computer-readable medium of claim 17, wherein the instructions further cause the computer processor to:

present, on the client device and as part of the communication session, a request message asking the first user whether the first user would like the virtual assistant to assist the first user with the second task; and

receive a second input indicating that the first user would like the virtual assistant to assist the first user with the second task.

19. The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the computer processor to:

transmit, to a second client device and as part of the communication session, a notification message indicating that the virtual assistant is being utilized in relation to the communication session, wherein the second client device is associated with a second user of the set of participant users.

20. The non-transitory computer-readable medium of claim 15, wherein the first task is performing a scheduling a meeting including the first user and at least a second user from the set of participant users.

21. The non-transitory computer-readable medium of claim 20, wherein the instructions further cause the computer processor to:

identify, based on calendar data for the first user and the at least a second user, a set of candidate times for the meeting;

place a temporary hold on the set of candidate times, wherein the set of candidate times appear booked in calendars of the first user and the at least a second user while the temporary hold is in place;

present the first user and the at least a second user with a poll to select from the set of candidate times, the poll presented as part of the communication session; and

schedule the meeting during one of the candidate times based on response data received from the first user and the at least a second user to the poll.