SENTIMENT ANALYSIS IN A VIDEO CONFERENCE

• US 20160042226A1
• Filed: 12/15/2014
• Published: 02/11/2016
• Est. Priority Date: 08/08/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cunico, Hernan A., Silva, Asima
• Granted Patent: US 9,646,198 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06N 5/022 Knowledge engineering; Knowledge acquisition
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: H04L 65/1066 Session management
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

In an approach to determine a sentiment of an attendee of a video conference, the computer receives a video of an attendee of a video conference and, then, determines, based, at least in part, on the video of the attendee, a first sentiment of the attendee. Furthermore, in the approach the computer receives an indication of an attendee activity on a first application and determines, based, in part, on the attendee activity whether the first sentiment of the attendee is related to the video conference.

Claims

1. A method for determining a sentiment of an attendee of a video conference, the method comprising:

receiving, by one or more computing devices, a video of an attendee of a video conference;

determining, by one or more computing devices, based, at least in part, on the video of the attendee, a first sentiment of the attendee;

receiving, by one or more computing devices, an indication of an attendee activity on a first application; and

determining, by one or more computing devices, based, in part, on the attendee activity whether the first sentiment of the attendee is related to the video conference.

2. The method of claim 1, wherein the indication of attendee activity includes receiving, by one or more computing devices, one or more of:

data including activity within at least the first application and at least one input to a user interface during the video conference.

3. The method of claim 1 further comprising, displaying, by one or more computing devices, the first sentiment of the attendee in the video conference.

4. The method of claim 3 wherein, displaying, by one or more computing devices, includes at least one or more of displaying to a moderator and displaying to one or more additional video conference attendees.

5. The method of claim 1, wherein determining, by one or more computing devices, based, at least in part, on the video of the attendee, the first sentiment of the attendee further comprises using at least one of a facial recognition technique, a natural language processing technique, and a sentiment analysis technique.

6. The method of claim 1 wherein, determining, by one or more computing devices, based, at least in part, on the video of the attendee, a first sentiment of the attendee, further comprises:

compiling, by one or more computing devices, a first sentiment of a plurality of attendees of the video conference to determine a first aggregate sentiment of the plurality of attendees for the video conference, and

displaying, by one or more computing devices, the first aggregated sentiment in the video conference.

7. The method of claim 1, further comprising:

monitoring, by one or more computing devices, the video of the attendee;

determining, by one or more computer devices, whether the sentiment of the attendee has changed; and

responsive to determining the sentiment of the attendee has changed, determining, by one or more computing devices, a second sentiment of the attendee.

8. The method of claim 1, wherein determining, by one or more computing devices, the first sentiment of the attendee further comprises:

retrieving, by one or more computing devices, historical sentiment data of the attendee;

determining, by one or more computing devices, based, at least in part, on the historical sentiment data of the attendee, one or more characteristic facial expressions of the attendee; and

comparing, by one or more computing devices, the one or more characteristic facial expressions with the video of the attendee.

9. A computer program product for determining a sentiment of an attendee of a video conference, the computer program product comprising:

one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions executable by a processor, the program instructions comprising;

program instructions to receive a video of an attendee of a video conference;

program instructions to determine, based, at least in part, on the video of the attendee, a first sentiment of the attendee;

program instructions to receive an indication of an attendee activity on a first application; and

program instructions to determine, based, in part, on the attendee activity whether the first sentiment of the attendee is related to the video conference.

10. The computer program product of claim 9, wherein the program instructions to receive an indication of attendee activity include program instructions to receive one or more of:

data including activity within at least the first application and at least one input to a user interface during the video conference.

11. The computer program product of claim 9, further comprising program instructions to display the first sentiment of the attendee in the video conference.

12. The computer program product of claim 9, wherein the program instructions to determine, based, at least in part, on the video of the attendee, the first sentiment of the attendee further comprises using at least one of a facial recognition technique, a natural language processing technique, and a sentiment analysis technique.

13. The computer program product of claim 9, wherein the program instructions to determine, based, at least in part, on the video of the attendee, a first sentiment of the attendee, further comprises:

program instructions to compile a first sentiment of a plurality of attendees of the video conference to determine a first aggregate sentiment of the plurality of attendees for the video conference, and

program instructions to display the first aggregated sentiment in the video conference.

14. The computer program product of claim 9, further comprising:

program instructions to monitor the video of the attendee;

program instructions to determine whether the sentiment of the attendee has changed; and

responsive to determining the sentiment of the attendee has changed, program instructions to determine a second sentiment of the attendee.

15. The computer program product of claim 9, wherein the program instructions to determine the first sentiment of the attendee further comprises:

program instructions to retrieve historical sentiment data of the attendee;

program instructions to determine, at least in part, on the historical sentiment data of the attendee, one or more characteristic facial expressions of the attendee; and

program instructions to compare the one or more characteristic facial expressions with the video of the attendee.

16. A computer system for determining a sentiment of an attendee of a video conference, the computer system comprising:

one or more computer processors;

one or more computer readable storage media;

program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising;

program instructions to receive a video of an attendee of a video conference;

program instructions to determine, based, at least in part, on the video of the attendee, a first sentiment of the attendee;

program instructions to receive an indication of an attendee activity on a first application; and

program instructions to determine, based, in part, on the attendee activity whether the first sentiment of the attendee is related to the video conference.

17. The computer system of claim 16, wherein the program instructions to determine the indication of attendee activity include program instructions to receive one or more of:

data including activity within at least the first application and at least one input to a user interface during the video conference.

18. The computer system of claim 16, wherein the program instructions to determine, based, at least in part, on the video of the attendee, the first sentiment of the attendee further comprises using at least one of a facial recognition technique, a natural language processing technique, and a sentiment analysis technique.

19. The computer system of claim 16, further comprising:

program instructions to monitor the video of the attendee;

program instructions to determine whether the sentiment of the attendee has changed; and

responsive to determining the sentiment of the attendee has changed, program instructions to determine a second sentiment of the attendee.

20. The computer system of claim 16, wherein the program instructions to determine the first sentiment of the attendee further comprises:

program instructions to retrieve historical sentiment data of the attendee;

program instructions to determine, at least in part, on the historical sentiment data of the attendee, one or more characteristic facial expressions of the attendee; and

program instructions to compare the one or more characteristic facial expressions with the video of the attendee.