Dynamic character substitution for web conferencing based on sentiment

• US 9,685,193 B2
• Filed: 04/20/2016
• Issued: 06/20/2017
• Est. Priority Date: 06/30/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cunico, Hernan A., Silva, Asima
• Primary Examiner(s): SMITH, CREIGHTON H
• Application Number:
  US15/133,733
• Publication Number:
  US 20160232941A1
• Time in Patent Office: 426 Days
• Field of Search: None
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G10L 15/183 using context dependencies, e.g. language models
• CPC Class Codes: G10L 25/57 for processing of video signals
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/155 involving storage of or access to video conference sessions tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

In an approach to determining a pre-recorded video for use in place of a video feed of a user in a video conference, a computer determines a sentiment of the video conference and determines a first video of one or more pre-recorded videos of a user that corresponds to the sentiment. The computer displays the first video in the video conference.

Claims

1. A method for determining a pre-recorded video for use in a video conference, the method comprising:

determining, by one or more computer devices, a meeting tone of at least one meeting discussion in the video conference;

determining, by one or more computer devices, a first video of one or more pre-recorded videos of a user that corresponds to the meeting tone at least by determining a video segment from the one or more pre-recorded videos of the user that corresponds to the meeting tone; and

substituting, by one or more computer devices, the first video into the video conference in place of a video feed of the video conference.

2. The method of claim 1, further comprising receiving, by one or more computer devices, a request from the user for the one or more pre-recorded videos of the user for use in the video conference in place of the video feed in the video conference.

3. The method of claim 1, wherein the one or more pre-recorded videos of the user include at least one visual representation of an emotional state.

4. The method of claim 1, wherein determining, by one or more computer devices, the meeting tone further comprises analyzing the at least one meeting discussion in the video conference using at least one of a natural language processing and a sentiment analysis.

5. The method of claim 1, wherein determining, by one or more computer devices, the first video of the one or more pre-recorded videos of the user that corresponds to the meeting tone further comprises matching the meeting tone with the first video, based, at least in part, on a filename of the first video.

6. The method of claim 1, further comprises:

monitoring, by one or more computer devices, the at least one meeting discussion in the video conference;

determining, by one or more computer devices, whether the meeting tone of the at least one meeting discussion changed; and

responsive to determining the meeting tone of the at least one meeting discussion changed, determining, by one or more computer devices, a second video of the one or more pre-recorded videos that corresponds to the changed meeting tone.

7. The method of claim 6, further comprising:

responsive to determining the meeting tone of the at least one meeting discussion has not changed, determining, by one or more computer devices, at least one additional video that corresponds to the meeting tone;

determining, by one or more computer devices, a rotation for the second video and the at least one additional video; and

substituting, by one or more computer devices, the second video and the at least one additional video into the video conference in place of the video feed in the video conference according to the determined rotation.

8. A computer program product for determining a pre-recorded video for use in a video conference, the computer program product comprising:

one or more computer readable storage devices and program instructions stored on the one or more computer readable storage devices, the program instructions executable by a processor, the program instructions comprising;

program instructions to determine a sentiment of the video conference;

program instructions to determine a first video of one or more pre-recorded videos of a user that corresponds to the sentiment at least by determining a video segment from the one or more pre-recorded videos of the user that corresponds to the meeting tone; and

program instructions to display the first video in the video conference.

9. The computer program product of claim 8, further comprises program instructions to receive a request from the user for the one or more pre-recorded videos of the user for use in the video conference.

10. The computer program product of claim 8, wherein the one or more pre-recorded videos of the user include at least one of a visual representation of an emotional state, a sentiment, or a response by the user.

11. The computer program product of claim 8, wherein the program instructions to determine the sentiment further comprise program instructions to analyze at least one meeting discussion in the video conference using at least one of a natural language processing and a sentiment analysis.

12. The computer program product of claim 8, wherein the program instructions to determine the first video of the one or more pre-recorded videos of the user that corresponds to the sentiment further comprise program instructions to match the sentiment with the first video, based, at least in part, on a filename of the first video.

13. The computer program product of claim 8, further comprises:

program instructions to monitor at least one meeting discussion in the video conference;

program instructions to determine whether the sentiment of the at least one meeting discussion changed; and

responsive to determining the sentiment of the at least one meeting discussion changed, program instructions to determine a second video of the one or more pre-recorded videos that corresponds to the changed sentiment.

14. The computer program product of claim 13, further comprises:

responsive to determining the sentiment of the at least one meeting discussion has not changed, program instructions to determine at least one additional video that corresponds to the sentiment;

program instructions to determine a rotation for the second video and the at least one additional video; and

program instructions to display the second video and the at least one additional video in the video conference according to the determined rotation.

15. A computer system for determining a pre-recorded video for use in a video conference, the computer system comprising:

one or more computer processors;

one or more computer readable storage devices;

program instructions stored on the computer readable storage devices for execution by at least one of the one or more processors, the program instructions comprising;

program instructions to determine a sentiment of the video conference;

program instructions to determine a first video of one or more pre-recorded videos of a user that corresponds to the sentiment at least by determining a video segment from the one or more pre-recorded videos of the user that corresponds to the meeting tone; and

program instructions to display the first video in the video conference.

16. The computer system of claim 15, wherein the one or more pre-recorded videos of the user include at least one of a visual representation of an emotional state, a sentiment, or a response by the user.

17. The computer system of claim 15, further comprising:

program instructions to monitor at least one meeting discussion in the video conference;

program instructions to determine whether the sentiment of the at least one meeting discussion changed; and

responsive to determining the sentiment of the at least one meeting discussion changed, program instructions to determine a second video of the one or more pre-recorded videos that corresponds to the changed sentiment.