Interest determination for auditory enhancement
First Claim
Patent Images
1. Computer readable storage media having computer readable program code embodied therein, the computer-readable program code adapted to be executed to implement a method comprising:
- connecting a computing device of a user to a plurality of participants participating in a video conference;
displaying video images of the plurality of participants on a graphic user interface on a display of the computing device of the user;
receiving user interest information determined by tracking a gaze of the user viewing the display to determine a video image of a particular participant of the plurality of participants that eyes of the user are focused on;
receiving participant interest information from the plurality of participants indicating which participants each of the plurality of participants are looking at;
determining from the user interest information and the participant interest information a subset of one or more participants of the plurality of participants for inclusion in a conversation group with the user, the conversation group comprising the subset of participants determined to be participating in or listening to a particular conversation of multiple conversations;
displaying a panoramic view of a table including the interest information and personal information for each of the plurality of participants on the display of the computing device of the user; and
increasing audio gain for audio received from the subset of participants included in the conversation group with the user for providing the audio with increased audio gain to the user.
2 Assignments
0 Petitions
Accused Products
Abstract
Gaze tracking or other interest indications are used during a video conference to determine one or more audio sources that are of interest to one or more participants to the video conference, such as by determining a conversation from among multiple conversations that a subset of participants are participating in or listening to, for enhancing the audio experience of one or more of the participants.
-
Citations
19 Claims
-
1. Computer readable storage media having computer readable program code embodied therein, the computer-readable program code adapted to be executed to implement a method comprising:
-
connecting a computing device of a user to a plurality of participants participating in a video conference; displaying video images of the plurality of participants on a graphic user interface on a display of the computing device of the user; receiving user interest information determined by tracking a gaze of the user viewing the display to determine a video image of a particular participant of the plurality of participants that eyes of the user are focused on; receiving participant interest information from the plurality of participants indicating which participants each of the plurality of participants are looking at; determining from the user interest information and the participant interest information a subset of one or more participants of the plurality of participants for inclusion in a conversation group with the user, the conversation group comprising the subset of participants determined to be participating in or listening to a particular conversation of multiple conversations; displaying a panoramic view of a table including the interest information and personal information for each of the plurality of participants on the display of the computing device of the user; and increasing audio gain for audio received from the subset of participants included in the conversation group with the user for providing the audio with increased audio gain to the user. - View Dependent Claims (2, 3)
-
-
4. A method implemented by a user computing device having one or more processors executing instructions stored in computer-readable media, the method comprising:
-
displaying video images of a plurality of participants on a graphic user interface on a display, wherein the plurality of participants are displayed in a panorama view of the plurality of participants present at an actual conference table in an environment having multiple microphones present for the plurality of participants; determining, for a first participant to a video conference, one or more second participants to a conversation of interest to the first participant from among the plurality of participants to the video conference by tracking a gaze of the first participant viewing the display to determine that eyes of the first participant are focused on a video image corresponding to one of the one or more second participants to a conversation of primary interest; and augmenting audio received by the first participant from the one or more second participants to the conversation of interest to the first participant to increase audibility of the audio received from the one or more second participants relative to audio received from the other participants of the plurality of participants of the video conference by increasing a gain on one or more microphones closest to the one or more second participants out of the multiple microphones. - View Dependent Claims (5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A computing device comprising:
-
a communication interface; a display; and one or more processors coupled to computer readable storage media storing instructions adapted to be executed by the one or more processors for configuring the computing device to; connect, via the communication interface, to a plurality of participants for participating in a video conference; display video images of the plurality of participants on a graphic user interface on the display; receive user interest information identifying a particular participant as being of interest; distinguish and highlight the particular participant of interest on the display; and in response to the particular participant remaining of interest for more than a predetermined threshold period of time, augmenting audio received from the particular participant identified as being of interest. - View Dependent Claims (16, 17, 18, 19)
-
Specification