Individual adjustment of audio and video properties in network conferencing

• US 9,060,094 B2
• Filed: 05/30/2008
• Issued: 06/16/2015
• Est. Priority Date: 09/30/2007
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Optical Fusion Inc.
• Inventors: Thapa, Mukund
• Primary Examiner(s): MCCORD, PAUL C
• Application Number:
  US12/130,998
• Publication Number:
  US 20090086013A1
• Time in Patent Office: 2,573 Days
• Field of Search: 700/94
• US Class Current: 1/1
• CPC Class Codes: H04L 65/1089 by adding media; by removing media
• CPC Class Codes: H04L 65/1093 by adding participants; by removing participants
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/4046 with distributed floor control
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04M 3/562 where the conference facilities are distributed
• CPC Class Codes: H04M 3/564 whereby the feature is a sub-conference
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/155 involving storage of or access to video conference sessions tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831

Abstract

Individual adjustment of audio volume and video properties in a computer network conference environment is provided. For audio adjustment, a buffer collects incoming streams; a stream decoder decodes the buffered audio streams, a gain adjustment applies a gain increase or decrease to the individual audio stream, and a mixer combines each of the individual signals together. The gain adjustment module receives input from a user interface control associated with each participant, and adjusts the volume of that participant'"'"'s stream accordingly. If a requested increase in gain would cause an overflow of the signal, only a gain increase that will avoid such overflow is applied. Video properties such as brightness, contrast and saturation are also adjustable. Properties of the user'"'"'s transmitted audio and video streams are also adjustable.

Claims

1. A computer-implemented method for conducting a videoconference between at least three participants, the method comprising:

receiving, at a client of a third participant, a first audio stream from a first participant, the first audio stream having a first gain;

determining a number of clipping events in an interval with which the first audio stream overflows;

responsive to the number of clipping events in an interval exceeding a threshold level, automatically decreasing the first gain by a first modified multiplier, the first modified multiplier chosen to prevent the first audio stream from overflowing with a number of clipping events in an interval exceeding the threshold level;

receiving, at the client of the third participant, a second audio stream from a second participant, the second audio stream having a second gain adjusted by a second modified multiplier so that the second gain does not exceed an upper gain limit that is less than the first gain;

the third participant adjusting, at the client, the first gain independent of the second gain; and

the third participant playing the received first and second audio streams, the first audio stream played at the independently adjusted first gain, and the second audio stream played at the second gain.

2. The method of claim 1 further comprising the third participant adjusting the second gain independent of the first gain and playing the second audio stream at the adjusted second gain.

3. The method of claim 1 wherein the first gain is adjusted via a user interface of a videoconference client application.

4. The method of claim 1 further comprising:

the third participant transmitting a third audio stream; and

the third participant adjusting a gain of the third audio stream independent of the first gain and the second gain, the gain of the third audio stream not exceeding the upper gain limit.

5. A computer-implemented method for conducting a videoconference between at least three participants, the method comprising:

receiving, at a client of a third participant, a first audio stream from a first participant, the first audio stream having a first gain;

determining a number of clipping events in an interval with which the first audio stream overflows;

responsive to the number of clipping events in an interval exceeding a threshold level, automatically decreasing the first gain by a first modified multiplier, the first modified multiplier chosen to prevent the first audio stream from overflowing with a number of clipping events in an interval exceeding the threshold level;

receiving, at the client of the third participant, a second audio stream from a second participant, the second audio stream having a second gain adjusted by a second modified multiplier so that the second gain does not exceed an upper gain limit that is less than the first gain;

receiving, from the third participant, an instruction to adjust the first gain by a multiplier;

adjusting, at the client, the first gain by the multiplier to produce an adjusted first audio stream;

mixing, at the client, the adjusted first audio stream and the second audio stream; and

outputting the mixed streams.

6. The method of claim 5 wherein the instructed adjustment is a decrease in gain.

7. The method of claim 5 further comprising:

determining that the instructed adjustment by the multiplier would cause the first audio stream to overflow; and

automatically adjusting the first gain by a modified multiplier, the modified multiplier chosen to prevent the first audio stream from overflowing.

8. The method of claim 5 wherein the received instruction is an instruction to automatically adjust the first gain to provide audio output at a volume equal to a volume associated with the gain of the second stream.

9. A system for conducting a videoconference between at least three participants, comprising:

a client for each participant, each client comprising;

a stream decoder, adapted to receive a first audio stream from a first participant and a second audio stream from a second participant, the first audio stream having a first gain and the second audio stream having a second gain with an upper gain limit less than the first gain;

a gain adjustment module, coupled to the stream decoder, adapted to;

determine a number of clipping events in an interval with which the first audio stream overflows;

responsive to the number of clipping events in an interval exceeding a threshold level, automatically decreasing the first gain by a first modified multiplier, the first modified multiplier chosen to prevent the first audio stream from overflowing with a number of clipping events in an interval exceeding the threshold level, and automatically decreasing the upper gain limit corresponding to the decreased first gain and adjusting the second gain by a second modified multiplier so that the second gain is less than the first gain;

receive an instruction from the participant to adjust the first gain by a multiplier; and

adjust the first gain by the multiplier to produce an adjusted first audio stream; and

a mixer, coupled to the gain adjustment module, adapted to mix the adjusted first audio stream and the second audio stream.

10. The system of claim 9 wherein at least one client further comprises a sound card, coupled to the mixer, adapted to receive and output the mixed audio streams.