Integration of audio conference bridge with video multipoint control unit

• US 8,149,261 B2
• Filed: 01/10/2007
• Issued: 04/03/2012
• Est. Priority Date: 01/10/2007
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Sarkar, Shantanu, Baird, Randall B., Taylor, Stuart Asbury
• Primary Examiner(s): WOO, STELLA L
• Application Number:
  US11/652,433
• Publication Number:
  US 20080165245A1
• Time in Patent Office: 1,910 Days
• Field of Search: 348/14.09, 348/14.08
• US Class Current: 348/14.09
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/4053 without floor control
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04M 3/569 using the instant speaker's algorithm speech detection per se G10L25/78
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

In one embodiment, a system includes a video multipoint control unit (MCU) and an audio conferencing bridge, the audio conferencing bridge being operable to receive audio streams from audio-only and video endpoints, and to negotiate video sessions between each of the video endpoints and the video MCU. In response to detecting when one of the video endpoints is an active speaker, the audio conferencing bridge transmitting a dummy audio stream over a dummy audio channel from the audio conferencing bridge to the video MCU. The dummy audio stream causes the video MCU to switch an image in a video output stream. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure.

Claims

1. A method comprising:

detecting, by an audio conferencing bridge, an attempt by an endpoint to establish a plurality of multimedia sessions;

negotiating a dummy session between the audio bridge and the video MCU, the dummy session for indicating to the video MCU when the endpoint is an active speaker in a conference session; and

sending a generic audio clip to the video MCU in response to the endpoint becoming the active speaker.

2. The method of claim 1 wherein the endpoint is operable to send and receive a video session.

3. The method of claim 1 further comprising negotiating, by the audio conferencing bridge, a video session between the endpoint and the video MCU.

4. The method of claim 1 further comprising establishing an audio session between the endpoint and the audio conferencing bridge.

5. The method of claim 1 wherein the generic audio clip comprises audible speech.

6. The method of claim 1 further comprising halting the sending of the generic audio clip to the video MCU when the endpoint is no longer the active speaker.

7. The method of claim 1 wherein the generic audio clip comprises a plurality of packets, and further comprising attaching an RTP header that includes a sequence number and a timestamp to each packet of the generic audio clip.

8. The method of claim 1 wherein the active speaker comprises one of a plurality of loudest speakers in the conference session.

9. A method comprising:

receiving audio media streams from a plurality of endpoints participating in a conference session, the endpoints including audio-only endpoints and video endpoints;

receiving control signals from the plurality of endpoints;

establishing a video media channel between each of the video endpoints and a video multipoint control unit (MCU);

detecting that a first video endpoint is an active speaker in the conference session;

sending a pre-recorded audio clip to the video MCU over an audio channel associated with the first video endpoint, the video MCU sending an image of a user of the first video endpoint to one or more of the video endpoints in response to the pre-recorded audio clip.

10. The method of claim 9 wherein the pre-recorded audio clip comprises audible speech.

11. The method of claim 9 further comprising:

detecting that the first video endpoint is no longer the active speaker; and

halting the sending of the pre-recorded audio clip to the video MCU.

12. The method of claim 9 wherein the pre-recorded audio clip comprises a plurality of packets, and further comprising attaching an RTP header that includes a sequence number and a timestamp to each packet of the pre-recorded audio clip.

13. The method of claim 9 wherein the control signals comprise dual tone, multi-frequency (DTMF) commands.

14. The method of claim 9 further comprising mixing the audio media streams to produce one or more mixed audio output streams.

15. The method of claim 14 further comprising delaying the one or more mixed audio output streams.

16. The method of claim 15 further comprising computing a half round-trip delay over the audio channel, the one or more mixed audio output streams being delayed in correspondence with the half round-trip delay plus an additional delay corresponding to a mixing delay between the audio conferencing bridge and the video MCU.

17. A computer readable memory encoded with a non-transitory computer program product, when executed the non-transitory computer program product being operable to:

detect when a first video endpoint becomes an active speaker in a conference session among one or more audio-only endpoints and a plurality of video endpoints which includes the first video endpoint;

send a dummy audio stream to a video bridge via an audio channel that corresponds to the first video endpoint, the dummy audio stream including generic audio that causes the video bridge to include an image received from the first video endpoint in an output video stream;

detect when the first video endpoint is no longer the active speaker; and

halt the sending of the dummy audio stream.

18. The computer readable memory of claim 17 wherein the non-transitory computer program product, when executed, is further operable to:

receive audio streams from the one or more audio-only endpoints and the video endpoints; and

mix the audio streams into one or more output audio streams.

19. The computer readable memory of claim 17 wherein the non-transitory computer program product, when executed, is further operable to:

receive first command signals from the one or more audio-only endpoints and second command signals from the video endpoints, the first and second command signals being in a first format;

translate the second command signals into a second format compatible with the video bridge; and

send the second command signals in the second format to the video bridge.

20. The computer readable memory of claim 19 wherein the first and second command signals comprise dual tone, multi-frequency (DTMF) keypad sequences.

21. The computer readable memory of claim 17 wherein the non-transitory computer program product, when executed, is further operable to delay the one or more mixed audio output streams.

22. A method comprising:

detecting, by an audio conferencing bridge, an attempt by an audio/video (A/V) endpoint to establish a video session;

negotiating, by the audio conferencing bridge, a session between the A/V endpoint and a video multipoint control unit (MCU);

negotiating a dummy session between the audio bridge and the video MCU, the dummy session for indicating to the video MCU when the A/V endpoint is an active speaker in a conference session; and

sending a generic audio clip to the video MCU in response to the A/V endpoint becoming the active speaker.

23. The method of claim 22 further comprising establishing an audio session between the A/V endpoint and the audio conferencing bridge.

24. The method of claim 22 wherein the generic audio dip comprises audible speech.

25. The method of claim 22 further comprising halting the sending of the generic audio clip to the video MCU when the A/V endpoint is no longer the active speaker.