Control unit for multipoint multimedia/audio conference

• US 7,054,820 B2
• Filed: 02/06/2002
• Issued: 05/30/2006
• Est. Priority Date: 02/06/2001
• Status: Active Grant

• Current Assignee: Polycom Israel Limited (Plantronics, Inc.)
• Original Assignee: Polycom Israel Limited (Plantronics, Inc.)
• Inventors: Elbaz, Moshe, Potekhin, Sergey, Knaz, Eran, Carmi, Moshe
• Primary Examiner(s): Azad, Abul K.
• Application Number:
  US10/072,081
• Publication Number:
  US 20020123895A1
• Time in Patent Office: 1,574 Days
• Field of Search: 704/270, 704/270.1, 704/275, 704/500, 704/503, 379/202.01, 379/205, 381/119
• US Class Current: 704/275
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04M 3/562 where the conference facilities are distributed
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30

Abstract

A multipoint controller unit in which the audio signal processing is distributed among several audio ports. The control of the audio signal processing may be centrally or distributively managed by one or more audio controllers. The audio signal processing may include selecting audio streams from a common interface and/or mixing the signals from the common interface. Each audio port may enhance the audio signal and generate control information from the audio signal. The audio ports are synchronized by a common information channel while the audio controllers are synchronized by a common control channel interface. Port fragmentation is reduced since the audio signal processing that relates to an endpoint within a conference is handled by a single audio port.

Claims

1. A system, comprising:

a plurality of audio ports between which audio signal processing of a conference is distributed, wherein each audio port is assigned to one of a plurality of endpoints and each audio port processes input audio signals from its assigned endpoint and processes output audio signals to be sent to its assigned endpoint; and

one or more audio controllers, wherein the one or more audio controllers receive control information from each of the audio ports as derived from the processed input audio signals and provide control instructions to each of the audio ports to control processing of the output audio signals, wherein the audio controller does not otherwise receive or process the audio signals.

2. The system of claim 1, wherein the processing of output audio signals includes mixing of at least one audio signal.

3. The system of claim 2, further comprising a switch that selects which audio signals will be mixed, and that is controlled by the one or more audio controllers.

4. The system of claim 1, wherein the processing of input audio signals includes analyzing the input audio signals to derive the control information.

5. The system of claim 1, wherein the processing of input audio signals includes enhancing the input audio signals.

6. The system of claim 1, wherein the one or more audio controllers are centralized and distinct from the plurality of audio ports.

7. The system of claim 1, wherein processing of output audio signals includes use of an encoder encoding the output audio signals.

8. The system of claim 7, further comprising a common interface that receives output from the encoder.

9. The system of claim 1, wherein the audio ports further comprise control buffers for storing the control information and the control instructions.

10. The system of claim 1, further comprising a control channel interface for broadcasting the control instructions from the one or more audio controllers to the audio ports.

11. The system of claim 1, further comprising an information channel for broadcasting the control information from the audio ports to the one or more audio controllers.

12. The system of claim 1, wherein the processing of input audio signals includes use of an analyze and enhance unit, wherein the analyze and enhance unit produces the control information.

13. The system of claim 1, wherein the processing of input audio signals includes decoding the input audio signals.

14. The system of claim 1, further comprising an interface common to the audio ports for carrying compressed input audio signals to audio ports.

15. The system of claim 14, wherein the common interface further carries the output audio signals to the endpoints.

16. A system, comprising:

a plurality of audio ports between which audio signal processing of a conference is distributed, wherein each of the plurality of audio ports is assigned to one of a plurality of endpoints, and each audio port processes input audio signals from its assigned endpoint and processes output audio signals to be sent to its assigned endpoint, each of the plurality of audio ports comprising

a decoder for decoding a compressed audio signal,

an analyzer for deriving control information from the decoded audio signal,

a mixer for mixing audio signals from other audio ports, and

an encoder that encodes the audio signal mixed by the mixer,

an information channel for receiving the control information from the audio ports;

one or more audio controllers for receiving the control information from the information channel and for deriving mixing control instructions;

a control channel for sending the mixing control instructions to the mixers; and

a system interface for sharing the decoded audio signals between the audio ports.

17. The system of claim 16, further comprising a common interface coupled to the audio ports, the common interface for carrying the compressed audio signals to the decoder and for receiving the encoded audio signals from the encoders.

18. The system of claim 16, further comprising:

a system format encoder between the analyzer and the system interface, wherein the system format encoder encodes the decoded audio signal with a system format; and

a system format decoder between the system interface and the mixer, wherein the system format decoder removes the system formatting.

19. The system of claim 16, wherein the analyzer also enhances the decoded audio signal.

20. A control unit for facilitating multipoint communication between a plurality of endpoints, comprising:

a plurality of audio ports each assigned to one of the plurality of endpoints, wherein each audio port processes input audio signals from its assigned endpoint and processes output audio signals to be sent to its assigned endpoint, and each audio port is capable of;

decoding compressed audio signals from its associated endpoint,

broadcasting the decoded audio signal from its associated endpoint to others of the plurality of audio ports,

mixing received broadcasted decoded audio signals from others of the plurality of audio ports, and

compressing the mixed audio signals for output to its associated endpoint; and

at least one audio controller for receiving control information from each of the audio ports derived from the decoded input audio signals and for providing control instructions to each of the audio ports to select which of the broadcasted received decoded audio signals are to be mixed, wherein the audio controller does not otherwise receive the input audio signals.

21. The control unit of claim 20, wherein the audio ports are further capable of enhancing the decoded audio signal.

22. The control unit of claim 20, wherein the audio port further comprises:

a system format encoder for encoding the decoded audio signal with a system format prior to broadcasting; and

a system format decoder, wherein the system format decoder removes the system format from the broadcasted received decoded audio signals prior to mixing.

23. The control unit of claim 20, wherein there is only one audio controller.

24. A control unit for facilitating multipoint communication between a plurality of endpoints, each endpoint being operative to send a compressed input audio signal to the control unit and receive a compressed output signal from the control unit, the control unit comprising:

a plurality of audio modules, each audio module receiving compressed input audio signals from at least one endpoint and sending compressed output audio signals to at least one endpoint, each audio module including

at least one audio port, each audio port being assigned to an endpoint within a conference and being operative to handle audio signal processing including decoding of the input audio signal of its assigned endpoint and mixing of the output audio signal to be sent to its assigned endpoint;

at least one audio controller for receiving control information from each of the plurality of audio ports as derived from the decoded input audio signals and providing to each of the plurality of audio ports control instructions for controlling the mixing; and

an interface to route the decoded input audio signals between audio modules without passing through the audio controller, wherein the audio controller does not otherwise receive the input audio signals.

25. The control unit of claim 24, wherein the audio port comprises:

a decoder for decoding the compressed input audio signal of its endpoint;

an analyzer for assessing the decoded input audio signal and sending the decoded audio signal to the interface;

a switch that selects from the interface decoded audio signals from a subset of the audio ports;

a mixer that mixes the selected decoded audio signals; and

an encoder that encodes an output signal of the mixer to form the output audio signal to be sent to its endpoint.

26. The control unit of claim 25, wherein the analyzer further enhances the decoded audio signal.

27. The control unit of claim 25, wherein the audio port further comprises:

a system format encoder between the analyzer and the interface, wherein the system format encoder encodes the decoded audio signal with a system format; and

a system format decoder between the interface and the mixer, wherein the system format decoder removes the system format from the selected decoded audio signals prior to arrival at the mixer.

28. The control unit of claim 24, wherein there is only one audio controller.

29. A method for distributed audio signal processing of a conference between a plurality of audio ports, comprising:

receiving an audio signal from an endpoint at each of the plurality of audio ports, wherein each of the audio ports is assigned to one of plurality of endpoints, and each audio port processes input audio signals from its assigned endpoint and processes output audio signals to be sent to its assigned endpoint;

analyzing the audio signal at each audio port to generate control information;

broadcasting the audio signals to the plurality of audio ports;

broadcasting the control information from the audio parts to one or more audio controllers; and

mixing at each audio port a subset of the broadcasted audio signals in accordance with control instructions from the one or more audio controllers as governed by the control information.

30. The method of claim 29, wherein only one audio controller is used.

31. The method of claim 29, further comprising encoding the mixed audio signals at each audio port.

32. The method of claim 29, further comprising decoding the received audio signals at each audio port.

33. The method of claim 32, wherein decoding proceeds the analysis of the audio signal.

34. The method of claim 29, wherein the received audio signals and mixed audio signals share an interface common to the audio ports.

35. The method of claim 29, wherein broadcasting the audio signals to the plurality of audio ports comprises broadcasting to an interface common to all of the audio ports.

36. A method, comprising:

receiving a compressed audio signal from an endpoint at each of a plurality of audio ports, wherein each of the audio ports is assigned to one of a plurality of endpoints, and each audio port processes input audio signals from its assigned endpoint and processes output audio signals to be sent to its assigned endpoint;

decoding the compressed audio signal at each audio port;

analyzing the decoded audio signal and generating control information;

broadcasting the decoded audio signals to the plurality of audio ports;

broadcasting the control information from the audio ports to one or more audio controllers;

mixing at each audio port a subset of the broadcasted decoded audio signals in accordance with control instructions from the one or more audio controllers as governed by the control information; and

encoding output of the mixing at each audio port for distribution to at least one endpoint.

37. The method of claim 36, further comprising enhancing the decoded audio signal prior to broadcasting to the plurality of audio ports.