Synthetic stereo conferencing over LAN/WAN

• US 6,408,327 B1
• Filed: 12/22/1998
• Issued: 06/18/2002
• Est. Priority Date: 12/22/1998
• Status: Expired due to Term

• Current Assignee: Avaya Incorporated
• Original Assignee: Nortel Networks Limited (Nortel Networks Corporation)
• Inventors: McClennon, R. Scott, Robert, Andre J.
• Primary Examiner(s): WINDER, PATRICE L
• Application Number:
  US09/218,135
• Time in Patent Office: 1,274 Days
• Field of Search: 709/204, 709/205, 709/231, 370/389, 370/260, 379/93.01, 379/202, 379/206, 379/388, 381/17, 381/92, 463/42
• US Class Current: 709/204
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04M 7/006 Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42
• CPC Class Codes: H04S 1/00 Two-channel systems H04S5/00, H04S7/00 take precedence

Abstract

A method of and system for facilitating synthetic stereo audio conferencing of a plurality of users over a local or wide area network (LAN/WAN). The disclosure describes a system architecture using a LAN/WAN to support synthetic audio conferencing thus allowing, at a receiving user location, for the spatially distinct virtual “placement” of the other parties involved in a conference call. This enables the user to differentiate between the various other parties and to discern which one or more of the parties are talking at any given time. In a first embodiment of the invention, both stereo synthesis and conferencing are client-based functions. In a second embodiment of the invention, both stereo synthesis and conferencing are server-based functions. In a third embodiment of the invention, stereo synthesis is a server-based function and conferencing is a hybrid client/server function using multicast.

Claims

1. A method of synthetic stereo audio conferencing a plurality of clients over a local or wide area network (LAN/WAN), said method comprising:

receiving, at a server in said network, a plurality of signals from said plurality of clients over said network;

synthesizing and mixing said plurality of signals at said server to create at least one client-specific composite signal distributed over multiple channels to effect virtual positioning of said plurality of clients;

transmitting said at least one client-specific composite signal to one of said plurality of clients in said network; and

outputting said at least one client-specific composite signal as stereo audio over a plurality of audio output devices at said one of said plurality of clients;

wherein said at least one client-specific composite signal does not include a signal from said one of said plurality of clients.

2. A method of synthetic stereo audio conferencing a plurality of clients over a local or wide area network (LAN/WAN), as recited in claim 1, wherein said virtual positioning of each of said remainder of said plurality of clients is spatially distributed about a user of said one of said plurality of clients.

3. A method of synthetic stereo audio conferencing a plurality of clients over a local or wide area network (LAN/WAN), as recited in claim 2, wherein said composite signal is output over a left speaker and a right speaker at said one of said plurality of clients.

4. A method of synthetic stereo audio conferencing a plurality of clients over a local or wide area network (LAN/WAN), said method comprising:

receiving, at a server in said network, a plurality of signals from said plurality of clients over said network;

synthesizing and mixing said plurality of signals at said server to create a single multicast signal distributed over multiple channels to effect virtual positioning of said plurality of clients;

transmitting said single multicast signal to each of said plurality of clients in said network;

receiving said single multicast signal at one of said plurality of clients in said network;

removing, from said single multicast signal at one of said plurality of clients, a signal component corresponding to a signal transmitted from said one of said plurality of clients to create a composite signal; and

outputting said composite signal as stereo audio over a plurality of audio output devices at said one of said plurality of clients.

5. A method of synthetic stereo audio conferencing a plurality of clients over a local or wide area network (LAN/WAN), as recited in claim 4, wherein said virtual positioning of said plurality of clients, is spatially distributed about a user of said one of said plurality of clients.

6. A method of synthetic stereo audio conferencing a plurality of clients over a local or wide area network (LAN/WAN), as recited in claim 5, wherein said composite signal is output over a left speaker and a right speaker at said one of said plurality of clients.

7. A method of synthetic stereo audio conferencing a plurality of clients over a local or wide area network (LAN/WAN), as recited in claim 4, wherein said plurality of signals comprise data packets of a defined length and wherein the step of synthesizing and mixing said signals at the server comprises:

synchronizing data packets received from said plurality of clients using at least one jitter buffer;

adjusting gain for at least one of said synchronized data packets; and

synthesizing and mixing said data packets of said plurality of signals to create the single multicast signal.

8. A system for providing synthetic stereo audio conferencing, said system comprising:

a local or wide area network (LAN/WAN);

a plurality of clients connected to said network for transmitting signals to and receiving signals from said network; and

a server connected to said network for receiving a plurality of signals transmitted from said plurality of clients in said network, synthesizing and mixing said plurality of signals to create at least one client-specific composite signal distributed over multiple channels to effect virtual positioning of said plurality of clients, and transmitting said at least one client-specific signal to at least one of said plurality of clients in said network;

wherein said at least one client-specific composite signal does not include a transmit signal from said one of said plurality of clients.

9. A system for providing synthetic stereo audio conferencing, as recited in claim 8, said at least one of said plurality of clients further comprising a left speaker and a right speaker for outputting said composite signal.

10. A system for providing synthetic stereo audio conferencing, as recited in claim 9, wherein said at least one of said plurality of clients is a stereo hands-free telephone.

11. A system for providing synthetic stereo audio conferencing, as recited in claim 9, wherein said at least one of said plurality of clients is a stereo headset telephone.

12. A system for providing synthetic stereo audio conferencing, said system comprising:

a local or wide area network (LAN/WAN);

a plurality of clients connected to said network for transmitting signals to and receiving signals from said network; and

a server connected to said network for receiving a plurality of signals transmitted from said plurality of clients in said network, synthesizing and mixing said plurality of signals to create a single multicast signal distributed over multiple channels to effect virtual positioning of said plurality of clients, and transmitting said multicast signal to each of said plurality of clients in said network.

13. A system for providing synthetic stereo audio conferencing, said system comprising:

a local or wide area network (LAN/WAN);

a plurality of clients connected to said network for transmitting signals to and receiving signals from said network; and

a server connected to said network for receiving a plurality of signals transmitted from said plurality of clients in said network, synthesizing and mixing said plurality of signals to create a single multicast signal distributed over multiple channels to effect virtual positioning of said plurality of clients, and transmitting said multicast signal to each of said plurality of clients in said network;

wherein said plurality of clients receive said multicast signal transmitted from the server and wherein at least one of said plurality of clients further comprises an echo controller for removing, from said multicast signal, a signal component corresponding to a signal transmitted from said at least one of said plurality of clients, to create a composite signal.

14. A system for providing synthetic stereo audio conferencing, as recited in claim 13, said at least one of said plurality of clients further comprising a left speaker and a right speaker for outputting said composite signal.

15. A system for providing synthetic stereo audio conferencing, as recited in claim 14, wherein said at least one of said plurality of clients is a stereo hands-free telephone.

16. A system for providing synthetic stereo audio conferencing, as recited in claim 14, wherein said at least one of said plurality of clients is a stereo headset telephone.

17. A system for providing synthetic stereo audio conferencing, as recited in claim 13, wherein said plurality of signals comprise data packets of a defined length and wherein said server comprises:

at least one jitter buffer for synchronizing data packets received from said plurality of clients;

an adjustable gain controller for applying adjustable gain to at least one of said synchronized data packets; and

a synthesizer and mixer for synthesizing and mixing said data packets of said plurality of signals to create the single multicast signal for transmission to each of said plurality of clients in said network.

18. A server for providing synthetic stereo audio conferencing over a local or wide area network (LAN/WAN) to which said server and a plurality of clients are connected, said server comprising a computer readable medium having program code recorded thereon for controlling said server to perform the following steps:

receiving a plurality of signals transmitted from said plurality of clients in said network;

synthesizing and mixing said plurality of signals to create at least one client-specific composite signal distributed over multiple channels to effect virtual positioning of said plurality of clients; and

transmitting said at least one client-specific signal to at least one of said plurality of clients in said network, wherein said at least one client-specific composite signal does not include a transmit signal from said one of said plurality of clients.

19. A system for providing synthetic stereo audio conferencing over a local or wide area network (LAN/WAN), said system comprising:

a plurality of clients connected to said network for transmitting signals to and receiving signals from said network; and

a server connected to said network for receiving a plurality of signals transmitted from said plurality of clients in said network, synthesizing and mixing said plurality of signals to create a single multicast signal distributed over multiple channels to effect virtual positioning of said plurality of clients, and transmitting said multicast signal to each of said plurality of clients in said network,

wherein said plurality of clients receive said multicast signal transmitted from the server and wherein at least one of said plurality of clients further comprises an echo controller for removing, from said multicast signal, a signal component corresponding to a signal transmitted from said at least one of said plurality of clients, to create a composite signal.

20. A system for providing synthetic stereo audio conferencing, as recited in claim 19, said at least one of said plurality of clients further comprising a left speaker and a right speaker for outputting said composite signal.

21. A system for providing synthetic stereo audio conferencing, as recited in claim 20, wherein said at least one of said plurality of clients is a stereo hands-free telephone.

22. A system for providing synthetic stereo audio conferencing, as recited in claim 20, wherein said at least one of said plurality of clients is a stereo headset telephone.

23. A system for providing synthetic stereo audio conferencing, as recited in claim 19, wherein said plurality of signals comprise data packets of a defined length and wherein said server comprises:

at least one jitter buffer for synchronizing data packets received from said plurality of clients;

an adjustable gain controller for applying adjustable gain to at least one of said synchronized data packets; and

a synthesizer and mixer for synthesizing and mixing said data packets of said plurality of signals to create the single multicast signal for transmission to each of said plurality of clients in said network.