Video and audio conferencing system with spatial audio
First Claim
1. A system, comprising:
- a first plurality of microphones;
a second plurality of microphones for producing an audio signal of a participant; and
a computing system coupled to the first and second plurality of microphones, wherein the computing system is configured to;
beamform a response of the first plurality of microphones to determine directional information for the audio signal relative to the first plurality of microphones;
beamform a response of the second plurality of microphones to determine directional information for the audio signal relative to the second plurality of microphones;
cross correlate the beamformed response of the first plurality of microphones and the second plurality of microphones to determine final directional information for the audio signal, wherein the final directional information indicates a left side or a right side of the second plurality of microphones; and
transmit the audio signal from the second plurality of microphones based on the final directional information, wherein the computing system is configured to transmit the audio signal by transmitting a left audio channel and a right audio channel, wherein the left audio channel comprises audio from at least one beam on the left side of the second plurality of microphones and the right audio channel comprises audio from at least one beam on the right side of the second plurality of microphones.
4 Assignments
0 Petitions
Accused Products
Abstract
In some embodiments, spatially realistic audio may be provided for a conference call. Voices from participants on the left side of a display, in a conference call, may be directed through audio on the left side of the display at the other conferencing system in the conference call (similarly for voices from the center and right side of the display). In some embodiments, two speakers may be used in the system to create synthesized stereo sound at a location specified by directional information received as side information along with the existing audio channel. The location may be determined by using beamforming with integrated microphones on a camera or speakerphone. In some embodiments, the audio signal and directional information may be sent in the form of a left audio channel and a right audio channel.
102 Citations
14 Claims
-
1. A system, comprising:
-
a first plurality of microphones; a second plurality of microphones for producing an audio signal of a participant; and a computing system coupled to the first and second plurality of microphones, wherein the computing system is configured to; beamform a response of the first plurality of microphones to determine directional information for the audio signal relative to the first plurality of microphones; beamform a response of the second plurality of microphones to determine directional information for the audio signal relative to the second plurality of microphones; cross correlate the beamformed response of the first plurality of microphones and the second plurality of microphones to determine final directional information for the audio signal, wherein the final directional information indicates a left side or a right side of the second plurality of microphones; and transmit the audio signal from the second plurality of microphones based on the final directional information, wherein the computing system is configured to transmit the audio signal by transmitting a left audio channel and a right audio channel, wherein the left audio channel comprises audio from at least one beam on the left side of the second plurality of microphones and the right audio channel comprises audio from at least one beam on the right side of the second plurality of microphones. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method, comprising:
-
beamforming audio using a first plurality of microphones to determine directional information for a conference participant relative to a conference system; beamforming the audio using a second plurality of microphones to determine directional information for the conference participant relative to the conference system; cross correlating the beamformed response from the first plurality of microphones with the beamformed response of the second plurality of microphones to determine final directional information for the audio, wherein the final directional information indicates a left side or a right side of the second plurality of microphones; capturing an audio signal of the conference participant using a second plurality of microphones; transmitting the audio signal to a remote conference system based on the final directional information, wherein said transmitting the audio signal comprises transmitting a left audio channel and a right audio channel, wherein the left audio channel comprises audio from at least one beam on the left side of the second plurality of microphones and the right audio channel comprises audio from at least one beam on the right side of the second plurality of microphones; wherein the audio signal is used to reproduce audio from the participant at the remote conference system. - View Dependent Claims (9, 10, 11, 12)
-
-
13. A system, comprising:
-
a first plurality of microphones; a second plurality of microphones for producing an audio signal of a participant; and a computing system coupled to the first and second plurality of microphones, wherein the computing system is configured to; beamform a response of the first plurality of microphones to determine directional information for the audio signal relative to the first plurality of microphones; and transmit the audio signal from the second plurality of microphones and directional information, wherein the computing system is configured to transmit the audio and directional information by transmitting a left audio channel and a right audio channel, wherein the left audio channel comprises audio from at least one beam on a left side of the second plurality of microphones and the right audio channel comprises audio from at least one beam on a right side of the second plurality of microphones, and wherein the computing system is configured to determine the left side and the right side of the second plurality of microphones by cross correlating the beamformed response from the first plurality of microphones with a beamformed response of the second plurality of microphones.
-
-
14. A method, comprising:
-
beamforming the audio using a first plurality of microphones to determine directional information for a conference participant relative to a conference system; capturing an audio signal of the conference participant using a second plurality of microphones; transmitting the audio signal and directional information to a remote conference system, wherein said transmitting the audio signal and directional information comprises transmitting a left audio channel and a right audio channel, wherein the left audio channel comprises audio from at least one beam on a left side of the second plurality of microphones and the right audio channel comprises audio from at least one beam on a right side of the second plurality of microphones, and wherein the left side and the right side of the second plurality of microphones are determined by cross correlating the beamformed response from the first plurality of microphones with a beamformed response of the second plurality of microphones.
-
Specification