Videoconferencing audio distribution

• US 20080273078A1
• Filed: 05/01/2007
• Published: 11/06/2008
• Est. Priority Date: 05/01/2007
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Gorzynski, Mark E., Grasley, Scott, Ingalls, David R.
• Application Number:
  US11/799,129
• Publication Number:
  US 20080273078A1
• Time in Patent Office: Days
• US Class Current: 348/14.08
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Systems, methodologies, and media associated with videoconferencing are described. One example system includes video display devices and audio output devices to output video and related audio received from a remote videoconferencing location(s). The example system includes a distribution logic to selectively route audio data to an audio output device(s) and to selectively route video data to a video display device(s). The routing may be based, at least in part, on a relationship between an audio source and a video source. The result of the routing is to cause audio outputs to be acoustically associated with related video outputs so that different audio and video outputs will be spatially distinguishable and so that audio is attributable to related video.

Claims

1. A system, comprising:

a distribution logic to receive from two or more remote videoconferencing sources a video data and an audio data;

one or more video display devices to display the video data, the video display devices being separately controllable, being able to accept separate video inputs, and being able to present separate video outputs; and

two or more audio output devices to output the audio data, the audio output devices being separately controllable, being able to accept separate audio inputs, and being able to produce separate audio outputs,

the distribution logic to selectively route a portion of the audio data to an audio output device and to selectively route a portion of the video data to a video display device, the routing being based, at least in part, on a relationship between an audio source and a video source, the routing to cause a first audio output to be acoustically associated with a first video output and a second audio output to be acoustically associated with a second video output,

the first audio output and the second audio output being spatially distinguishable.

2. The system of claim 1, the audio data to be received over N connections, N being an integer greater than or equal to the number of audio sources, the N connections including one or more of, a circuit-switched connection, and a packet-switched connection.

3. The system of claim 2, the distribution logic to establish a path from a member of the N connections to an audio output device and to a video display device.

4. The system of claim 1, the audio data to be received over M connections, M being an integer less than the number of audio sources, the audio data comprising two or more audio signals multiplexed together, the M connections including one or more of, a circuit-switched connection, and a packet-switched connection.

5. The system of claim 4, the distribution logic to establish a path from a member of the M connections to an audio output device and to a video display device.

6. The system of claim 1, the audio data to be received over a single connection, the audio data comprising two or more audio signals multiplexed together, the single connection being one of, a circuit switched connection, and a packet-switched connection.

7. The system of claim 1, the distribution logic being one of, a circuit, a dynamically configurable circuit, a computer configurable circuit, and a computing component.

8. The system of claim 1, the audio data including spatial information to identify an audio source location and to identify a video source location related to the audio source location.

9. The system of claim 8, where the spatial information includes one or more of, a remote videoconferencing location identifier, an identifier of a position within a remote videoconferencing location, and an identifier of a microphone at a remote videoconferencing location with which a portion of the audio data is associated.

10. The system of claim 1, the distribution logic to selectively route the audio data based, at least in part, on one or more of, spatial information associated with at least a portion of the audio data, volume information that relates at least a portion of the audio data to a microphone, signal to noise information that relates at least a portion of the audio data to a microphone, and microphone identification information that relates at least a portion of the audio data to a microphone.

11. The system of claim 1, the audio data to be received from a remote system comprising:

one or more sets of microphones to receive audio signals from audio sources at remote videoconferencing locations; and

a spatial information logic to process the audio signals to determine spatial information associated with the audio signals and to provide the spatial information with the audio data provided to the distribution logic, the spatial information comprising one or more of, Cartesian coordinates, polar coordinates, and microphone identifiers,

the distribution logic to separate related audio signals based on the spatial information, the distribution logic to route based, at least in part, on the spatial information.

12. The system of claim 11, including a discrimination logic to determine from which microphone a cleanest signal was received, from which microphone a clearest signal was received, and from which microphone a loudest signal was received;

the spatial information logic to establish a one to one relationship between an audio source and a video source based, at least in part, on information provided by the discrimination logic.

13. A system, comprising:

a distribution logic to receive from two or more remote videoconferencing sources a video data and an audio data, the distribution logic being one of, a circuit, a dynamically configurable circuit, a computer configurable circuit, and a computing component, the audio data including spatial information to identify an audio source location and to identify a video source location related to the audio source location, the spatial information including one or more of, an identifier of a remote videoconferencing location, an identifier of a position within a remote videoconferencing location, and an identifier of a microphone at a remote videoconferencing location with which a portion of the audio data is associated;

the audio data to be received over M connections, M being an integer less than or equal to the number of audio sources, the audio data comprising two or more audio signals multiplexed together, the M connections including one or more of, a circuit-switched connection, and a packet-switched connection;

one or more video display devices to display the video data, the video display devices being separately controllable, being able to accept separate video inputs, and being able to present separate video outputs; and

two or more audio output devices to output the audio data, the audio output devices being separately controllable, being able to accept separate audio inputs, and being able to produce separate audio outputs,

the audio data to be received from a remote system comprising;

one or more sets of microphones to receive audio signals from audio sources at remote videoconferencing locations; and

a spatial information logic to process the audio signals to determine spatial information associated with the audio signals and to provide the spatial information with the audio data provided to the distribution logic, the spatial information logic to establish a one to one relationship between an audio source and a video source, the spatial information comprising one or more of, Cartesian coordinates, polar coordinates, and microphone identifiers,

the distribution logic to selectively route a portion of the audio data to an audio output device and to selectively route a portion of the video data to a video display device, the routing being based, at least in part, on a relationship between an audio source and a video source and on the spatial information,

the routing to cause a first audio output to be acoustically associated with a first video output and a second audio output to be acoustically associated with a second video output,

the video display devices and the audio output devices being arranged in a videoconferencing studio,

the first audio output and the second audio output being spatially distinguishable.

14. A computer-readable medium storing processor executable instructions that when executed by a processor cause the processor to perform a method, the method comprising:

receiving an audio signal from a set of remote videoconferencing audio sources;

receiving a video signal from a set of remote videoconferencing video sources related to the set of remote videoconferencing audio sources;

determining how to distribute the audio signal to a set of audio speakers;

determining how to distribute the video signal to a set of video displays;

distributing a first portion of the video signal to a first subset of the set of video displays;

distributing a first portion of the audio signal related to the first portion of the video signal to a first subset of the set of audio speakers to create a first audio-visual presentation where the first portion of the video signal is spatially correlated to the first portion of the audio signal;

distributing a second portion of the video signal to a second subset of the set of video displays; and

distributing a second portion of the audio signal related to the second portion of the video signal to a second subset of the set of audio speakers to create a second audio-visual presentation where the second portion of the video signal is spatially correlated to the second portion of the audio signal and where the first audio-visual presentation is identifiably separate from the second audio-visual presentation, where being identifiably separate includes being spatially distinguishable and acoustically distinguishable.

15. The computer-readable medium of claim 14, where receiving the audio signal includes receiving electronic signals corresponding to audible data detected at a remote videoconferencing audio source and receiving electronic signals that characterize the remote videoconferencing audio source including one or more of, an audio source identifier, and a participant identifier, and

where receiving the video signal includes receiving electronic signals corresponding to visual data detected at a remote videoconferencing video source and receiving electronic signals that characterize the remote videoconferencing video source including one or more of, a video source identifier, and a participant identifier.

16. The computer-readable medium of claim 15, where determining how to distribute the audio signal and the video signal includes identifying one or more subsets of collectively controllable output devices capable of producing an integrated audio-visual presentation.

17. The computer-readable medium of claim 16, where distributing the first portion of the video signal and the related first portion of the audio signal includes providing the first portion of the video signal, providing the related first portion of the audio signal, and providing a control signal to synchronize the output of the first portion of the video signal and the related first portion of the audio signal, and

where distributing the second portion of the video signal and the related second portion of the audio signal includes providing the second portion of the video signal, providing the related second portion of the audio signal, and providing a control signal to synchronize the output of the second portion of the video signal and the related second portion of the audio signal.

18. The computer-readable medium of claim 17, including controlling the set of collectively controllable output devices to present simultaneously a plurality of integrated audio-visual presentations, where a member of the plurality of integrated audio-visual presentations is individually identifiable both visually and acoustically from another member of the plurality of integrated audio-visual presentations.

19. A system, comprising:

means for receiving videoconferencing data from multiple sources, the videoconferencing data including both audio data and video data;

means for determining how to present a local presentation of a videoconference involving multiple sources so that the multiple sources appear visually and acoustically distinct in the local presentation; and

means for presenting the local presentation of the videoconference involving multiple sources so that the multiple sources appear visually and acoustically distinct.

20. The system of claim 19, including:

means for acquiring videoconferencing data at a remote videoconferencing location;

means for determining spatial data to relate audio data in the videoconferencing data to video data in the videoconferencing data;

means for determining separation data to separate a first audio source from a second audio source;

means for incorporating the spatial data and the separation data into the videoconferencing data; and

means for providing the videoconferencing data.