Method, apparatus, and system for processing cascade conference sites in cascade conference

• US 8,836,753 B2
• Filed: 12/14/2012
• Issued: 09/16/2014
• Est. Priority Date: 12/24/2010
• Status: Active Grant

• Current Assignee: Huawei Device Company Limited (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Device Company Limited (Huawei Investment & Holding Co., Ltd.)
• Inventors: Liang, Liyan
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US13/715,436
• Publication Number:
  US 20130100239A1
• Time in Patent Office: 641 Days
• Field of Search: 348 1401- 1416, 379/202.01
• US Class Current: 348/14.08
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

Embodiments of the present invention disclose a method for processing cascade conference sites in a cascade conference, which may be used to implement one-to-one correspondence between an image orientation and a voice orientation of each conference site in the cascade conference, and improve the user experience of a participant. Certain embodiments of the present invention include: receiving an audio code stream sent by a cascade conference site, where the audio code stream sent by the cascade conference site is sent to different conference sites through different audio sound channels or audio cascade channels; receiving an audio code stream sent by a non-cascade conference site; and selecting audio data satisfying a preconfigured condition from audio data to be selected.

Claims

1. A method for processing cascade conference sites in a cascade conference, comprising:

receiving an audio code stream sent by a cascade conference site, wherein the audio code stream sent by the cascade conference site is sent based on that different conference sites occupy different audio sound channels or audio cascade channels;

receiving an audio code stream sent by a non-cascade conference site;

selecting audio data satisfying a preconfigured condition from audio data to be selected, wherein the audio data to be selected comprises;

the received audio code stream sent by the cascade conference site and the received audio code stream sent by the non-cascade conference site; and

adjusting an orientation sequence of the audio data satisfying the preconfigured condition.

2. The method for processing the cascade conference sites in the cascade conference according to claim 1, wherein the non-cascade conference site comprises:

an ordinary conference site and/or a telepresence conference site.

3. The method for processing the cascade conference sites in the cascade conference according to claim 1, wherein when the audio code stream sent by the cascade conference site is sent based on that different conference sites occupy different audio cascade channels, the method further comprises:

receiving audio cascade channel composition information sent by the cascade conference site, wherein the audio cascade channel composition information is quantity information of audio cascade channels established by the cascade conference site, so as to obtain the quantity of audio cascade channels occupied by the received audio code stream sent by the cascade conference site.

4. The method for processing the cascade conference sites in the cascade conference according to claim 1, wherein the preconfigured condition is to reserve audio data of several parties having maximum voices in the cascade conference site and the non-cascade conference site.

5. A method for processing cascade conference sites in a cascade conference, comprising:

receiving an audio code stream sent by a non-cascade conference site;

selecting audio data satisfying a preconfigured condition from audio data to be selected, wherein the audio data to be selected at least comprises the received audio code stream sent by the non-cascade conference site;

processing the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio sound channels or audio cascade channels to obtain cascade conference site audio data, so that a first cascade conference site can identify the cascade conference site audio data;

encoding the cascade conference site audio data to obtain an audio code stream; and

sending the audio code stream to the first cascade conference site.

6. The method for processing the cascade conference sites in the cascade conference according to claim 5, wherein the non-cascade conference site comprises:

an ordinary conference site and/or a telepresence conference site.

7. The method for processing the cascade conference sites in the cascade conference according to claim 5, wherein

the processing the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio sound channels to obtain the cascade conference site audio data comprises:

if the audio data satisfying the preconfigured condition is audio data corresponding to a screen of a telepresence conference site, using the audio data corresponding to the screen of the telepresence conference site as audio data corresponding to a separate conference site;

if the audio data satisfying the preconfigured condition is audio data corresponding to an ordinary conference site and the sound channel quantity of the ordinary conference site is not a single sound channel, mixing the audio data of the ordinary conference site into single sound channel audio data; and

according to an orientation sequence of a video code stream that needs to be sent, adjusting an orientation sequence of the audio data satisfying the preconfigured condition according to different conference sites occupying different audio sound channels, respectively, and using the audio data which satisfies the preconfigured condition and whose orientation sequence is adjusted as the cascade conference site audio data.

8. The method for processing the cascade conference sites in the cascade conference according to claim 5, wherein

the processing the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio sound channels to obtain the cascade conference site audio data comprises:

if the audio data satisfying the preconfigured condition is audio data corresponding to a screen of a telepresence conference site, using the audio data corresponding to the screen of the telepresence conference site as audio data corresponding to a separate conference site;

if the audio data satisfying the preconfigured condition is audio data corresponding to an ordinary conference site and the sound channel quantity of the ordinary conference site is not a single sound channel, mixing the audio data of the ordinary conference site into single sound channel audio data;

sequencing the audio data satisfying the preconfigured condition according to different conference sites occupying different audio sound channels, respectively, and using the sequenced audio data satisfying the preconfigured condition as the cascade conference site audio data; and

generating audio conference site location information, wherein the audio conference site location information is location sequencing information of the audio data satisfying the preconfigured condition; and

after the processing the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio sound channels or audio cascade channels to obtain the cascade conference site audio data, the method comprises;

sending the audio conference site location information to the first cascade conference site.

9. The method for processing the cascade conference sites in the cascade conference according to claim 5, wherein

after the processing the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio cascade channels to obtain the cascade conference site audio data, the method comprises:

generating audio cascade channel composition information, wherein the audio cascade channel composition information is quantity information of audio cascade channels established by the cascade conference site, so as to obtain the quantity of audio cascade channels occupied by the received audio code stream sent by the cascade conference site; and

after the processing the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio sound channels or audio cascade channels to obtain cascade conference site audio data, the method comprises;

sending the audio cascade channel composition information to the first cascade conference site.

10. The method for processing the cascade conference sites in the cascade conference according to claim 5, wherein the preconfigured condition is to reserve audio data of several parties with the maximum voices in a cascade conference site and the non-cascade conference site.

11. An apparatus for processing cascade conference sites in a cascade conference, comprising:

a receiving unit, configured to receive an audio code stream sent by a cascade conference site, wherein the audio code stream sent by the cascade conference site is sent based on that different conference sites occupy different audio sound channels or audio cascade channels, and

the receiving unit is further configured to receive an audio code stream sent by a non-cascade conference site;

a selecting unit, configured to

select audio data satisfying a preconfigured condition from audio data to be selected, wherein the audio data to be selected comprises;

the received audio code stream sent by the cascade conference site and the received audio code stream sent by the non-cascade conference site; and

a sequence adjusting unit, configured to adjust an orientation sequence of the audio data satisfying the preconfigured condition.

12. The apparatus for processing the cascade conference sites in the cascade conference according to claim 11, wherein when the audio code stream sent by the cascade conference site is sent based on that different conference sites occupy different audio cascade channels,

the receiving unit is further configured to receive audio cascade channel composition information sent by the cascade conference site, wherein the audio cascade channel composition information is quantity information of audio cascade channels established by the cascade conference site, so as to obtain the quantity of audio cascade channels occupied by the received audio code stream.

13. The apparatus for processing the cascade conference sites in the cascade conference according to claim 11, further comprising:

a decoding unit, configured to decode the audio code stream sent by the cascade conference site and the audio code stream sent by the non-cascade conference site.

14. An apparatus for processing cascade conference sites in a cascade conference, comprising:

a receiving unit, configured to receive an audio code stream sent by a non-cascade conference site;

a selecting unit, configured to

select audio data satisfying a preconfigured condition from audio data to be selected, wherein the audio data to be selected at least comprises the audio code stream sent by the non-cascade conference site;

a processing unit, configured to process the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio sound channels or audio cascade channels to obtain cascade conference site audio data, so that a first cascade conference site can identify the cascade conference site audio data;

an encoding unit, configured to encode the cascade conference site audio data to obtain an audio code stream; and

a sending unit, configured to send the audio code stream to the first cascade conference site.

15. The apparatus for processing the cascade conference sites in the cascade conference according to claim 14, wherein

when processing the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio sound channels to obtain the cascade conference site audio data, the processing unit comprises:

a conference site identifying module, configured to,

if the audio data satisfying the preconfigured condition is audio data corresponding to a screen of a telepresence conference site, use the audio data corresponding to the screen of the telepresence conference site as audio data corresponding to a separate conference site;

a sound mixing module, configured to, if the audio data satisfying the preconfigured condition is audio data corresponding to an ordinary conference site and the sound channel quantity of the ordinary conference site is not a single sound channel, mix the audio data of the ordinary conference site into single sound channel audio data; and

a correlation module, configured to, according to an orientation sequence of a video code stream that needs to be sent, adjust an orientation sequence of the audio data satisfying the preconfigured condition based on that different conference sites occupy through different conference sites occupying different audio sound channels, respectively, and use the audio data which satisfies the preconfigured condition and whose orientation sequence is adjusted as the cascade conference site audio data.

16. The apparatus for processing the cascade conference sites in the cascade conference according to claim 14, wherein

when processing the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio sound channels to obtain the cascade conference site audio data, the processing unit comprises:

a conference site identifying module, configured to,

if the audio data satisfying the preconfigured condition is audio data corresponding to a screen of a telepresence conference site, use the audio data corresponding to the screen of the telepresence conference site as audio data corresponding to a separate conference site;

a sound mixing module, configured to, if the audio data satisfying the preconfigured condition is audio data corresponding to an ordinary conference site and the sound channel quantity of the ordinary conference site is not a single sound channel, mix the audio data of the ordinary conference site into single sound channel audio data; and

a sequencing module, configured to sequence the audio data satisfying the preconfigured condition according to different conference sites occupying different audio sound channels, and use the sequenced audio data satisfying the preconfigured condition as the cascade conference site audio data; and

a generating module, configured to generate audio conference site location information, wherein the audio conference site location information is location sequencing information of the audio data satisfying the preconfigured condition; and

the sending unit is further configured to send the audio conference site location information to the first cascade conference site.

17. The apparatus for processing the cascade conference sites in the cascade conference according to claim 14, wherein when processing the audio data satisfying the preconfigured condition based on that different conference sites occupy different audio cascade channels to obtain the cascade conference site audio data, the apparatus further comprises:

a generating unit, configured to generate audio cascade channel composition information, wherein the audio cascade channel composition information is quantity information of audio cascade channels established by the cascade conference site, so as to obtain the quantity of audio cascade channels occupied by the received audio code stream sent by the cascade conference site; and

the sending unit is further configured to send the audio cascade channel composition information to the first cascade conference site.