METHOD AND SYSTEM FOR CONDUCTING VIDEO CONFERENCES OF DIVERSE PARTICIPATING DEVICES

• US 20140028788A1
• Filed: 04/24/2013
• Published: 01/30/2014
• Est. Priority Date: 07/30/2012
• Status: Abandoned Application

• Current Assignee: Polycom Incorporated (Plantronics, Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Halavy, Avishay
• Application Number:
  US13/869,781
• Publication Number:
  US 20140028788A1
• Time in Patent Office: Days
• US Class Current: 348/14.09
• CPC Class Codes: H04L 45/74 Address processing for routing
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A novel universal bridge (UB) can handle and conduct multimedia multipoint conferences between a plurality of MREs and LEPs without using an MRM, an MCU and a gateway. Further, a UB can be configured to allocate and release resources dynamically according to the current needs of each conferee and the session.

Claims

1. A universal bridge for a multimedia conferencing system, comprising:

an interface, configured to carry streams of transport frames according to a transport protocol, each frame having a stream identifier;

a media relay input processor, coupled to the interface and configured to deliver to the interface transport frames carrying compressed media received from a media relay endpoint;

a decoder module, coupled to the interface and configured to obtain a stream of transport frames carrying compressed media and generate a stream of transport frames carrying decoder module data units;

a first type media combiner module, coupled to the interface and configured to combine a plurality of streams of transport frames carrying decoder module data units into a stream of transport frames carrying combined media targeted toward a legacy endpoint;

an encoder output module, coupled to the interface and configured to obtain a stream of transport protocol frames carrying decoder module data units and generate a stream of transport frames carrying compressed media;

a media relay endpoint output processor, coupled to the interface and configured to obtain one or more streams of transport frames carrying compressed media originated by a first media relay endpoint or a first legacy endpoint and deliver one or more streams of packets toward a second media relay endpoint; and

a control module that controls data traffic to and from the interface and allocates stream identifiers for streams of transport frames.

2. The universal bridge of claim 1, further comprising:

a legacy input processor, coupled to the interface and configured to deliver to the interface transport frames carrying compressed media received from a legacy endpoint.

3. The universal bridge of claim 2, wherein the legacy input processor further comprises a real time protocol processing unit.

4. The universal bridge of claim 1, further comprising:

a legacy input processor, coupled to the interface and configured to receive from a legacy endpoint and process packets carrying compressed media, comprising;

a decoder module, configured to process chunks of compressed media into a stream of transport frames carrying decoder module data units to be transferred to the interface,

wherein the legacy input processor is further configured to deliver data chunks of compressed media to the decoder module.

5. The universal bridge of claim 1, further comprising:

a second type media combiner module, coupled to the interface and configured to combine a plurality of streams of transport frames carrying compressed media into a stream of transport frames carrying combined media targeted toward a media relay endpoint.

6. The universal bridge of claim 5, wherein at least one of the plurality of streams of transport frames carrying compressed media originates from a legacy endpoint.

7. The universal bridge of claim 1, further comprising a plurality of decoder modules, encoder output modules, and first type media combiner modules,

wherein the control module, from time to time, in response to obtained control parameters, allocates at least one module selected from a group consisting of:

decoder module, encoder output module, and first type media combiner module.

8. The universal bridge of claim 1, wherein a decoder module data unit is a decompressed data unit.

9. The universal bridge of claim 1, wherein the encoder output module obtains a stream of transport frames carrying combined media and generates a stream of transport protocol frames carrying compressed combined media.

10. The universal bridge of claim 9, further comprising a legacy output processor, coupled to the interface and configured to obtain a stream of transport frames carrying compressed combined media, and deliver packets toward a legacy endpoint.

11. The universal bridge of claim 1, wherein transport frames according to the transport protocol comprise a header that complies with a real time protocol.

12. The universal bridge of claim 1, wherein the media is video and the first type media combiner module is further configured to build a continuous presence video image.

13. The universal bridge of claim 12, wherein the first type media combiner module is configured to scale a decoded video image to a required resolution while building the continuous presence video image.

14. The universal bridge of claim 1, wherein the media is audio and the first type media combiner module is an audio mixer.

15. The universal bridge of claim 1, wherein the decoder module further comprises a scaler that scales a decoded video image to a required resolution.

16. The universal bridge of claim 1, wherein the encoder output module comprises a scaler that scales a decoded video image to a required resolution.

17. The universal bridge of claim 1, wherein the interface is a shared memory.

18. The universal bridge of claim 17,

wherein transport frames according to the transport protocol comprise a transport protocol header,

wherein the transport protocol header comprises the stream identifier, and

wherein the stream identifier represents a set of memory addresses.

19. The universal bridge of claim 1, wherein the interface comprises a switch having multicast routing capabilities.

20. The universal bridge of claim 1, wherein the packets carrying compressed media toward a second media relay endpoint are used to build, at the second media relay endpoint, a continuous presence video image.

21. The universal bridge of claim 1,

wherein the control module controls data traffic responsive to one or more control parameters, and

wherein the control parameters comprise one or more of status information, user requests, and endpoint parameters.

22. The universal bridge of claim 21, wherein the status information comprises audio energy of audio streams received from the one or more media relay endpoints and one or more legacy endpoints.

23. The universal bridge of claim 1, wherein the control module allocates at least one module selected from a group consisting of:

a decoding module, an encoder output module, and a media combiner module.

24. A universal bridge system for a multimedia conferencing system, comprising:

a first interface, configured to carry streams of transport frames according to a transport protocol;

a control module connected to the first interface;

a media relay processor, connected to the first interface and configured to receive compressed media received from a first media relay endpoint, to deliver one or more streams of packets toward a second media relay endpoint, to deliver streams of transport frames to the first interface, and to receive streams of transport frames from the first interface; and

a legacy processor, connected to the first interface, configured to receive compressed media received from a first legacy endpoint, to deliver one or more streams of packets toward second legacy endpoint, to deliver streams of transport frames to the first interface, and to receive streams of transport frames from the first interface.

25. The universal bridge of claim 24, wherein the media relay processor comprises:

a second interface, configured to carry streams of transport frames according to the transport protocol;

a media relay input processor, coupled to the second interface and configured to deliver to the second interface transport frames carrying compressed media received from the first media relay endpoint;

a first type media combiner module, coupled to the second interface and configured to combine a plurality of streams of transport frames carrying compressed media in a stream of transport frames carrying combined media targeted toward a media relay endpoint;

a media relay endpoint output processor, coupled to the second interface and configured to obtain one or more streams of transport frames carrying combined media created by the first type media combiner module from compressed media originated by the first media relay endpoint and the first legacy endpoint and deliver one or more streams of packets toward the second media relay endpoint; and

a first interface adaptor module, coupled to the first and second interfaces, that is configured to deliver transport frames between the first interface and the second interface.

26. The universal bridge of claim 24, wherein the legacy processor comprises:

a third interface, configured to carry streams of transport frames according to the transport protocol; and

a legacy endpoint output processor, coupled to the third interface and configured to obtain a stream of transport frames carrying compressed media originated by the first media relay endpoint and the first legacy endpoint and deliver one or more streams of packets toward the second legacy endpoint; and

a second interface adaptor module, coupled to the first and third interfaces, configured to deliver transport frames between the first interface and the third interface.

27. The universal bridge of claim 26, wherein the legacy processor further comprises:

a legacy input processor, coupled to the third interface, configured to deliver to the third interface transport frames carrying compressed media received from the first legacy endpoint.

28. The universal bridge of claim 27, wherein the legacy processor further comprises:

a decoder module, coupled to the third interface and configured to obtain a stream of transport frames carrying compressed media and generate a stream of transport frames carrying decoder module data units.

29. The universal bridge of claim 26, wherein the legacy processor further comprises:

a legacy input processor, coupled to the third interface, configured to receive compressed media from the first legacy endpoint, and

a decoder module, configured to process chunks of compressed media into a stream of transport frames carrying decoder module data units to be transferred to the third interface,

wherein the legacy input processor is further configured to deliver data chunks of compressed media to the decoder module.

30. The universal bridge of claim 26, wherein the legacy processor further comprises:

a lossless decoder, coupled to the third interface, configured to decode, using a lossless technique, lossless compressed media carried in transport frames received from the first interface.

31. The universal bridge of claim 26, wherein the legacy processor further comprises:

a lossless encoder, coupled to the third interface, configured to compress, using a lossless technique, uncompressed media for delivering lossless compressed media in transport frames to the first interface.

32. The universal bridge of claim 26, wherein the legacy processor second interface adaptor module comprises:

a lossless decoder, configured to decode, using a lossless technique, compressed media carried in transport frames received from the first interface; and

a lossless encoder, configured to compress, using a lossless technique, uncompressed media for delivering lossless compressed media in transport frames to the first interface.

33. The universal bridge system of claim 26, wherein the legacy processor further comprises:

a second type media combiner module, coupled to the third interface, configured to combine a plurality of streams of transport frames carrying decoder module data units into a stream of transport frames carrying combined media targeted toward the second legacy endpoint.

34. The universal bridge system of claim 33, wherein at least one of the plurality of streams of transport frames carrying decoder module data units originated from a media relay endpoint.

35. The universal bridge of claim 26, wherein the legacy processor further comprises:

an encoder module, coupled to the third interface and configured to obtain a stream of transport protocol frames carrying decoder module data units and generate a stream of transport frames carrying compressed media.

36. The universal bridge of claim 24, comprising a plurality of media relay processors and a plurality of legacy processors.

37. A universal bridge system for a multimedia conferencing system, comprising:

a first interface, configured to carry streams of transport frames according to a transport protocol;

a plurality of sub-bridges communicatively coupled to media relay endpoints and legacy endpoints, wherein each of the plurality of sub-bridges is configured for

receiving streams of packets carrying compressed media from a source media relay endpoint;

delivering streams of packets carrying compressed media toward a destination media relay endpoint;

receiving streams of packets carrying compressed media from a source legacy endpoint;

delivering streams of packets carrying compressed media toward a destination legacy endpoint;

receiving streams of transport frames from the first interface originating from another of the plurality of sub-bridges; and

delivering streams of transports frames to the first interface targeted for another of the plurality of sub-bridges.

38. The universal bridge system of claim 37, further comprising:

a control module connected to the first interface, configured for controlling the plurality of sub-bridges.

39. The universal bridge system of claim 37, wherein each of the plurality of sub-bridges comprises:

a second interface, configured to carry streams of transport frames according to a transport protocol;

a media relay input processor, coupled to the second interface, configured to deliver to the second interface transport frames carrying compressed media received from a source media relay endpoint;

a legacy input processor, coupled to the second interface, configured to deliver to the second interface transport frames carrying compressed media received from a source legacy endpoint;

a decoder module, coupled to the second interface, configured to obtain a stream of transport frames carrying compressed media and generate a stream of transport frames carrying decoder module data units;

a media combiner module, coupled to the second interface, configured to combine a plurality of streams of transport frames carrying decoder module data units into a stream of transport frames carrying combined media;

an encoder output module, coupled to the second interface, configured to obtain a stream of transport protocol frames carrying decoder module data units or combined media and generate a stream of transport frames carrying compressed media;

a media relay output processor, coupled to the second interface, configured to obtain one or more streams of transport frames carrying compressed media and deliver one or more streams of packets toward a destination media relay endpoint;

a legacy output processor, coupled to the second interface, configured to obtain a stream of transport frames carrying compressed combined media, and deliver packets toward a destination legacy endpoint; and

an interface adaptor, configured to pass transport frames between the first interface and the second interface.

40. A method of configuring a universal bridge for a multimedia conferencing system, comprising:

allocating for a media relay input stream in a conference;

a media relay input processor; and

a decoder module;

allocating for each media relay endpoint in the conference;

a media combiner module; and

a media relay output processor;

allocating for a legacy input stream in the conference;

a legacy input processor;

a decoder module;

a scaler; and

an encoder output module;

allocating for each legacy endpoint in the conference;

a media combiner module; and

a legacy output processor.

41. The method of claim 40, further comprising:

creating a control table and a routing table;

allocating an entry in the control table for each media relay endpoint and each legacy endpoint in the conference; and

allocating an entry in the routing table for each media relay input stream and each legacy input stream.

42. The method of claim 41, further comprising:

determining a current continuous presence image to be presented at a media relay endpoint in the conference; and

updating the routing table to allow the media combiner module allocated to the media relay endpoint to obtain transport frames corresponding to presented media relay endpoints and transport frames produced by the allocated encoder output module corresponding to presented legacy endpoints.

43. The method of claim 41, further comprising:

determining a current continuous presence image to be presented at a legacy endpoint in the conference; and

updating the routing table to allow the media combiner module allocated to the legacy endpoint to obtain transport frames from the decoder modules associated with presented media relay endpoints and presented legacy endpoints.

44. The method of claim 40, wherein allocating for a media relay input stream is performed when a continuous presence image corresponding to the media relay input stream is presented to at least one legacy endpoint.

45. The method of claim 40, wherein allocating for a legacy input stream is performed when a continuous presence image corresponding to the legacy input stream is presented to at least one media relay endpoint.