Systems and methods for scalable distributed global infrastructure for real-time multimedia communication

• US 8,514,263 B2
• Filed: 05/11/2011
• Issued: 08/20/2013
• Est. Priority Date: 05/12/2010
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Blue Jeans Network, Inc. (Verizon Communications Inc.)
• Inventors: Periyannan, Alagu, Anand, Raghavan, Grupenhoff, Michael, Kalluri, Ravi Kiran, Weber, Emmanuel, Villait, Anil
• Primary Examiner(s): Nguyen, Joseph J
• Application Number:
  US13/105,699
• Publication Number:
  US 20110279636A1
• Time in Patent Office: 832 Days
• Field of Search: 348 1401- 1409
• US Class Current: 348/14.08
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A new approach is proposed that contemplates systems and methods to support the operation of a Virtual Media Room or Virtual Meeting Room (VMR), wherein each VMR can accept from a plurality of participants at different geographic locations a variety of video conferencing feeds of audio and video streams from video conference endpoints. A globally distributed infrastructure that supports operations of the VMR through a plurality of MCUs (Multipoint Control Unit) built from off-the-shelf components instead of custom hardware as media processing nodes, each configured to process the plurality of audio and video streams from the plurality of video conference endpoints in real time. Each single VMR can be implemented and supported across the infrastructure of globally distributed set of servers/media processing nodes co-located in Points of Presence (POPs) for Internet access, wherein such massively distributed architecture can support thousands of simultaneously active VMRs and yet is transparent to the users of the VMRs.

Claims

1. A system, comprising:

a virtual meeting room (VMR) engine, which in operation, accepts from a plurality of participants to a video conference a plurality of audio and video streams from a plurality of video conference endpoints each associated with one of the plurality of participants;

a globally distributed infrastructure that supports operations of the VMR, comprising a plurality of MCUs (Multipoint Control Unit) as media processing nodes, each configured to process the plurality of audio and video streams from a plurality of video conference endpoints in real time, wherein the MCUs are built from off-the-shelf components instead of custom hardware and

wherein the globally distributed infrastructure distributes the MCUs around a globe in Points of Presence (POPs) at data centers or cloud based servers to translate and decode the audio and video streams having different communication protocols coming from a video conference endpoints, wherein each of the POPs has as much processing power as required to handle the load from a geographical region that the POP is located, and the globally distributed infrastructure allowing for one or more other globally distributed networks to connect to it and directing the audio and video stream from each of the participants connecting to the VMR to a selected POP to achieve at least one of an ability to support a wide variety of audio video formats and protocols, a scalable mixing and composition of audio and video streams, a service delivered with reduced latency, a service that is capital efficient and cost efficient to operate.

2. The system of claim 1, wherein:

the off-the-shelf components include one or more of Linux/x86 CPUs and PC GPUs (Graphics Processing Units).

3. The system of claim 1, wherein:

globally distributed infrastructure deploys the MCUs in a rack-and-stack cloud-computing style to achieve the scalability and cost/performance efficiency.

4. The system of claim 1, wherein:

the MCUs support scalable mixing and composition of the plurality of audio and video streams.

5. The system of claim 1, wherein:

the globally distributed infrastructure clusters the off-the-shelf components both locally on a LAN as well as across geographies for the MCUs to achieve unlimited scaling.

6. The system of claim 5, wherein:

the clustered MCUs make use of network or application layer multicast and a multi-bit-rate stream distribution scheme to achieve the unlimited scaling.

7. The system of claim 1, wherein:

the globally distributed infrastructure distributes the audio and video streams from the participants both locally on a LAN present in each POP or across multiple POPs on the WAN.

8. The system of claim 1, wherein:

the globally distributed infrastructure allows for one or more other globally distributed private networks to connect to it, including deployments of videoconferencing services that require federation at edge nodes and translation and decoding of several communication and transport protocols.

9. The system of claim 1, wherein:

the globally distributed infrastructure limits audio and video stream from each of the participants to the video conference to go through a maximum of two hops of POPs.

10. The system of claim 1, wherein:

the globally distributed infrastructure provides a high-level mechanism for fault tolerant protocol handling to prevent improper input from causing instability and security breach by isolating processing of protocol control messages and audio and video streams in one or more separate, independent, unprivileged processes.

11. The system of claim 1, wherein:

the globally distributed infrastructure supports distributed fault-tolerant messaging for an internet-based client-server architecture.

12. The system of claim 1, wherein:

the globally distributed infrastructure enables seamless firewall traversal for legacy video conference endpoints that implement only standardized protocols and does not assume a public internet address available for that videoconferencing endpoint to communicate outside the firewall.

13. A method, comprising:

accepting from a plurality of participants to a video conference a plurality of audio and video streams from a plurality of video conference endpoints each associated with one of the plurality of participants;

supporting operations of the VMR, comprising a plurality of MCUs (Multipoint Control Unit) as media processing nodes, each configured to process the plurality of audio and video streams from the plurality of video conference endpoints in real time, wherein the MCUs are built from off-the-shelf components instead of custom hardware and

wherein the globally distributed infrastructure distributes the MCUs around a globe in Points of Presence (POPs) at data centers or cloud based servers to translate and decode the audio and video streams having different communication protocols coming from a video conference endpoints, wherein each of the POPs has as much processing power as required to handle the load from a geographical region that the POP is located, and the globally distributed infrastructure allowing for one or more other globally distributed networks to connect to it, and directing the audio and video stream from each of the participants connecting to the VMR to a selected POP to achieve at least one of an ability to support a wide variety of audio video formats and protocols, a scalable mixing and composition of audio and video streams, a service delivered with reduced latency, a service that is capital efficient and cost efficient to operate.

14. The method of claim 13, further comprising:

deploying the MCUs in a rack-and-stack cloud-computing style to achieve the scalability and cost/performance efficiency.

15. The method of claim 13, further comprising:

supporting distributed scalable mixing and composition of the plurality of audio and video streams.

16. The method of claim 13, further comprising:

clustering the off-the-shelf components both locally on a LAN as well as across geographies for the MCUs to achieve unlimited scaling.

17. The method of claim 13, further comprising:

distributing the audio and video streams from the participants both locally on a LAN present in each POP or across multiple POPs on the WAN.

18. The method of claim 13, further comprising:

allowing for one or more other globally distributed private networks to connect to it, including deployments of videoconferencing services that require federation at edge nodes and translation and decoding of several communication and transport protocols.

19. The method of claim 13, further comprising:

limiting audio and video stream from each of the participants to the video conference to go through a maximum of two hops of POPs.

20. The method of claim 13, further comprising:

providing a high-level mechanism for fault tolerant protocol handling to prevent improper input from causing instability and security breach by isolating processing of protocol control messages and audio and video streams in one or more separate, independent, unprivileged processes.

21. The method of claim 13, further comprising:

supporting distributed fault-tolerant messaging for an internet-based client-server architecture.

22. The method of claim 13, further comprising:

enabling seamless firewall traversal for legacy video conference endpoints that implement only standardized protocols that do not assume an Internet-based service being available to communicate with other video conference endpoints via firewall traversal.