Method and system for a multitenancy telephone network

• US 8,737,593 B2
• Filed: 10/01/2012
• Issued: 05/27/2014
• Est. Priority Date: 03/02/2009
• Status: Active Grant

• Current Assignee: Twilio, Inc.
• Original Assignee: Twilio, Inc.
• Inventors: Lawson, Jeff, Wolthuis, John, Cooke, Evan
• Primary Examiner(s): NGUYEN, QUYNH H
• Application Number:
  US13/632,872
• Publication Number:
  US 20130028394A1
• Time in Patent Office: 603 Days
• Field of Search: 379/220.01, 379/265.09
• US Class Current: 379/220.01
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 61/2564 for a higher-layer protocol, e.g. for session initiation protocol [SIP]
• CPC Class Codes: H04L 65/1016 IP multimedia subsystem [IMS]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04M 1/2473 Telephone terminals interfacing a personal computer, e.g. using an API (Application Programming Interface) details of API H04M7/0021
• CPC Class Codes: H04M 15/34 Charging, billing or metering arrangements for private branch exchanges
• CPC Class Codes: H04M 2201/39 using speech synthesis speech synthesis per se G10L13/00
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 3/36 Statistical metering, e.g. recording occasions when traffic exceeds capacity of trunks
• CPC Class Codes: H04M 3/367 Traffic or load control
• CPC Class Codes: H04M 3/42323 PBX's with CTI arrangements
• CPC Class Codes: H04M 3/51 Centralised call answering arrangements requiring operator intervention , e.g. call or contact centers for telemarketing
• CPC Class Codes: H04M 3/5158 in combination with automated outdialling systems devices for signalling identity of wanted subscriber H04M1/26
• CPC Class Codes: H04M 3/523 with call distribution or queueing
• CPC Class Codes: H04M 3/5235 Dependent on call type or called number [DNIS]
• CPC Class Codes: H04M 7/0033 Notification or handling of incoming calls by a computer
• CPC Class Codes: H04M 7/006 : Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42
• CPC Class Codes: Y02D 10/00 : Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A method and system for operating a multitenancy telephony system including a call queue that stores call requests received from a plurality of users; an expandable and contractible telephony resource cluster that establishes call sessions for call requests; a analysis system that calculates capacity requirements of the system; a resource allocator that manages the scaling and operation of the telephony resource cluster; and a plurality of telephony network channels that are used as telephony communication channels for call sessions.

Claims

1. A method for multitenant messaging comprising:

through an application programming interface (API) of a telephony resource cluster, receiving a first outbound messaging request of a first account;

through the API of the telephony resource cluster, receiving a second outbound messaging request of a second account;

at a first individually assigned message queue, queuing the first outbound messaging request, wherein the first individually assigned queue is individually assigned to messaging requests of a first telephony endpoint of the first account;

at a second individually assigned message queue;

queuing the second outbound messaging request, wherein the second individually assigned queue is individually assigned to messaging requests of a second telephony endpoint of the second account;

dequeuing the queued first messaging request at an inter-message rate of the first account;

dequeuing the queued second messaging request at an inter-message rate of the second account; and

at a resource of the telephony resource cluster, sending a first message of the dequeued first message request, and sending a second message of the dequeued second message request.

2. The method of claim 1, wherein the first and second messaging requests are dequeued from the individually assigned queues in a round-robin methodology.

3. The method of claim 1, wherein the first and second messaging request are dequeued from the individually assigned queues in a user-weighted fair queuing methodology.

4. The method of claim 1, wherein the first account and second account are a single account with access to the first telephony endpoint and the second telephony endpoint.

5. The method of claim 1, further comprising queuing the first dequeued messaging request and the second dequeued messaging request in a telecommunications control queue;

dequeuing the first messaging request and the second messaging request from the telecommunications control queue;

wherein the first messaging request is sent upon being dequeued from the telecommunications control queue; and

wherein the second messaging request is sent upon being dequeued from the telecommunications control queue.

6. The method of claim 5, wherein the first and second messaging requests are dequeued from the carrier control queue at a rate of the telecommunications control queue resource.

7. The method of claim 1, wherein the rate of the first account and the rate of the second account are an inter-message communication rate.

8. The method of claim 1, wherein the rate of the first account and the rate of the second account are determined by the message capacity of the telephony resource cluster.

9. The method of claim 1, wherein sending the first message includes sending a short message service (SMS) message.

10. The method of claim 1, wherein sending the first message includes sending a multimedia messaging service (MMS) message.

11. The method of claim 1, wherein the telephony resource cluster is a multitenant cloud environment.

12. The method of claim 11, further comprising provisioning resources to the telephony resource cluster;

wherein sending the message of the second queued message request includes selecting a load balancing message router of the telephony resource cluster; and

communicating the second dequeued message request to the selected message router;

wherein at the message router, sending the message of the second message request.

13. A method for multitenant messaging comprising:

at a multitenant telephony resource cluster in a cloud environment, receiving a first inbound message to a telephony endpoint of a first account;

at the telephony resource cluster, receiving a second inbound message to a telephony endpoint of a second account;

initiating a first messaging request for the first inbound message and initiating a second messaging request for the second inbound message;

servicing the first messaging request with the telephony resource cluster;

queuing the second inbound messaging request in a first queue individually assigned to messaging requests of a second telephony endpoint of the second account;

dequeuing the second messaging request; and

servicing the dequeued second messaging request with the telephony resource cluster.

14. The method of claim 13, wherein dequeuing the second inbound messaging request occurs upon completing servicing the first messaging request.

15. The method of claim 14, wherein servicing the first messaging request includes retrieving telephony instructions from a first application service and executing the telephony instructions;

and servicing the second messaging request includes retrieving telephony instructions from a second application service and executing the telephony instructions.

16. The method of claim 13, wherein servicing the first messaging request includes sending a short message service (SMS) message to a destination.

17. The method of claim 13, wherein sending the first messaging request includes sending a multimedia messaging service (MMS) message to a destination.

18. A method for multitenant messaging comprising:

through a representational state transfer (REST) application programming interface (API) of a multi-tenant telephony resource cluster in a cloud environment, receiving a first outbound messaging request of a first account;

through the REST API of the telephony resource cluster, receiving a second outbound messaging request of a second account, wherein the first outbound messaging request and the second outbound messaging request is a short message service (SMS) outbound messaging request or a multimedia messaging service (MMS) outbound messaging request;

at a first individually assigned message queue, queuing the first outbound messaging request;

at a second individually assigned message queue;

queuing the second outbound messaging request;

dequeuing the queued first messaging request at an inter-message rate of the first account;

dequeuing the queued second messaging request at an inter-message rate of the second account;

queuing the first dequeued messaging request and the second dequeued messaging request in a multi-user telecommunications control queue;

dequeuing the first messaging request and the second messaging request from the telecommunications control queue; and

at a resource of the telephony resource cluster, sending a first message of the first message request upon dequeuing the first messaging request from the telecommunication control queue, and sending a second message of the second message request upon dequeuing the second messaging request from the telecommunication control queue.

19. A method for multitenant messaging comprising:

through an application programming interface (API) of a telephony resource cluster, receiving a first outbound messaging request of a first account;

through the API of the telephony resource cluster, receiving a second outbound messaging request of a second account;

at a first individually assigned message queue, queuing the first outbound messaging request, wherein the first individual assigned queue is a queue individually assigned to the first account;

at a second individually assigned message queue;

queuing the second outbound messaging request, wherein the second individually assigned queue is individually assigned to the second account;

dequeuing the queued first messaging request at an inter-message rate of the first account;

dequeuing the queued second messaging request at an inter-message rate of the second account; and

at a resource of the telephony resource cluster, sending a first message of the dequeued first message request, and sending a second message of the dequeued second message request.

20. The method of claim 19, wherein the first and second messaging requests are dequeued from the individually assigned queues in a round-robin methodology.

21. The method of claim 19, wherein the first and second messaging request are dequeued from the individually assigned queues in a user-weighted fair queuing methodology.

22. The method of claim 19, further comprising queuing the first dequeued messaging request and the second dequeued messaging request in a telecommunications control queue;

dequeuing the first messaging request and the second messaging request from the telecommunications control queue;

wherein the first messaging request is sent upon being dequeued from the telecommunications control queue; and

wherein the second messaging request is sent upon being dequeued from the telecommunications control queue.

23. The method of claim 22, wherein the first and second messaging requests are dequeued from the carrier control queue at a rate of the telecommunications control queue resource.

24. The method of claim 19, wherein the rate of the first account and the rate of the second account are an inter-message communication rate.

25. The method of claim 19, wherein the rate of the first account and the rate of the second account are determined by the message capacity of the telephony resource cluster.

26. The method of claim 19, wherein sending the first message includes sending a short message service (SMS) message.

27. The method of claim 19, wherein sending the first message includes sending a multimedia messaging service (MMS) message.

28. The method of claim 19, wherein the telephony resource cluster is a multitenant cloud environment.

29. The method of claim 28, further comprising provisioning resources to the telephony resource cluster;

wherein sending the message of the second queued message request includes selecting a load balancing message router of the telephony resource cluster; and

communicating the second dequeued message request to the selected message router;

wherein at the message router, sending the message of the second message request.

30. A method for multitenant messaging comprising:

at a multitenant telephony resource cluster in a cloud environment, receiving a first inbound message to a telephony endpoint of a first account;

at the telephony resource cluster, receiving a second inbound message to a telephony endpoint of a second account;

initiating a first messaging request for the first inbound message and initiating a second messaging request for the second inbound message;

servicing the first messaging request with the telephony resource cluster;

queuing the second inbound messaging request in a first queue individually assigned to the second account;

dequeuing the second messaging request; and

servicing the dequeued second messaging request with the telephony resource cluster.

31. The method of claim 30, wherein dequeuing the second inbound messaging request occurs upon completing servicing the first messaging request.

32. The method of claim 31, wherein servicing the first messaging request includes retrieving telephony instructions from a first application service and executing the telephony instructions;

and servicing the second messaging request includes retrieving telephony instructions from a second application service and executing the telephony instructions.

33. The method of claim 30, wherein servicing the first messaging request includes sending a short message service (SMS) message to a destination.

34. The method of claim 30, wherein sending the first messaging request includes sending a multimedia messaging service (MMS) message to a destination.