Method and apparatus for data traffic distribution among independent processing centers

• US 9,191,336 B2
• Filed: 11/20/2012
• Issued: 11/17/2015
• Est. Priority Date: 11/20/2012
• Status: Active Grant

• Current Assignee: DIRECTV, LLC (AT&T, Inc.)
• Original Assignee: The DIRECTV Group, Inc. (AT&T, Inc.)
• Inventors: Arya, Vishal, Ali, Shahzad, Cugno, Christopher J., Lam, Thai, Makhijani, Michael A., Singh, Vaibhav
• Primary Examiner(s): WANG, LIANG CHE A
• Application Number:
  US13/682,704
• Publication Number:
  US 20140143423A1
• Time in Patent Office: 1,092 Days
• Field of Search: 709/217, 709/218, 709/219, 709/226, 709/238
• US Class Current: 1/1
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation

Abstract

A method and apparatus for assigning processing requests is disclosed. The method is typically used in a processing system comprising a first processing center and one or more second processing centers remote from the first processing center, a. A method of assigning a processing request may comprise the steps of: determining at a traffic distribution controller a capacity of each of the processing centers to process the processing request, accepting a processing request in the first processing center, and assigning the processing request to at least one of the second processing centers according to the determined current capacity of each of the processing centers. The processing request is initially addressed to a first global address of the first processing center, then the processing request is readdressed to a second global address of one of the second processing centers.

Claims

1. In a processing system comprising a first processing center and one or more second processing centers remote from the first processing center, each of the second processing centers comprising at least one associated second processing center processor, a method of assigning a processing request, comprising:

determining, at a traffic distribution controller of the first processing center, a capacity of each of the second processing centers to process the processing request, including determining a current capacity of each second processing center processor to process the processing request;

receiving the processing request from a client in the first processing center; and

assigning the processing request to at least one second processing center processor according to the determined current capacity of the at least one of the second processing center processor, comprising;

commanding, by the traffic distribution controller, a modification of processor assignment information of the second processing center associated with the assigned at least one second processing center processor according to the determined capacity of each processor of the second processing center to process the processing request;

wherein a global address of the assigned at least one second processing center processor is transmitted from the second processing center associated with the assigned at least one second processing center processor to the client, and the at least one second processing center processor receives the processing request from the client at the global address of the at least one second processing center processor.

2. The method of claim 1, wherein:

the processing request is addressed to a first global address comprising a first canonical name (CNAME) of a domain; and

assigning the processing request comprises readdressing the processing request from the first global address to the global address of the assigned at least one second processing center processor, wherein the global address of the assigned at least one second processing center processor comprises a second domain name.

3. The method of claim 1, wherein the step of determining the current capacity of each of the second processing centers comprises the steps of:

determining, in a load determining agent (LDA) executing at each of the second processing centers, the processing load of each of the processing centers, wherein the load comprises a set of one or more measured values respectively associated with one or more processing parameters;

reporting the load of each of the second processing centers from each respective load determining agent to the traffic distribution controller;

determining, in the traffic distribution controller, a limit comprising a set of one or more threshold values corresponding to the one or more processing parameters; and

determining, in the traffic distribution controller, the current capacity of each of the second processing centers to process the processing request based on a comparison of the limit and the reported load of each of the second processing centers.

4. The method of claim 3, wherein the one or more processing parameters include:

a number of clients currently serviced by the second processing center;

bandwidth utilization of the second processing center;

memory utilization of the second processing center; and

processing utilization of the second processing center.

5. The method of claim 3, wherein:

each of the second processing centers are executing one or more applications; and

the one or more processing parameters include a response latency of at least one of the one or more executing applications.

6. The method of claim 5, wherein at least one of the measured values of the one or more processing parameters are determined by performing steps comprising:

polling the executing applications in each of the second processing centers; and

generating the processing load of each of the second processing centers from the polled executing applications.

7. The method of claim 5:

wherein the response latency is measured by performing steps comprising;

transmitting a test request to the at least one of the one or more executing applications;

measuring a time required for the at least one of the one or more executing applications to respond to the transmitted test request;

wherein the number of connections is measured by performing steps comprising;

establishing a secure remote login to the second processing center; and

reading the number of clients currently serviced by the second processing center;

wherein the second processing center includes network devices, and the bandwidth utilization of the processing center is measured by performing steps comprising;

monitoring network equipment used at the second processing center;

wherein the memory utilization of the second processing center is measured by performing steps comprising;

establishing a secure remote login to the second processing center; and

reading memory utilization of the second processing center;

wherein processing utilization of the second processing center is measured by performing steps comprising;

establishing a secure remote login to the second processing center; and

reading the processing utilization of the second processing center.

8. The method of claim 1, wherein each of the plurality of second processing centers are third-party vendor point of presence (POP) processing centers commercially distinct from the first processing center and contracted to accept and process the processing request for the first processing center.

9. The method of claim 1, wherein:

the processor assignment information comprises at least one second processing center processor domain name; and

the processor assignment information is modified to remove or add the at least one second processing center processor domain name according to the current capacity of each second processing center processor.

10. A processing system comprising:

a first processing center, for accepting a processing request from a client;

one or more second processing centers remote from the first processing center, each of the second processing centers comprising an associated second processing center processor; and

a traffic distribution controller, disposed external to the one or more second processing centers, for determining a capacity of each of the second processing centers to process the processing request, including determining a current capacity of each second processing center processor associated with each second processing center to process the processing request and for assigning the processing request to at least one second processing center processor according to the determined current capacity of the second processing center processor associated with each of the second processing centers, by commanding a modification of processor assignment information of the second processing center associated with the assigned at least one second processing center processor according to the determined current capacity of the assigned at least one second processing center processor to process the processing request;

wherein a global address of the assigned at least one second processing center processor is transmitted from second processing center associated with the assigned at least one second processing center processor to the client, and the at least one second processing center processor receives the processing request from the client at the global address of the at least one second processing center processor.

11. The processing system of claim 10, wherein:

the processing request is addressed to a first global address comprising a first canonical name (CNAME) of a domain; and

the processing request is assigned by readdressing the processing request from the first global address to the global address of the assigned at least one second processing center processor, wherein the global address of the assigned at least one second processing center processors comprises a second domain name.

12. The processing system of claim 10, wherein:

the processing system further comprises a load determining agent, executing at each of the second processing centers, for determining the processing load of each of the second processing centers, wherein the load comprises a plurality of measured values of respective processing parameters, and for reporting the load of each of the second processing centers from the associated load determining agent to the traffic distribution controller; and

the traffic distribution controller further determines a limit set comprising threshold values for each of the processing parameters and determines the current capacity of each of the second processing centers to process the processing request from the limit set and the reported load for each of the second processing centers.

13. The processing system of claim 12, wherein the one or more processing parameters include:

a number of clients currently serviced by the second processing center;

bandwidth utilization of the second processing center;

memory utilization of the second processing center; and

processing utilization of the second processing center.

14. The processing system of claim 12, wherein:

each of the second processing centers are executing one or more applications; and

the one or more processing parameters include a response latency of at least one of the one or more executing applications.

15. The processing system of claim 14, wherein the load determining agent comprises a module for determining at least one of the measured values of the processing parameters, the module including:

a monitoring module for polling the executing applications in each of the second processing centers; and

a processing load module for generating the processing load of each of the second processing centers from the polled executing applications.

16. The processing system of claim 15, wherein:

the monitoring module transmits a test request to the at least one of the one or more executing applications; and

the processing load module measures a time required for the at least one of the one or more executing applications to respond to the transmitted test request.

17. The processing system of claim 15, wherein the monitoring module establishes a secure remote login to the second processing center and reads the number of clients currently serviced by the processing center.

18. The processing system of claim 15, wherein the monitoring module monitors a network device used at the second processing center.

19. The processing system of claim 15, wherein the monitoring module establishes a secure remote login to the processing center and reads memory utilization of the second processing center.

20. The processing system of claim 15, wherein the monitoring module establishes a secure remote login to the second processing center and reads the processing utilization of the processing center.

21. The processing system of claim 10, wherein each of the plurality of second processing centers are third-party vendor point of presence (POP) processing centers commercially distinct from the first processing center and contracted to accept and process processing requests for the first processing center.

22. The processing system of claim 10, wherein:

the processor assignment information comprises at least one second processing center processor domain name, and processor assignment information is modified to remove or add the at least one second processing center processor domain name of according to the current capacity of each second processing center processor.