Layered request processing with redirection and delegation in a content delivery network (CDN)

• US 9,749,191 B2
• Filed: 03/13/2013
• Issued: 08/29/2017
• Est. Priority Date: 12/13/2012
• Status: Active Grant

• Current Assignee: Sandpiper CDN, LLC (Theseus LF Asset Holdings, LLC)
• Original Assignee: Level 3 Communications LLC (Lumen Technologies, Inc.)
• Inventors: Varney, Lewis Robert, Lipstone, Laurence R., Crowder, William, Swart, Andrew, Newton, Christopher
• Primary Examiner(s): Srivastava, Vivek
• Assistant Examiner(s): Khan, Atta
• Application Number:
  US13/802,489
• Publication Number:
  US 20140173054A1
• Time in Patent Office: 1,630 Days
• Field of Search: 709219
• CPC Class Codes: G06F 12/0808 with cache invalidating means G06F12/0815 takes precedence
• CPC Class Codes: G06F 15/173 using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
• CPC Class Codes: G06F 15/177 Initialisation or configuration control processor initialisation G06F9/4405
• CPC Class Codes: G06F 9/5055 considering software capabilities, i.e. software resources associated or available to the machine
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 41/0813 characterised by the conditions triggering a change of settings
• CPC Class Codes: H04L 41/0816 the condition being an adaptation, e.g. in response to network events
• CPC Class Codes: H04L 41/0823 characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability for optimising operational conditions of wireless networks H04W24/02
• CPC Class Codes: H04L 41/0869 Validating the configuration within one network element
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/50 Network service management, e.g. ensuring proper service fulfilment according to agreements
• CPC Class Codes: H04L 41/5041 characterised by the time relationship between creation and deployment of a service
• CPC Class Codes: H04L 41/509 wherein the managed service relates to media content delivery, e.g. audio, video or TV
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 43/10 Active monitoring, e.g. heartbeat, ping or trace-route
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/83 based on usage prediction
• CPC Class Codes: H04L 61/10 of different types
• CPC Class Codes: H04L 61/2503 : Translation of Internet protocol [IP] addresses
• CPC Class Codes: H04L 61/4511 : using domain name system [DNS]
• CPC Class Codes: H04L 61/4535 : using an address exchange platform which sets up a session between two nodes, e.g. rendezvous servers, session initiation protocols [SIP] registrars or H.323 gatekeepers
• CPC Class Codes: H04L 61/58 : Caching of addresses or names
• CPC Class Codes: H04L 65/403 : Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/60 : Network streaming of media packets
• CPC Class Codes: H04L 67/01 : Protocols
• CPC Class Codes: H04L 67/06 : specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1078 : Resource delivery mechanisms
• CPC Class Codes: H04L 67/2885 : Hierarchically arranged intermediate devices, e.g. for hierarchical caching
• CPC Class Codes: H04L 67/289 : Intermediate processing functionally located close to the data consumer application, e.g. in same machine, in same home or in same sub-network
• CPC Class Codes: H04L 67/51 : Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04L 67/55 : Push-based network services
• CPC Class Codes: H04L 67/568 : Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 67/5682 : Policies or rules for updating, deleting or replacing the stored data
• CPC Class Codes: H04L 67/60 : Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70
• CPC Class Codes: H04L 69/03 : Protocol definition or specification protocol conformance testing H04L1/244

Abstract

In a content delivery network (CDN) a method includes: receiving a request for a CDN service of a first type, wherein a CDN service of the first type defines a fixed number of configurable layers of request processing, sequentially from a first layer to a last layer; and processing the request, starting at the first layer, the processing being based on a modifiable runtime environment, the processing continuing conditionally through each of the layers in turn until either the request is terminated by one of the layers or the last layer processes the request. A layer may cause some of the processing of a request to be handled by another service. The CDN service may be selected from: delivery services, collector services, reducer services, rendezvous services, configuration services, and control services.

Claims

1. A computer-implemented method operable in a content delivery network (CDN), and operable on a device comprising hardware including memory and at least one processor, the method comprising:

(A) at a first CDN service instance of a first type, receiving a request for a CDN service of said first type, wherein a CDN service instance of said first type defines a number of configurable layers of request processing, from a first layer to a last layer;

(B) said first CDN service instance processing said request, starting at said first layer, said processing being based on a modifiable runtime environment comprising;

(i) a control environment, wherein said control environment is not a function of said request initially received in (A), and wherein said control environment is not modifiable by said layers, and (ii) a modifiable request environment, wherein said modifiable request environment for said first layer is based on said request initially received in (A), and wherein each particular layer after said first layer receives said modifiable request environment from a particular prior layer of said number of configurable layers, and wherein, for each particular layer after said first layer said modifiable request environment is based on the modifiable request environment received by said particular prior layer of said particular layer,

and wherein processing of said request by one of said layers comprises;

(B)(1) causing at least some of said request to be processed by a second CDN service instance, wherein the causing in (B)(1) comprises;

(B)(1)(a) redirecting the request to said second CDN service instance, and

wherein the request initially received in (A) is from a client, and wherein said redirecting in (B)(1)(a) causes said client to make said request to said second CDN service instance, and

wherein the first layer determines the modifiable request environment from information associated with the request initially received in (A), and wherein each subsequent layer obtains the modifiable request environment from a previous layer.

2. The method of claim 1 wherein said first CDN service instance redirects the request in (B)(1)(a) as modified by previous processing.

3. The method of claim 1 wherein the request initially received in (A) is an initial HTTP request.

4. The method of claim 2 wherein the at least some of the request in (B)(1) comprises a modified HTTP request, distinct from said initial HTTP request.

5. The method of claim 1 wherein the causing in (B)(1) comprises:

(B)(1)(a) delegating at least some of the request to said second CDN service instance.

6. The method of claim 5 further comprising, responsive to said delegating, obtaining a response from said second CDN service instance.

7. The method of claim 6 wherein subsequent processing of said request by said first CDN service instance uses said response obtained from said second CDN service instance.

8. The method of claim 7 wherein said first CDN service instance composes a response to said request based on said response obtained from said second CDN service instance.

9. The method of claim 5 wherein the causing in (B)(1) also comprises:

(B)(1)(b) delegating at least some of the request to a third CDN service instance.

10. The method of claim 9 further comprising, responsive to said delegating in (B)(1)(b), obtaining a second response from said second CDN service in stance.

11. The method of claim 10 wherein said first CDN service instance composes a response to said request based on said response obtained from said second CDN service instance and on said second response obtained from said second CDN service instance.

12. The method of claim 9 wherein said delegating in (B)(1)(a) and said delegating in (B)(1)(b) occur in parallel.

13. The method of claim 1 wherein said second CDN service instance is of the same type as the first CDN service instance.

14. The method of claim 1 wherein the second CDN service instance is an external service instance.

22. The method of claim 1 wherein said request for said CDN service comprises a request for a streaming service.

26. The method of claim 1 wherein at least one layer modifies said modifiable request environment.

27. The method of claim 1 wherein said modifiable request environment comprises one or more name, value assignments.

28. The method of claim 27 wherein at least one of said layers modifies at least one of said name, value assignments in said modifiable request environment.

15. A computer-implemented method operable in a content delivery network (CDN), and operable on a device comprising hardware including memory and at least one processor, the method comprising:

(A) at a first CDN service instance of a first type, receiving a request for a CDN service of said first type, wherein a CDN service of said first type defines a number of configurable layers of request processing, from a first layer to a last layer;

(B) said first CDN service instance processing said request, starting at said first layer, said processing being based on a modifiable runtime environment comprising;

(i) a control environment, wherein said control environment is not a function of said request initially received in (A), and wherein said control environment is not modifiable by said layers, and (ii) a modifiable request environment, wherein said modifiable request environment for said first layer is based on said request initially received in (A), and wherein each particular layer after said first layer receives said modifiable request environment from a particular prior layer of said number of configurable layers, and wherein, for each particular layer after said first layer said modifiable request environment is based on the modifiable request environment received by said particular prior layer of said particular layer, and wherein processing of said request by subsequent layers is based on said modifiable request environment, as modified by processing of said request, and wherein processing of said request by one of said layers comprises;

(B)(1) causing at least some of said request to be processed, at least in part, by at least one other CDN service, wherein the causing in (B)(1) comprises;

(B)(1)(a) redirecting the request to said second CDN service instance, and wherein the request initially received in (A) is from a client, and wherein said redirecting in (B)(1)(a) causes said client to make said request to said second CDN service instance, and

wherein the first layer determines the modifiable request environment from information associated with the request initially received in (A), and wherein each subsequent layer obtains the modifiable request environment from a previous layer.

16. The method of claim 15 wherein said causing in (B)(1) comprises one of:

(i) delegating said at least some of said request to said at least one other CDN service; and

(ii) causing said at least some of said request to be redirected to said at least one other CDN service.

17. The method of claim 16 wherein when said causing in (B)(1) comprises delegating said at least some of said request to said at least one other CDN service, said method further comprises:

receiving at least one response from said at least one other CDN service;

composing a response to said request received in (A) based on said at least one response received from said at least one other CDN service.

23. The method of claim 15 wherein said request for said CDN service comprises a request for a streaming service.

18. A device operable in a content delivery network (CDN), the device comprising:

(a) hardware including memory and at least one processor, and

(b) a service running on said hardware, wherein said service is configured to;

(A) receive a request for a CDN service of said first type, wherein a CDN service of said first type defines a number of configurable layers of request processing, sequentially from a first layer to a last layer;

(B) process said request, starting at said first layer, said processing being based on a modifiable runtime environment comprising;

(i) a control environment, wherein said control environment is not a function of said request initially received in (A), and wherein said control environment is not modifiable by said layers, and (ii) a modifiable request environment, wherein said modifiable request environment for said first layer is based on said request initially received in (A), and wherein each particular layer after said first layer receives said modifiable request environment from a particular prior layer of said number of configurable layers, and wherein, for each particular layer after said first layer said modifiable request environment is based on the modifiable request environment received by said particular prior layer of said particular layer, and wherein processing of said request by one of said layers comprises;

(B)(1) causing at least some of said request to be processed by a second CDN service, wherein the causing in (B)(1) comprises;

(B)(1)(a) redirecting the request to said second CDN service instance, and

wherein the request initially received in (A) is from a client, and wherein said redirecting in (B)(1)(a) causes said client to make said request to said second CDN service instance, and

wherein the first layer determines the modifiable request environment from information associated with the request initially received in (A), and wherein each subsequent layer obtains the modifiable request environment from a previous layer.

19. A system comprising at least two devices of claim 18.

20. A content delivery network (CDN) comprising at least two devices of claim 18.

24. The device of claim 18 wherein said request for said CDN service comprises a request for a streaming service.

21. An article of manufacture, comprising non-transitory computer-readable media having computer readable instructions stored thereon, the computer readable instructions including instructions for implementing a computer-implemented method, said method operable in a content delivery network (CDN) and operable on a device comprising hardware including memory and at least one processor and running a service on said hardware, said method comprising:

(A) at a first CDN service instance of a first type, receiving a request for a CDN service of said first type, wherein a CDN service of said first type defines a number of configurable layers of request processing, from a first layer to a last layer;

(B) said first CDN service instance processing said request, starting at said first layer, said processing being based on a modifiable runtime environment comprising;

(i) a control environment, wherein said control environment is not a function of said request initially received in (A), and wherein said control environment is not modifiable by said layers, and (ii) a modifiable request environment, wherein said modifiable request environment for said first layer is based on said request initially received in (A), and wherein each particular layer after said first layer receives said modifiable request environment from a particular prior layer of said number of configurable layers, and wherein, for each particular layer after said first layer said modifiable request environment is based on the modifiable request environment received by said particular prior layer of said particular layer, and wherein processing of said request by one of said layers comprises;

(B)(1) causing at least some of said request to be processed by a second CDN service instance, wherein the causing in (B)(1) comprises;

(B)(1)(a) redirecting the request to said second CDN service instance, and

wherein the request initially received in (A) is from a client, and wherein said redirecting in (B)(1)(a) causes said client to make said request to said second CDN service instance, and

wherein the first layer determines the modifiable request environment from information associated with the request initially received in (A), and wherein each subsequent layer obtains the modifiable request environment from a previous layer.

25. The computer program product of claim 21 wherein said request for said CDN service comprises a request for a streaming service.