Optimizing content management

• US 8,117,306 B1
• Filed: 09/29/2008
• Issued: 02/14/2012
• Est. Priority Date: 09/29/2008
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Baumback, Mark S., Bettis, David William, Jenkins, Jonathan A.
• Primary Examiner(s): Chang, Jungwon
• Application Number:
  US12/240,659
• Time in Patent Office: 1,233 Days
• Field of Search: 709/224, 709/245, 709/238, 709/239, 709/225, 709/203, 709/246, 709/217
• US Class Current: 709/224
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/0817 by checking functioning

Abstract

A system and method for monitoring the performance associated with fulfilling resource requests and determining optimizations for improving such performance are provided. A processing device obtains and processes performance metric information associated with processing a request for an original resource and any embedded resource. The processing device uses the processed performance metric information to determine a CDN service provider for alternatively hosting at least a portion of the original resource and/or any embedded resources. In some embodiments, in making such a determination, the processing device assesses performance metric information collected and associated with subsequent resource requests for the original resource and any embedded resources using each of a variety of alternative CDN service providers. The processing device may also consider CDN selection criteria obtained from the original content provider. Aspects of systems and methods for generating recommendations associated with monitoring the operation and performance of CDN service providers with respect to specific resource requests are also provided.

Claims

1. A system for monitoring performance associated with processing a resource request, the system comprising:

a client computing component associated with a client computing device, wherein the client computing component is operable to determine a first set of performance data associated with processing a resource request, wherein the resource request corresponds to one or more resources;

a performance measurement component associated with the client computing device, wherein the performance measurement component is operable to determine a second set of performance data associated with processing the resource request; and

a processing component operable to;

obtain, from the client computing component, the first set of performance data associated with processing the resource request;

obtain, from the performance measurement component, the second set of performance data associated with processing the resource request;

identify one or more content delivery networks to be utilized in conjunction with a subsequent resource request, wherein the one or more content delivery networks host content on behalf of a content provider and wherein the subsequent resource request corresponds to at least one of the one or more resources;

for each identified content delivery network;

cause an initiation of the subsequent resource request associated with the identified content delivery network;

obtain, from the client computing component and the performance measurement component performance data related to processing of the subsequent resource request using the identified content delivery network; and

dynamically determine a content delivery network based on the first and second sets of performance data and the performance data related to processing the subsequent resource request using each of the one or more identified content delivery networks.

2. The system as recited in claim 1, wherein the processing component is further operable to generate a recommendation to use the determined service provider to process a further subsequent request for at least one of the one or more resources.

3. The system as recited in claim 2, wherein the processing component is further operable to generate code for at least one of the one or more resources to be processed using the determined service provider.

4. The system as recited in claim 1, wherein the processing component is further operable to generate code for at least one of the one or more resources to be processed using the determined service provider.

5. The system as recited in claim 1, wherein dynamically determining a CDN, by the processing component, is further based on content delivery network selection criteria.

6. The system as recited in claim 5, wherein the content delivery network selection criteria includes CDN quality of service information.

7. The system as recited in claim 5, wherein the content delivery network selection criteria includes cost information associated with processing the subsequent resource request.

8. The system as recited in claim 1, wherein the processing component is further operable to obtain content delivery network selection criteria from the content provider.

9. A method comprising:

identifying two or more service providers to be utilized in conjunction with processing a request for at least one resource, wherein the two or more service providers host content on behalf of a content provider;

for each identified service provider;

causing an initiation of a request for the at least one resource to the identified service provider; and

obtaining performance data related to processing of the request using the identified service provider; and

dynamically determining a service provider from the identified two or more service providers based on the obtained performance data corresponding to processing the same at least one resource using each identified service provider.

10. The method as recited in claim 9, wherein the at least one resource corresponds to a first resource and one or more embedded resources.

11. The method as recited in claim 10, wherein the request is for the first resource and the one or more embedded resources.

12. The method as recited in claim 9, wherein the at least one resource corresponds to an embedded resource of another resource.

13. The method as recited in claim 9, wherein obtaining performance data related to processing of the request using each of the two or more identified service providers comprises:

for each of the two or more identified service providers;

obtaining, from a client computing component, performance data associated with a record identifier, wherein the performance data is associated with processing the request;

obtaining, from a performance measurement component, performance data associated with a record identifier, wherein the performance data is associated with processing the request and includes timing information as to the receipt of the first and last bytes of data for each embedded resource associated with the request; and

associating the performance data from the client computing component and the performance measurement component using the record identifier.

14. The method as recited in claim 9 further comprising generating a recommendation to use the determined service provider to process a subsequent request for the at least one resource and providing the recommendation to the content provider, wherein the content provider is the original content provider of the at least one resource.

15. The method as recited in claim 14 further comprising generating code for the at least one resource to be processed using the determined service provider.

16. The method as recited in claim 9 further comprising generating code for the at least one resource to be processed using the determined service provider.

17. The method as recited in claim 9, wherein dynamically determining a service provider is further based on service provider selection criteria.

18. The method as recited in claim 17, wherein the service provider selection criteria includes service provider quality of service information.

19. The method as recited in claim 17, wherein the service provider selection criteria includes cost information associated with processing the request.

20. The method as recited in claim 19, wherein dynamically determining a service provider comprises determining a service provider having a cost associated with processing the request that falls within a selected cost range.

21. The method as recited in claim 9 further comprising obtaining, from the content provider, service provider selection criteria.

22. The method as recited in claim 21, wherein dynamically determining a service provider is further based on the service provider selection criteria provided by the content provider.

23. The method as recited in claim 22, wherein the service provider selection criteria includes service provider quality of service information.

24. The method as recited in claim 22, wherein the service provider selection criteria includes cost information associated with processing the request.

25. A method comprising:

obtaining, from a client computing device, performance data associated with processing an original resource request initiated by the client computing device, wherein the resource request corresponds to one or more resources and wherein the original resource request is serviced by a content provider; and

dynamically identifying, based on the obtained performance data, one or more service providers to be utilized in conjunction with a subsequent resource request for at least one of the one or more resources originally provided by the content provider in response to the original resource request, wherein the one or more service providers host content on behalf of the content provider.

26. The method as recited in claim 25, wherein obtaining performance data associated with processing the requested resource comprises:

obtaining, from a client computing component, performance data associated with a record identifier, wherein the performance data is associated with processing the resource request;

obtaining, from a performance measurement component, performance data associated with a record identifier, wherein the performance data is associated with processing the resource request and includes timing information as to the receipt of the first and last bytes of data for each of the one or more resources; and

associating the performance data from the client computing component and the performance measurement component using the record identifier.

27. The method as recited in claim 25, wherein dynamically identifying one or more service providers to be utilized in conjunction with the subsequent resource request based on the obtained performance data comprises processing the obtained performance data and dynamically identifying one or more service providers to be utilized in conjunction with the subsequent resource request if the processed performance data fails to meet a predetermined level of performance.

28. The method as recited in claim 25, wherein dynamically identifying one or more service providers to be utilized in conjunction with the subsequent resource request is further based on service provider selection criteria.

29. The method as recited in claim 28, wherein the service provider selection criteria includes service provider quality of service information.

30. The method as recited in claim 28, wherein the service provider selection criteria includes cost information associated with processing the subsequent resource request.

31. The method as recited in claim 25 further comprising obtaining, from the content provider, service provider selection criteria, wherein dynamically identifying one or more service providers to be utilized in conjunction with the subsequent resource request is further based on the obtained service provider selection criteria.

32. The method as recited in claim 25 further comprising:

for each of the one or more identified service providers, enabling the one or more resources to be provided by the identified service provider.

33. The method as recited in claim 32, wherein enabling the one or more resources comprises translating one or more corresponding resource identifiers such that requests for the one or more resources are directed to the identified service provider.

34. The method as recited in claim 32, wherein enabling the one or more resources comprises providing the one or more resources to the identified service provider.

35. The method as recited in claim 25 further comprising:

for each identified service provider, causing an initiation of the subsequent resource request associated with the identified service provider.

36. The method as recited in claim 25 further comprising:

for each identified service provider, processing performance data from a client computing device, wherein the performance data is associated with processing the subsequent resource request using the identified service provider.

37. The method as recited in claim 36 further comprising providing a recommendation for processing a further subsequent resource request based on a comparison of the performance data associated with processing the resource request without use of one of the identified service providers with the performance data associated with processing the subsequent resource request using each of the identified one or more service providers, wherein the further subsequent resource request corresponds to at least one of the one or more resources.

38. The method as recited in claim 36 further comprising dynamically selecting a service provider based on the processed performance data.

39. The method as recited in claim 38, wherein dynamically selecting a service provider is further based on the performance data associated with processing the resource request without use of one of the identified service providers.

40. The method as recited in claim 38, wherein dynamically selecting a service provider is further based on service provider selection criteria.

41. The method as recited in claim 40, wherein the service provider selection criteria includes service provider quality of service information.

42. The method as recited in claim 40, wherein the service provider selection criteria includes cost information associated with processing the subsequent resource request.

43. A method comprising:

identifying one or more service providers to be utilized in conjunction with processing a request for at least one resource, wherein the one or more service providers host content on behalf of a content provider;

for each identified service provider;

causing an initiation of a request for the at least one resource to the identified service provider; and

obtaining performance data related to processing of the request using the identified service provider by;

obtaining, from a client computing component, performance data associated with a record identifier, wherein the performance data is associated with processing the request;

obtaining, from a performance measurement component, performance data associated with a record identifier, wherein the performance data is associated with processing the request and includes timing information as to the receipt of the first and last bytes of data for each embedded resource associated with the request; and

associating the performance data from the client computing component and the performance measurement component using the record identifier; and

dynamically determining a service provider based on the performance data.

44. A method comprising:

obtaining, from a client computing device, performance data associated with processing a resource request, wherein the resource request corresponds to one or more resources and wherein obtaining performance data associated with processing the requested resource comprises;

obtaining, from a client computing component, performance data associated with a record identifier, wherein the performance data is associated with processing the resource request;

obtaining, from a performance measurement component, performance data associated with a record identifier, wherein the performance data is associated with processing the resource request and includes timing information as to the receipt of the first and last bytes of data for each of the one or more resources; and

associating the performance data from the client computing component and the performance measurement component using the record identifier; and

dynamically identifying one or more service providers to be utilized in conjunction with a subsequent resource request, wherein the one or more service providers host content on behalf of a content provider and wherein the subsequent resource request corresponds to at least one of the one or more resources.