Methods and systems for managing network traffic

• US 7,680,897 B1
• Filed: 04/08/2003
• Issued: 03/16/2010
• Est. Priority Date: 04/08/2003
• Status: Expired due to Fees

• Current Assignee: RPX Corporation
• Original Assignee: Novell Incorporated (Open Text Corporation)
• Inventors: Carter, Stephen R, Major, Robert Drew
• Primary Examiner(s): Follansbee, John
• Assistant Examiner(s): Patel, Chirag R
• Application Number:
  US10/409,529
• Time in Patent Office: 2,534 Days
• Field of Search: 709/224, 709/217, 709/219, 709/226
• US Class Current: 709/217
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/762 triggered by the network
• CPC Class Codes: H04L 47/808 User-type aware
• CPC Class Codes: H04L 47/821 Prioritising resource allocation or reservation requests
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements

Abstract

Methods and systems for network traffic management are provided. A content distribution network application manages data in a cache. A network rate shaper application controls and manages requests for access to an external network connection. The content distribution network application determines priorities associated with requests and communicates these priorities to the rate shaper application. The rate shaper application adjusts access levels or data transfer rates for the requests based on the received priorities.

Claims

1. A computer-implemented method residing in a computer medium and processed by a computer to manage network traffic, comprising:

using, by the computer, a cache application to manage network traffic;

interfacing, by the computer, a content distribution network application with the cache application to assist in managing the network traffic, the content distribution network application analyzes patterns associated with the network traffic and analyzes requests for that network traffic to determine that certain types of data are to be acquired and pre-positioned in the cache before any first request is made for those types of data, the content distribution network application makes this determination based on a type of request and a type of data being requested with the requests, and at least some data is pre-positioned in response to a list provided from an administrator to the content distribution network application indicating that the data identified in the list is to be pre-positioned in the cache in accordance with a schedule that accompanies the list, and the types of data include media data, file data, Hypertext Transfer Protocol (HTTP) data, email data, and text data and the requests include a batch request, an external requestor request, and an external requestor request with a priority assigned already; and

interfacing, by the computer, a network rate shaper application with the content distribution network application to prioritize the network traffic for the content distribution network application, and the content distribution network application alters at least some priorities of the network traffic via interactions with the network rate shaper and in response the network rate shape reallocate resources that handles the network traffic, and the content distribution network application includes and is integrated with the network rate shaper application, and the priorities are also altered in response to existing policies associated with an external network connection that handles the network traffic, and content distribution network application accesses the existing policies, which include logic that determines in any given circumstance a particular priority for a particular request, to alter at least some of the priorities for the network traffic, the existing policies include factors for time of day for the network traffic, requestor of the network traffic, type of data being requested with the network traffic, and current processing load associated with the external network connection, the network rate shaper application knows allocations for the network traffic and external network connection policies and the network rate shaper application issues commands to the external network connection to reallocate and prioritize processing and bandwidth allocated within the external network connection, the external network connection links an internal network with one or more external networks, the rate shaper application is separate and distinct from the content distribution network application and is in direct communication with external network application and external network resources of the external network connection.

2. The method of claim 1 wherein in using the cache application, the cache application manages data in a cache that is made available to satisfy a network request without accessing an external network.

3. The method of claim 1 wherein in interfacing the content distribution network application, the content distribution network application, acquires data to populate a cache for the cache application in advance of a request made for the data.

4. The method of claim 3 wherein in interfacing the network rate shaper application, the content distribution network application directs the rate shaper application to decrease a data transfer rate associated with acquiring the data when an additional request for additional data is determined to have a higher priority.

5. The method of claim 4 wherein in interfacing the network rate shaper application, the content distribution network application directs the rate shaper application to increase the data transfer rate for the data when the data having a higher priority is finished processing.

6. The method of claim 1 wherein in interfacing the network rate shaper application, the content distribution network application alters data transfer and accesses the policies of the rate shaper application in order to prioritize the network traffic.

7. The method of claim 1 further comprising, receiving, by the computer, requests associated with the network traffic for access to an external network connection, wherein the requests are managed by the cache application, the content distribution network application, and the network rate shaper application.

8. The method of claim 1 further comprising, increasing, by the computer, an access throughput to an external network connection through the cooperation of the cache application, the content distribution network application, and the network rate shaper application.

9. A computer-implemented method residing in a computer medium and processed by a computer to manage network traffic, comprising:

identifying, by the computer, data frequently accessed over an external network connection, the data associated with media data, file data, Hypertext Transfer Protocol (HTTP) data, email data, and text data;

acquiring, by the computer, the data in advance of a first request over the external network and pre-positioning the data in a cache and at least some additional data is acquired in advance and in response to a list provided from an administrator indicating that the additional data identified in the list is to be pre-positioned in the cache in accordance with a schedule that accompanies the list, and;

altering, by the computer, an access rate of acquiring the data over the external network connection during the processing associated with acquiring the data in order to accommodate a second request having a higher priority to access the external network connection by reallocating resources associated with the external network connection, and allocation of the resources is directly related to bandwidth throughput/utilization associated with the external network connection, and altering the access rate also accounts for existing policies associated with the external network connection, the existing policies include factors for time of day for network traffic, requestors of the network traffic, type of data being requested with the network traffic, and current processing load associated with the external network connection.

10. The method of claim 9 wherein in identifying, the data is identified by determining that historical high frequency network traffic, which has occurred over the external network connection, is associated with the data.

11. The method of claim 9 wherein in acquiring a content distribution network application determines that the data is to be acquired in advance.

12. The method of claim 9 wherein in altering a content distribution network application assigns the higher priority to the second request.

13. The method of claim 12 wherein in altering, the content distribution network application directs a rate shaper application to decrease the access rate of acquiring the data and to increase a second access rate for the second request.

14. The method of claim 12 wherein in altering, the content distribution network application directs a rate shaper application to increase the access rate of acquiring the data when the second request is finished.

15. A network traffic management system, comprising:

an external network connection that is maintained via one or more hardware devices having software resources;

an internal network that is maintained via one or more other hardware devices with other software resources;

a content distribution network application implemented in a computer medium and to process on a computer and that manages, pre-acquires, and pre-positions data in a cache, the data is associated with information that natively resides on an external network and acquired via the external network connection, and the content distribution network application is to analyze patterns associated with network traffic and analyze requests for that network traffic to determine the data and pre-positioned the data in the cache before any first or initial request is made for that data and at least some data is also pre-positioned in response to a list provided from an administrator to the content distribution network application indicating that the data identified in the list is to be pre-positioned in the cache in accordance with a schedule that accompanies the list, and;

rate shaper application implemented in a computer medium and to process on the computer and that controls access from the internal network connection to the external network connection and alters access levels and existing policies based in part on directives received from the content distribution network application, and the content distribution network application is to also alter at least some priorities of the network traffic via interactions with the rate shaper application and in response the rate shape application reallocate resources that handles the network traffic, and the content distribution network application includes the rate shaper application and is integrated with the rate shaper application, and the rate shaper application also alters the priorities in response to the existing policies associated with the external network connection, and the existing policies include factors for time of day for the network traffic, requestor of the network traffic, type of data being requested with the network traffic, and current processing load associated with the external network connection, the content distribution network application and the rate shaper application cooperate and interface with one another to ensure the software resources of the external network connection are being fully utilized at capacity.

16. The system of claim 15, wherein the external connection is a network interface including at least one of an Asynchronous Transfer Mode (ATM) interface, Gigabit Ethernet (GigE) interface, Frame Relay (FR) interface, Time-Division Multiplexing (TDM) interface, and Integrates Services Digital Network Interface (ISDN).

17. The system of claim 15, wherein the content distribution network application communicates with a cache application in managing the cache.

18. The system of claim 15, wherein the content distribution network application identifies to the rate shaper application accesses associated with request processing, which are considered to be low priority accesses.

19. The system of claim 18, wherein the request accesses are associated with acquiring some of the data over the external connection in advance of having received a request for the data.

20. The system of claim 15, wherein the rate shaper application controls access at least in part based on network traffic policies associated with the external connection.

21. The system of claim 20, wherein the network traffic policies are known to the content distribution network application and used by the content distribution network application in order to issue the directives to the rate shaper application.

22. The system of claim 20, wherein the network traffic policies are temporarily suspended or altered based on a number of the directives received from the content distribution network application.

23. A computer-implemented method residing in a computer medium and processed on a computer for managing network traffic, comprising:

processing, by the computer, a content distribution network (CDN) application for assisting with the management of network traffic, and the CDN application analyzes patterns associated with network traffic and analyzes requests for that network traffic to determine data and pre-positioned the data in the cache before any first or initial request is made for that data and wherein at least some data is pre-positioned in response to a list provided from an administrator to the content distribution network application indicating that the data identified in the list is to be pre-positioned in the cache in accordance with a schedule that accompanies the list, and;

interfacing, by the computer, a network rate shaper application with the CDN application to prioritize the network traffic, and the CDN application alters at least some priorities of the network traffic via interactions with the network rate shaper application and in response the network rate shape application reallocates resources that handles the network traffic, and the CDN application includes the rate shaper application and is integrated with the rate shaper application, and the network rate shaper application also prioritizes the network traffic in response to existing policies associated with an external network connection that handles the network traffic, and the existing policies include factors for time of day for the network traffic, requestor of the network traffic, type of data being requested with the network traffic, and current processing load associated with the external network connection, the network rate shaper application cooperate and interface with one another to ensure that the resources of the external network connection are being fully utilized at capacity.

24. The method of claim 23 wherein interfacing the network rate shaper application further includes directing, by the CDN application, the network rate shaper application to decrease or increase data transfer rates based on priorities of received requests associated with the network traffic.

25. The method of claim 23 wherein interfacing the network rate shaper further includes altering, by the CDN application, at least one of data transfer rate policies and access policies associated with portions of the network traffic, wherein the data transfer rate and access policies are controlled by the network rate shaper application.

26. The method of claim 23 further comprising inspecting, by the CDN application via the computer, data types and types of requests associated with portions of the network traffic in order to adjust priorities of the network traffic.

27. The method of claim 23 further comprising, reallocating, by the network rate shaper application via the computer, resources associated with the network traffic based on directives issued by the CDN application.

28. A computer-implemented method residing in a computer medium and processed by a computer to manage network traffic, comprising:

inspecting, by a content distribution network (CDN) application via the computer, requests associated with an external network connection, and the inspection includes determining the types of data associated with the requests, and the types of data include media data, file data, Hypertext Transfer Protocol (HTTP) data, email data, and text data; and

directing, by the CDN application via the computer, a rate shaper application to adjust priorities and reallocate resources of the external network connection for network traffic associated with the requests based on the inspection performed by the CDN application, and the CDN application includes the rate shaper application and is integrated with the rate shaper application, and the rate shaper application also adjusts the priorities in response to existing policies associated with the external network connection, and the existing policies include factors for time of day for the network traffic, requestor of the network traffic, type of data being requested with the network traffic, and current processing load associated with the external network connection, and the rate shaper application is authorized to suspend the existing policies to ensure utilization on the external network connection is being maximized, and the rate shaper application forces some of the requests to be reassigned to a limited number of processing, memory, or port resources to ensure the utilization and in a manner that is contrary to the existing policies, the CDN application and the rate shaper application cooperate with one another to ensure that resources of the external network connection are being fully utilized at capacity.

29. The method of claim 28 wherein inspecting further includes, determining, by the CDN application, which of the requests have been submitted to the rate shaper application for processing, which of the requests have not yet been confirmed by the rate shaper application for processing, which of the requests that the rate shaper is currently processing, and which of the requests that the rate shaper has queued for subsequent processing.

30. The method of claim 28 wherein directing further includes, lowering, by the CDN application, a number of the priorities for some of the requests which are using a number of the resources associated with an external network connection where those requests are not actively communicating via the external network connection.

31. The method of claim 30 further comprising, reallocating, by the rate shaper application via the computer, a number of the resources associated with the external network connection to different ones of the requests which are actively attempting to communicate via the external network connection.

32. The method of claim 30 wherein directing further includes, adjusting, by the CDN application, the priorities in order to utilize a number of the resources which are being underutilized for purposes of increasing bandwidth associated with an external network connection.

33. A computer-implemented network traffic management system, comprising:

a content distribution network (CDN) application implemented in a computer medium and processed on a computer; and

a rate shaper application implemented in a computer medium and processed on the computer, the CDN application inspects requests associated with network traffic and priorities which are managed by the rate shaper application, and the CDN application adjusts the priorities in order to manage bandwidth to an external network connection, and the CDN application interacts with the rate shaper application to have the rate shaper application reallocate resources associated with the external network connection, and the CDN application includes the rate shaper application and is integrated with the rate shaper application, and the rate shaper application also adjusts the priorities in response to existing policies associated with the external network connection, and the existing policies include factors for time of day for the network traffic, requestor of the network traffic, type of data being requested with the network traffic, and current processing load associated with the external network connection, and the rate shaper application is authorized to suspend the existing policies to ensure utilization on the external network connection is being maximized, and the rate shaper application forces some of the requests to be reassigned to a limited number of processing, memory, or port resources to ensure the utilization and in a manner that is contrary to the existing policies, and the CDN application and the rate shaper application cooperate with one another to ensure that the resources of the external network connection and being fully utilized at full capacity.

34. The network traffic management system of claim 33 wherein the CDN application inspects data types associated with the requests to determine whether a number of the priorities need adjusting within the rate shaper application.

35. The network traffic management system of claim 33 wherein the CDN application inspects resources associated with the external network connection and adjusts a number of the priorities in the rate shaper application to increase utilization of those resources.

36. The network traffic management system of claim 33 wherein the CDN application adjust access policies for a number of the requests within the rate shaper application.

37. The network traffic management system of claim 33 wherein the CDN application temporarily suspends a number of traffic policies within the rate shaper to increase the bandwidth to the external network connection.