Method, apparatus, and computer program product for server bandwidth utilization management

• US 6,424,993 B1
• Filed: 05/26/1999
• Issued: 07/23/2002
• Est. Priority Date: 05/26/1999
• Status: Expired due to Term

• Current Assignee: Intellectual Ventures I LLC (Intellectual Ventures LLC)
• Original Assignee: Respondtv, Inc
• Inventors: Weber, Jay C.
• Primary Examiner(s): Meky, Moustafa M.
• Application Number:
  US09/320,010
• Time in Patent Office: 1,154 Days
• Field of Search: 709/200, 709/201, 709/202, 709/203, 709/206, 709/217, 709/218, 709/219, 709/223, 709/224, 709/233, 709/235, 709/225
• US Class Current: 709/203
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 47/15 in relation to multipoint traffic arrangements for broadcast or multicast in data networks H04L12/18
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/741 Holding a request until resources become available
• CPC Class Codes: H04L 47/826 Involving periods of time
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1004 Server selection for load balancing
• CPC Class Codes: H04L 69/28 Timers or timing mechanisms used in protocols
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A system for management of communications bandwidth utilization is disclosed in which delays are deliberately introduced when responding to requests for resources. Appropriately introducing delays can disperse the peak bandwidth consumption event over a longer period, however peak bandwidth utilization is decreased when responding to numerous substantially simultaneous requests. The deliberately introduced delays can be generated in a range bounded above by an acceptable response time (“ART”). The ART may be communicated to a server as part of the request, for instance in the ‘port’ or ‘path’ portion of a URI.

Claims

1. A computer-implemented method for managing bandwidth utilization by a server in fulfilling requests for resources, said method comprising:

receiving a request for a resource;

generating a delay value, said delay value less than an acceptable response time;

delaying fulfillment of said request by a predetermined time period, for reducing instantaneous bandwidth utilization by said server; and

thereafter fulfilling said request for said resource.

2. The method according to claim 1 wherein said delaying step comprises:

waiting for a time interval at least as great as said delay value to elapse.

3. The method according to claim 2 wherein said delay value is an element of a sequence distributed substantially uniformly between zero and said acceptable response time.

4. The method according to claim 3 wherein said sequence is a pseudo-random sequence.

5. The method according to claim 3 wherein said acceptable response time is received with said request.

6. The method according to claim 5 wherein said acceptable response time is determined by a port through which the request arrives.

7. The method according to claim 5 wherein said request comprises a path identifying said resource and said path comprises said acceptable response time.

8. The method according to claim 1 wherein receiving a request for a resource comprises:

receiving a request for a resource with a request dispatch process;

determining a delay value, said delay value determined with said request dispatch process; and

dispatching said request and said delay value to a request handling process for handling.

22. The computer program product according to claim 3 wherein said acceptable response time is received with said request.

23. The computer program product according to claim 22 wherein said acceptable response time is determined by a port through which the request arrives.

24. The computer program product according to claim 22 wherein said request comprises a path identifying said resource and said path comprises said acceptable response time.

9. An apparatus comprising a processor, a memory, a network interface, and a file system, programmed instructions configuring said apparatus to accept connections in order to service requests by sending responses thereto, said apparatus further configured with programmed instructions comprising:

a request receiver configured for receiving a request for a resource;

a delay value generator configured for generating a delay value, said delay value less than an acceptable response time;

a response fulfillment delayer configured for delaying fulfillment of said request by a predetermined time period; and

a request handler configured for fulfilling said request for said resource.

10. The apparatus according to claim 9 wherein said response fulfillment delayer comprises:

a timer configured for waiting for a time interval at least as great as said delay value to elapse.

11. An apparatus according to claim 10 wherein said delay value is an element of a sequence distributed substantially uniformly between zero and said acceptable response time.

12. The method according to claim 10 wherein said sequence is a pseudo-random sequence.

13. An apparatus according to claim 12 wherein said acceptable response time is received with said request.

14. An apparatus according to claim 13 wherein said acceptable response time is determined by a port through which the request arrives.

15. An apparatus according to claim 13 wherein said request comprises a path identifying said resource and said path comprises said acceptable response time.

16. The method according to claim 10 wherein said request receiver comprises:

a request receiver configured for receiving a request for a resource with a request dispatch process;

a delay value determiner configured for determining a delay value with said request dispatch process; and

a request dispatcher configured for providing said request and said delay value to a request handling process.

17. A computer program product comprising a computer-readable medium having computer readable instructions encoded thereon for server bandwidth utilization management, comprising:

computer program instructions configured to cause a computer to receive a request for a resource;

computer program instructions configured to cause a computer to generate a delay value, said delay value less than an acceptable response time;

computer program instructions configured to cause a computer to delay fulfillment of said request by a predetermined time period; and

computer program instruction configured to cause a computer to fulfill said request for said resource after expire of said predetermined time period.

18. The computer program product according to claim 17 wherein said delaying step comprises:

computer program instructions configured to cause a computer to wait for a time interval at least as great as said delay value to elapse.

19. The computer program product according to claim 18 wherein said delay value is an element of a sequence distributed substantially uniformly between zero and said acceptable response time.

20. The computer program product according to claim 19 wherein said sequence is a pseudo-random sequence.

21. The computer program product according to claim 17 wherein said computer program instructions configured to cause a computer to receive a request for a resource comprises:

computer program instructions configured to cause a computer to receive a request for a resource with a request dispatch process;

computer program instructions configured to cause a computer to determine a delay value, said delay value determined with said request dispatch process; and

computer program instructions configured to cause a computer to dispatch said request and said delay value to a request handling process for handling.

25. A method for managing bandwidth utilization by a server in fulfilling requests for resources, said method comprising:

transmitting an identifier of a resource available on a server to a client, said identifier comprising an acceptable response time;

receiving a request for said resource from said client;

extracting said acceptable response time from said identifier; and

transmitting a response to said client after the expire of said acceptable response time.