SYSTEM AND METHOD FOR PERFORMING FLASH CROWD CACHING OF DYNAMICALLY GENERATED OBJECTS IN A DATA COMMUNICATION NETWORK

• US 20110145330A1
• Filed: 02/22/2011
• Published: 06/16/2011
• Est. Priority Date: 12/30/2005
• Status: Active Grant

• Current Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Original Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Inventors: SUNDARRAJAN, PRABAKAR, K.R, Bharath Bushan, Kailash, Kailash, Sinha, Rajiv, Kumar, Anil, Soni, Ajay, Khemani, Prakash, Annamalaisami, Saravana
• Granted Patent: US 8,499,057 B2
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching

Abstract

The present invention is directed towards a “flash crowd” technique for handling situations where the cache receives additional requests, e.g., nearly simultaneous requests, for the same object during the time the server is processing and returning the response object for a first requestor. Once all such nearly simultaneous requests are responded to by the cache, the object is flushed from the cache, with no additional expiry time or invalidation action needed. This technique of the present invention enables data to be cached and served for very small amounts of time for objects that would otherwise be considered non-cacheable. As such, this technique yields a significant improvement in applications that serve fast changing data to a large volume of concurrent users, such, for example, as real time stock quotes, or a fast evolving news story.

Claims

1. A method for responding, by a device intermediary to a server and a plurality of clients,

to a plurality of requests from different clients using a single response from the server, the method comprising:

(a) forwarding, by a device intermediary to a server and a plurality of clients, a first request for a dynamically generated object from a first client to the server;

(b) receiving, by the device prior to transmitting to the first client a response to the first request from the server, a plurality of requests from different clients for the dynamically generated object requested by the first request;

(c) holding, by the device, the plurality of requests while waiting for the response to the first request for the dynamically generated object;

(d) transmitting, by the device responsive to the receiving the response from the server to the first request, the response to the first client, the response comprising the dynamically generated object; and

(e) transmitting, by the device responsive to the receiving the response from the server to the first request, responses to each of the plurality of requests using the dynamically generated object from the response to the first request.

2. The method of claim 1, wherein step (a) further comprises forwarding, by the device, the first request from the client responsive to determining the dynamically generated object is not in a cache of the device.

3. The method of claim 1, wherein step (a) further comprises forwarding, by the device, the first request from the client responsive to determining the dynamically generated object in a cache of the device is about to expire.

4. The method of claim 1, wherein step (a) further comprises forwarding, by the device, the first request from the client responsive to the determining the dynamically generated object is in a cache of the device is expired.

5. The method of claim 1, wherein step (b) further comprises receiving, by the device, the plurality of requests while waiting for the response to the first request from the server.

6. The method of claim 1, wherein step (b) further comprises receiving, by the device, the plurality of requests while the response is being transmitted from the server.

7. The method of claim 1, wherein step (b) further comprises receiving, by the device, the plurality of requests while the response is received by the device but not yet transmitted to the first client.

8. The method of claim 1, wherein step (c) further comprises not forwarding the plurality of requests to the server.

9. The method of claim 1, wherein step (c) further comprises identifying that the dynamically generated object has already been requested in connection with the first request.

10. The method of claim 1, wherein step (e) further comprises transmitting, by the device, the responses without storing the dynamically generated object in a cache of the device.

11. A system for responding to a plurality of requests from different clients using a single response from a server, the system comprising:

a device intermediary to a server and a plurality of clients,

a packet engine of the device forwarding a first request for a dynamically generated object from a first client to the server;

wherein the device receives prior to transmitting to the first client a response to the first request from the server, a plurality of requests from different clients for the dynamically generated object requested by the first request; and

wherein the packet engine holds the plurality of requests while waiting for the response to the first request for the dynamically generated object and

wherein the packet engine responsive to receiving the response comprising the dynamically generated object from the server to the first request, transmits the response to the first client and transmits responses to each of the plurality of requests using the dynamically generated object from the response to the first request.

12. The system of claim 11, wherein the device forwards the first request from the client responsive to determining the dynamically generated object is not in a cache of the device.

13. The system of claim 11, wherein the packet engine forwards the first request from the client responsive to determining the dynamically generated object in a cache of the device is about to expire.

14. The system of claim 11, wherein the packet engine forwards the first request from the client responsive to the determining the dynamically generated object is in a cache of the device is expired.

15. The system of claim 11, wherein device receives the plurality of requests while waiting for the response to the first request from the server.

16. The system of claim 11, wherein device receives the plurality of requests while the response is being transmitted from the server.

17. The system of claim 11, wherein device receives the plurality of requests while the response is received by the device but not yet transmitted to the first client.

18. The system of claim 11, wherein the packet engines does not forward the plurality of requests to the server.

19. The system of claim 11, wherein the packet engine identifies that the dynamically generated object has already been requested in connection with the first request.

20. The system of claim 11, wherein the packet engine transmits the responses without storing the dynamically generated object in a cache of the device.