System and method for performing flash caching of dynamically generated objects in a data communication network

• US 8,255,456 B2
• Filed: 12/30/2005
• Issued: 08/28/2012
• Est. Priority Date: 12/30/2005
• Status: Active Grant

• Current Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Original Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Inventors: Sundarrajan, Prabakar, Khemani, Prakash, Kailash, Kailash, Soni, Ajay, Sinha, Rajiv, Annamalaisami, Saravana, Kumar, Anil, Bhushan KR, Bharath
• Primary Examiner(s): Nawaz, Asad M
• Assistant Examiner(s): Chang, Stephanie
• Application Number:
  US11/324,141
• Publication Number:
  US 20070156876A1
• Time in Patent Office: 2,433 Days
• Field of Search: 709/216, 709/223, 709/218, 709/229, 709/238, 709/242, 709/203, 709/219, 709/225, 709/231, 713/151, 726/15, 711/118, 711/206, 711/139, 718/100, 718/102
• US Class Current: 709/203
• CPC Class Codes: H04L 63/102 Entity profiles
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data

Abstract

The present invention is directed towards a method and system for providing a technique referred to as flash caching to respond to requests for an object, such as a dynamically generated object, from multiple clients. This technique of the present invention uses a dynamically generated object stored in a buffer for transmission to a client, for example in response to a request from the client, to also respond to additional requests for the dynamically generated object from other clients while the object is stored in the buffer. Using this technique, the present invention is able to increase cache hit rates for extremely fast changing dynamically generated objects that may not otherwise be cacheable.

Claims

1. A method for responding to a request for a non-cacheable dynamically generated object from a plurality of clients, the method comprising the steps of:

(a) receiving, by a device comprising a cache, a response from an originating server to a first request of a first client for a non-cacheable dynamically generated object, the response comprising the dynamically generated object;

(b) requesting, by the device, to a packet processing engine to transmit the response to the first client, the response held in a transmission buffer of a network stack of the device while waiting to be transmitted;

(c) receiving, by the device, from a second client a second request for the dynamically generated object while transmitting the response to the first client and prior to completing transmission of the response from the transmission buffer to the first client;

(d) requesting, by the device prior to completing transmission of the response from the transmission buffer to the first client, to the packet processing engine to transmit the dynamically generated object of the response to the first client held in the transmission buffer to the second client; and

(e) removing, by the device, the non-cacheable dynamically generated object from the transmission buffer.

2. The method of claim 1, comprising transmitting, by the packet processing engine, the response to the first client.

3. The method of claim 1, comprising transmitting, by the packet processing engine, the dynamically generated object to the second client in response to the second request.

4. The method of claim 1, comprising removing, by the packet processing engine, the response from the transmission buffer after transmitting the response to one of the first client or the second client.

5. The method of claim 1, wherein the transmission buffer comprises one of a TCP/IP buffer or a portion of a TCP/IP stack of the device.

6. The method of claim 1, wherein the device comprises a single TCP/IP stack for transmitting to the first client and the second client, the transmission buffer associated with the single TCP/IP stack.

7. The method of claim 1, wherein step (c) further comprises receiving, by the device, from a plurality of clients a plurality of requests for the dynamically generated object, and wherein step (d) further comprises requesting, by the device, to transmit the dynamically generated object of the response to the first client held in the transmission buffer to the plurality of clients.

8. The method of claim 1, comprising holding, by the packet processing engine, the response to the first client based on one or more characteristics related to a connection of the first client to a network.

9. The method of claim 1, comprising queuing, by the device, the second request.

10. The method of claim 1, comprising removing the dynamically generated object from the transmission buffer after transmitting the dynamically generated object to the first client and the second client.

11. The method of claim 1, wherein the dynamically generated object is identified as non-cacheable.

12. The method of claim 1, comprising determining, by the device, the second request is for the dynamically generated object of the first request via an object determinant associated with the second request.

13. The method of claim 1, wherein the device comprises one of an appliance, a network device or a computing device in communication between the first client and the originating server.

14. The method of claim 1, wherein the device comprises a cache in communication with the packet processing engine.

15. The method of claim 14, comprising requesting, by the cache, the packet processing engine to transmit one of the response to the first client or the dynamically generated object of the first client to the second client.

16. A system for responding to a request for a non-cacheable dynamically generated object from a plurality of clients, the system comprising:

a device comprising a cache receiving a response from an originating server to a first request of a first client for a non-cacheable dynamically generated object, the response comprising the dynamically generated object, the device comprising;

a transmission buffer of a network stack of the device for holding one or more network packets waiting to be transmitted from the device;

a packet processing engine receiving a request from the device to transmit the response to the first client from the transmission buffer, the transmission buffer holding one or more network packets comprising the response; and

wherein the device receives from a second client a second request for the dynamically generated object while transmitting the response to the first client and prior to completing transmission of the response from the transmission buffer to the first client;

requests, prior to completing transmission of the response from the transmission buffer to the first client, the packet processing engine to transmit the dynamically generated object of the response held in the transmission buffer to the second client; and

removes the non-cacheable dynamically generated object from the transmission buffer.

17. The system of claim 16, wherein the packet processing engine transmits from the transmission buffer the response to the first client.

18. The system of claim 16, wherein the packet processing engine transmits from the transmission buffer the dynamically generated object to the second client in response to the second request.

19. The system of claim 16, wherein the packet processing engine removes the response from the transmission buffer after transmitting the response to one of the first client or the second client.

20. The system of claim 16, wherein the transmission buffer comprises one of a TCP/IP buffer or a portion of a TCP/IP stack of the device.

21. The system of claim 16, wherein the device comprises a single TCP/IP stack for transmitting to the first client and the second client, the transmission buffer associated with the single TCP/IP stack.

22. The system of claim 16, wherein the device receives from a plurality of clients a plurality of requests for the dynamically generated object, and wherein the device requests the packet processing engine to transmit the dynamically generated object of the response to the first client held in the transmission buffer to the plurality of clients.

23. The system of claim 16, wherein the packet processing engine holds the response to the first client based on one or more characteristics related to a connection of the first client to a network.

24. The system of claim 16, wherein the device queues the second request.

25. The system of claim 16, wherein the packet processing engine remove the dynamically generated object from the transmission buffer after transmitting the dynamically generated object to the first client and the second client.

26. The system of claim 16, wherein the dynamically generated object is identified as non-cacheable.

27. The system of claim 16, comprising determining, by the device, the second request is for the dynamically generated object of the first request via an object determinant associated with the second request.

28. The system of claim 16, wherein the device comprises one of an appliance, a network device or a computing device in communication between the first client and the originating server.

29. The system of claim 16, wherein the device comprises a cache in communication with the packet processing engine.

30. The system of claim 29, wherein the cache requests the packet processing engine to transmit one of the response to the first client or the dynamically generated object of the first client to the second client.