Caching architecture for packet-form in-memory object caching

• US 9,860,332 B2
• Filed: 02/27/2014
• Issued: 01/02/2018
• Est. Priority Date: 05/08/2013
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kuang, Jilong, Waddington, Daniel G., Colmenares, Juan
• Primary Examiner(s): Salad, Abdullahi E
• Application Number:
  US14/191,959
• Publication Number:
  US 20140337459A1
• Time in Patent Office: 1,405 Days
• CPC Class Codes: H04L 45/7453 using hashing
• CPC Class Codes: H04L 67/2871 Implementation details of single intermediate entities
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

One embodiment provides a caching system comprising a hash table, a network interface for receiving a sequence of network-level packets for caching, and a caching application module for storing the sequence of network-level packets in the hash table. The sequence of network-level packets is stored its original form without de-fragmentation.

Claims

1. A caching system, comprising:

at least one processor; and

a non-transitory processor-readable memory device storing instructions that when executed by the at least one processor causes the at least one processor to perform operations including;

maintaining a hash table;

receiving a sequence of network-level packets for caching, wherein each network-level packet of the sequence of network-level packets comprises at least one network header; and

caching the sequence of network-level packets in the hash table in its original form by storing the sequence of network-level packets in the hash table as a linked list of network packets together with corresponding metadata for the sequence of network-level packets, wherein the linked list comprises each network-level packet of the sequence of network-level packets and each network header included in the network-level packet, and the corresponding metadata comprises information common to each network-level packet of the sequence of network-level packets.

2. The caching system of claim 1, wherein the sequence of network-level packets is cached in the hash table without de-fragmentation of network-level packets included in the sequence of network-level packets, thereby removing the need to re-assemble the network-level packets into an application frame, and further removing the need to copy the network-level packets.

3. The caching system of claim 1, wherein the operations further comprise:

generating the corresponding metadata, wherein the corresponding metadata comprises a corresponding metadata header including the information common to each network-level packet of the sequence of network-level packets; and

storing the sequence of network-level packets in the hash table together with the corresponding metadata header.

4. The caching system of claim 3, wherein the information common to each network-level packet of the sequence of network-level packets comprises one or more of the following:

access information to a key included in the sequence of network-level packets, access information to a value included in the sequence of network-level packets, expiration time information identifying when to remove the sequence of network-level packets from the hash table, an atomic reference count for enabling multi-threaded processing, and information identifying the total number of network-level packets included in the sequence of network-level packets.

5. The caching system of claim 1, wherein the operations further comprise:

receiving a request for the sequence of network-level packets, wherein the request includes a key associated with the sequence of network-level packets;

performing a look-up of the hash table using the key;

retrieving the sequence of network-level packets associated from the hash table; and

generating a response to the request based on the sequence of network-level packets.

6. The caching system of claim 5, wherein the response is generated without fragmentation of network-level packets included in the sequence of network-level packets.

7. The caching system of claim 1, wherein the operations further comprise:

enabling concurrent caching operations.

8. A method, comprising:

maintaining a hash table;

receiving a sequence of network-level packets for caching, wherein each network-level packet of the sequence of network-level packets comprises at least one network header; and

caching the sequence of network-level packets in the hash table in its original form by storing the sequence of network-level packets in the hash table as a linked list of network packets together with corresponding metadata for the sequence of network-level packets, wherein the linked list comprises each network-level packet of the sequence of network-level packets and each network header included in the network-level packet, and the corresponding metadata comprises information common to each network-level packet of the sequence of network-level packets.

9. The method of claim 8, wherein the sequence of network-level packets is cached in the hash table without de-fragmentation of network-level packets included in the sequence of network-level packets, thereby removing the need to re-assemble the network-level packets into an application frame, and further removing the need to copy the network-level packets.

10. The method of claim 8, further comprising:

generating the corresponding metadata, wherein the corresponding metadata comprises a corresponding metadata header including the information common to each network-level packet of the sequence of network-level packets; and

storing the sequence of network-level packets in the hash table together with the corresponding metadata header.

11. The method of claim 10, wherein the information common to each network-level packet of the sequence of network-level packets comprises one or more of the following:

access information to a key included in the sequence of network-level packets, access information to a value included in the sequence of network-level packets, expiration time information identifying when to remove the sequence of network-level packets from the hash table, an atomic reference count for enabling multi-threaded processing, and information identifying the total number of network-level packets included in the sequence of network-level packets.

12. The method of claim 8, further comprising:

receiving a request for the sequence of network-level packets, wherein the request includes a key associated with the sequence of network-level packets;

performing a look-up of the hash table using the key;

retrieving the sequence of network-level packets associated from the hash table; and

generating a response to the request based on the sequence of network-level packets.

13. The method of claim 12, wherein the response is generated without fragmentation of network-level packets included in the sequence of network-level packets.

14. The method of claim 8, further comprising:

enabling concurrent caching operations.

15. A non-transitory computer-readable medium having instructions which when executed on a computer perform a method comprising:

maintaining a hash table;

receiving a sequence of network-level packets for caching, wherein each network-level packet of the sequence of network-level packets comprises at least one network header; and

caching the sequence of network-level packets in the hash table in its original form by storing the sequence of network-level packets in the hash table as a linked list of network packets together with corresponding metadata for the sequence of network-level packets, wherein the linked list comprises each network-level packet of the sequence of network-level packets and each network header included in the network-level packet, and the corresponding metadata comprises information common to each network-level packet of the sequence of network-level packets.

16. The medium of claim 15, wherein the sequence of network-level packets is cached in the hash table without de-fragmentation of network-level packets included in the sequence of network-level packets, thereby removing the need to re-assemble the network-level packets into an application frame, and further removing the need to copy the network-level packets.

17. The medium of claim 15, the method further comprising:

generating the corresponding metadata, wherein the corresponding metadata comprises a corresponding metadata header including the information common to each network-level packet of the sequence of network-level packets; and

storing the sequence of network-level packets in the hash table together with the corresponding metadata header.

18. The medium of claim 17, wherein the information common to each network-level packet of the sequence of network-level packets comprises one or more of the following:

access information to a key included in the sequence of network-level packets, access information to a value included in the sequence of network-level packets, expiration time information identifying when to remove the sequence of network-level packets from the hash table, an atomic reference count for enabling multi-threaded processing, and information identifying the total number of network-level packets included in the sequence of network-level packets.

19. The medium of claim 15, the method further comprising:

receiving a request for the sequence of network-level packets, wherein the request includes a key associated with the sequence of network-level packets;

performing a look-up of the hash table using the key;

retrieving the sequence of network-level packets associated from the hash table; and

generating a response to the request based on the sequence of network-level packets.

20. The medium of claim 19, wherein the response is generated without fragmentation of network-level packets included in the sequence of network-level packets.