Mechanism for providing early coherency detection to enable high performance memory updates in a latency sensitive multithreaded environment

• US 7,216,204 B2
• Filed: 08/05/2002
• Issued: 05/08/2007
• Est. Priority Date: 08/27/2001
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Bernstein, Debra, Rosenbluth, Mark B., Wolrich, Gilbert
• Primary Examiner(s): PORTKA, GARY J
• Application Number:
  US10/212,548
• Publication Number:
  US 20030041216A1
• Time in Patent Office: 1,737 Days
• Field of Search: 711/141, 711/108
• US Class Current: 711/141
• CPC Class Codes: G06F 9/30021 Compare instructions, e.g. Greater-Than, Equal-To, MINMAX
• CPC Class Codes: G06F 9/3004 to perform operations on memory
• CPC Class Codes: G06F 9/30087 Synchronisation or serialisation instructions
• CPC Class Codes: G06F 9/383 Operand prefetching cache prefetching G06F12/0862
• CPC Class Codes: G06F 9/3851 from multiple instruction streams, e.g. multistreaming
• CPC Class Codes: G06F 9/3885 using a plurality of independent parallel functional units

Abstract

Stored units of information related to packet processing are associated with identifiers, each of which is maintained as an entry in a Content Addressable Memory (CAM). Each entry includes status information associated with the information unit with which the identifier is associated. The status information is used to determine validity of the information unit with which the status information is associated.

Claims

1. A method of accessing shared-access information stored in external memory, the method comprising:

storing copies of information units related to packet processing from the external memory to local memory, each information unit having an associated identifier;

maintaining each identifier as an entry in a Content Addressable Memory (CAM), each entry including status information associated with the information unit with which the identifier is associated; and

using the status information to determine validity of the information unit with which the status information is associated and to protect coherency during read-modify-write operations by enforcing exclusive modification privileges between microengines;

wherein the status information comprises a lock status to indicate that the information unit with which the status information is associated is in process of being read from the external memory to the local memory or in process of being modified in the local memory.

2. The method of claim 1 wherein storing copies of the information units comprises storing copies of the information units in an external memory controller cache, the cached information units collectively corresponding to a portion of all such information units stored in the external memory.

3. The method of claim 2 wherein the information units are queue descriptors.

4. The method of claim 3 wherein the associated identifiers are queue numbers.

5. The method of claim 1 wherein the information units correspond to information in state tables.

6. The method of claim 5 wherein the associated identifiers are packet flow identifiers.

7. The method of claim 1, further comprising:

performing a lookup in the CAM of a selected one of the information units stored in the external memory based on the associated identifier; and

receiving from the CAM a lookup result that indicates if a match was found, a match indicating that the selected one of the information units is stored in the local memory.

8. The method of claim 7 wherein the lookup result includes the status information of the matched identifier.

9. The method of claim 7 wherein the CAM maintains a Least Recently Used (LRU) list of the identifiers in the CAM and, if no match is found, the result providing an index to an identifier from the LRU list.

10. The method of claim 9, further comprising using the LRU identifier to replace a least recently used information unit in the local memory with the selected one of the information units from the external memory.

11. The method of claim 10, further comprising:

replacing the LRU identifier in the CAM with the identifier associated with the selected one of the information units.

12. The method of claim 7, further comprising:

setting a lock status of the identifier associated with the selected one of the information units to indicate invalid status;

modifying the selected one of the information units in the local memory; and

upon completion of the modification, changing the lock status to indicate valid status.

13. A computer program product residing on a computer-readable medium comprising instructions to cause a computer to:

store copies of information units related to packet processing from external memory to local memory, each information unit having an associated identifier;

maintain each identifier as an entry in a Content Addressable Memory (CAM), each entry including status information associated with the information unit with which the identifier is associated; and

use the status information to determine validity of the information unit with which the status information is associated and to protect coherency during read-modify-write operations by enforcing exclusive modification privileges between microengines;

wherein the status information comprises a lock status to indicate that the information unit with which the status information is associated is in process of being read from the external memory to the local memory or of being modified in the local memory.

14. The computer program product of claim 13, wherein the information units stored in the local memory comprise information units stored in an external memory controller cache, the cached information units collectively corresponding to a portion of all such information units stored in the external memory.

15. An apparatus comprising:

an external memory controller;

a local memory; and

a Content Addressable Memory (CAM) configured to maintain entries including identifiers and associated status information, the identifiers being associated with units of information related to packet processing that are read from external memory to the local memory, and the apparatus being configured to cause the status information to indicate that a unit of information, which has been associated with an entry of the CAM, is currently invalid when the unit of information is in process of being read from external memory to the local memory, and the apparatus being configured to protect coherency during read-modify-write operations by enforcing exclusive modification privileges between microengines using the status information.

16. The apparatus of claim 15, wherein the external memory controller comprises an external memory controller cache, and the local memory comprises the external memory controller cache.

17. The apparatus of claim 15, wherein the status information comprises a lock status to indicate that the information unit with which the status information is associated is in process of being read from the external memory to the local memory or of being modified in the local memory.

18. A system comprising:

multiple network devices;

external memory; and

a processor comprising multiple microengines, an external memory controller, a local memory, and a Content Addressable Memory (CAM) configured to maintain entries including identifiers and associated status information, the identifiers being associated with units of information related to packet processing that are read from the external memory to the local memory, and the processor being configured to cause the status information to indicate that a unit of information, which has been associated with an entry of the CAM, is currently invalid when the unit of information is in process of being read from external memory to the local memory.

19. The system of claim 18, wherein the external memory controller comprises an external memory controller cache, and the local memory comprises the external memory controller cache.

20. The system of claim 18, wherein the status information comprises a lock status to indicate that the information unit with which the status information is associated is in process of being read from the external memory to the local memory or of being modified in the local memory.