Buffer control system and method for a memory system having outstanding read and write request buffers

• US 7,188,219 B2
• Filed: 01/30/2004
• Issued: 03/06/2007
• Est. Priority Date: 01/30/2004
• Status: Active Grant

• Current Assignee: Micron Technology, Inc.
• Original Assignee: Micron Technology, Inc.
• Inventors: Jeddeloh, Joseph M.
• Primary Examiner(s): Peugh; Brian R.
• Assistant Examiner(s): Golden; James
• Application Number:
  US10/769,079
• Publication Number:
  US 20050172084A1
• Time in Patent Office: 1,131 Days
• Field of Search: 711/154, 711/156, 710/54, 710/56, 710/57, 345/558
• US Class Current: 711/154
• CPC Class Codes: G06F 13/1642 with request queuing
• CPC Class Codes: G06F 13/1673 using buffers
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0656 Data buffering arrangements
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A memory controller and method for managing the issuance of read and write requests to a system memory is provided. The number of outstanding read requests and write requests issued to the system memory are separately monitored and further issuance of read and write requests to the system memory is separately controlled based on the number of outstanding read and write requests, respectively. For example, the issuance of read and write requests can be managed by independently halting and resuming the issuance of read and write requests to the system memory to maintain the number of outstanding read requests between first and second read thresholds and to maintain the number of outstanding write requests between first and second write thresholds, respectively.

Claims

1. A memory hub controller for controlling access to a system memory, comprising:

a memory request queue storing at least one memory request received through an input port, the memory request queue being operable to issue from an output port each memory request stored in the memory request queue responsive to a flow control signal;

a response queue coupled to receive through an input port read responses containing each read data and a read status signal identifying read requests corresponding to the read data, the response queue further being coupled to receive through the input port write responses each having a write status signal identifying write requests that have been serviced, the response queue being operable to couple at least the read data from each read response signal to a data output port and to couple the read status signal from each read response and the write status signal from each write response to a flow control port; and

a buffer management unit coupled to receive the read status signals and the write status signals from the response queue, the buffer management unit having a read buffer monitor circuit to determine from the read status signals a number of outstanding read requests issued by the memory request queue and having a write buffer monitor circuit to determine from the write status signals a number of outstanding write requests issued by the memory request queue, the buffer management unit further having a flow control circuit coupled to the read and write buffer monitor circuits to generate a flow control signal provided to the memory request queue controlling issuance of read and write requests to the memory modules based on the numbers of outstanding read and write requests, respectively, issued by the memory request queue.

2. The memory hub controller of claim 1 wherein the flow control circuit of the buffer management unit comprises a control circuit operable to generate a flow control signal halting issuance of read requests to the system memory in response to the read buffer monitor circuit determining the number of outstanding read requests exceeds a read request threshold and further operable to generate a flow control signal halting issuance of write requests to the system memory in response to the write buffer monitor circuit determining the number of outstanding write requests exceeds a write request threshold.

3. The memory hub controller of claim 2 wherein the read request threshold and the write request threshold are unequal.

4. The memory hub controller of claim 2 wherein the write request threshold is greater than the read request threshold.

5. The memory hub controller of claim 2 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read buffer monitor circuit determining the number of outstanding read requests is less than a read request resume threshold and further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write buffer monitor circuit determining the number of outstanding write requests is less than a write request resume threshold.

6. The memory hub controller of claim 2 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read buffer monitor circuit determining the number of outstanding read requests issued to the system memory is zero.

7. The memory hub controller of claim 2 wherein the control circuit is further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write buffer monitor circuit determining the number of outstanding write requests issued to the system memory is zero.

8. The memory hub controller of claim 1 wherein the memory request queue is further operable to issue from the output port along with each memory request a request identification uniquely identifying the respective memory request.

9. The memory hub controller of claim 8 wherein the buffer management unit is operable to generate and couple to the memory request queue the request identification for each memory request, and wherein the buffer management unit is further operable to generate the flow control signal on the basis of a comparison between the request identification coupled to the memory request queue and the read status signals and the write status signals received from the response queue.

10. A memory controller coupled to a system memory through a memory bus, comprising:

a memory request queue to receive and store memory requests, the memory request queue issuing read requests and write requests to the system memory in response to a flow control signal;

a response queue coupled to receive a memory request response having a status signal identifying read requests and write requests that have been serviced by the system memory; and

a memory request flow control circuit coupled to the response queue to receive the status signals and having separate read and write request monitor circuits to monitor a number of outstanding read requests and a number of outstanding write requests issued to the system memory, respectively, the memory request flow control circuit coupled to the memory request queue to provide the flow control signal responsive to the number of outstanding read and write requests to separately control issuance of read requests and issuance of write requests to the system memory.

11. The memory controller of claim 10 wherein the memory request flow control circuit comprises a control circuit operable to generate a flow control signal halting issuance of read requests to the system memory in response to the read request monitor circuit determining the number of outstanding read requests exceeds a read request threshold and further operable to generate a flow control signal halting issuance of write requests to the system memory in response to the write request monitor circuit determining the number of outstanding write requests exceeds a write request threshold.

12. The memory controller of claim 11 wherein the read request threshold and the write request threshold are unequal.

13. The memory controller of claim 11 wherein the write request threshold is greater than the read request threshold.

14. The memory controller of claim 11 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read request monitor circuit determining the number of outstanding read requests is less than a read request resume threshold and further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write request monitor circuit determining the number of outstanding write requests is less than a write request resume threshold.

15. The memory controller of claim 11 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read request monitor circuit determining the number of outstanding read requests issued to the system memory is zero.

16. The memory controller of claim 11 wherein the control circuit is further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write request monitor circuit determining the number of outstanding write requests issued to the system memory is zero.

17. The memory controller of claim 10 wherein the memory request queue is further operable to issue along with each memory request a request identification uniquely identifying the respective memory request.

18. The memory controller of claim 17 wherein the memory request flow control circuit is operable to generate and couple to the memory request queue the request identification for each memory request, and wherein the memory request flow control circuit is further operable to generate the flow control signal on the basis of a comparison between the request identification coupled to the memory request queue and the read status signals and the write status signals received from the response queue.

19. A memory hub controller for controlling access to a system memory, comprising:

a memory request queue storing read and write memory requests and being operable to issue to the system memory the read and write memory requests stored in the memory request queue responsive to read and write request flow control signals received at a queue control terminal;

a response queue coupled to receive from the system memory read responses each having a read status signal identifying read requests that have been serviced and to receive write responses each having a write status signal identifying write requests that have been serviced, the response queue being operable to couple the read status signal from each read response and the write status signal from each write response to a flow control port; and

a buffer management unit coupled to the queue control terminal of the memory request queue and further coupled to the flow control port of the response queue, the buffer management unit operable to determine from the read status signals a number of outstanding read requests issued by the memory request queue and to determine from the write status signals a number of outstanding write requests issued by the memory request queue, and in response to the numbers of outstanding read and write requests, generate flow control signals to separately control issuance of read requests and issuance of write requests by the memory request queue to the system memory.

20. The memory hub controller of claim 19 wherein the buffer management unit comprises a flow control circuit operable to generate a flow control signal halting issuance of read requests to the system memory in response to determining the number of outstanding read requests exceeds a read request threshold and further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to determining the number of outstanding read requests is less than a read request resume threshold.

21. The memory hub controller of claim 19 wherein the buffer management unit comprises a flow control circuit operable to generate a flow control signal halting issuance of write requests to the system memory in response to determining the number of outstanding write requests exceeds a write request threshold and further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to determining the number of outstanding write requests is less than a write request resume threshold.

22. The memory hub controller of claim 19 wherein the memory request queue is further operable to issue along with each memory request a request identification uniquely identifying the respective memory request.

23. The memory hub controller of claim 22 wherein the buffer management unit is operable to generate and couple to the memory request queue the request identification for each memory request, and wherein the buffer management unit is further operable to generate the flow control signal on the basis of a comparison between the request identification coupled to the memory request queue and the read status signals and the write status signals received from the response queue.

24. A memory system, comprising:

a memory bus for transmitting memory requests and responses thereon;

a plurality of memory modules coupled to the memory bus, each of the modules having;

a plurality of memory devices;

a memory hub coupled to the plurality of devices and the memory bus for receiving memory requests and generating signals in response thereto to operate the plurality of memory devices and service read and write requests, the memory hub including a memory write buffer coupled to the memory bus to store write requests, a memory read queue coupled to the memory devices to receive read data from the memory devices and store the read data for coupling to the memory bus, and further including a response generator to generate a read response including a read status signal identifying read requests corresponding to the read data and to generate a write response including a write status signal identifying write requests that have been serviced; and

a memory controller coupled to the memory bus, the memory controller having;

a memory request queue storing at least one memory request and operable to issue from an output port to the memory modules each memory request stored in the memory request queue responsive to a flow control signal;

a response queue coupled to receive the read responses and write responses, the response queue being operable to couple at least the read data from each read response signal to a data output port and to couple the read status signal from each read response and the write status signal from each write response to a flow control port; and

a buffer management unit coupled to receive the read status signals and the write status signals from the response queue, the buffer management unit having a read buffer monitor circuit to determine from the read status signals a number of outstanding read requests issued by the memory request queue and having a write buffer monitor circuit to determine from the write status signals a number of outstanding write requests issued by the memory request queue, the buffer management unit further having a flow control circuit coupled to the read and write buffer monitor circuits to generate a flow control signal provided to the memory request queue controlling issuance of read and write requests to the memory modules based on the numbers of outstanding read and write requests, respectively, issued by the memory request queue.

25. The memory system of claim 24 wherein the flow control circuit of the buffer management unit comprises a control circuit operable to generate a flow control signal halting issuance of read requests to the system memory in response to the read buffer monitor circuit determining the number of outstanding read requests exceeds a read request threshold and further operable to generate a flow control signal halting issuance of write requests to the system memory in response to the write buffer monitor circuit determining the number of outstanding write requests exceeds a write request threshold.

26. The memory system of claim 25 wherein the read request threshold and the write request threshold are unequal.

27. The memory system of claim 25 wherein the write request threshold is greater than the read request threshold.

28. The memory system of claim 25 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read buffer monitor circuit determining the number of outstanding read requests is less than a read request resume threshold and further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write buffer monitor circuit determining the number of outstanding write requests is less than a write request resume threshold.

29. The memory system of claim 25 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read buffer monitor circuit determining the number of outstanding read requests issued to the system memory is zero.

30. The memory system of claim 25 wherein the control circuit is further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write buffer monitor circuit determining the number of outstanding write requests issued to the system memory is zero.

31. The memory system of claim 24 wherein the memory request queue is further operable to issue from the output port along with each memory request a request identification uniquely identifying the respective memory request.

32. The memory system of claim 31 wherein the buffer management unit is operable to generate and couple to the memory request queue the request identification for each memory request, and wherein the buffer management unit is further operable to generate the flow control signal on the basis of a comparison between the request identification coupled to the memory request queue and the read status signals and the write status signals received from the response queue.

33. A memory system, comprising:

a memory bus for transmitting memory requests and responses thereon;

a system memory having a plurality of memory modules coupled to the memory bus, each of the modules having;

a plurality of memory devices;

a memory hub coupled to the plurality of devices and the memory bus for receiving memory requests and generating signals in response thereto to operate the plurality of memory devices and service read and write requests, the memory hub including a memory write buffer coupled to the memory bus to store write requests, a memory read queue coupled to the memory devices to receive read data from the memory devices and store the read data for coupling to the memory bus, and further including a response generator to generate a read response including a read status signal identifying read requests corresponding to the read data and to generate a write response including a write status signal identifying write requests that have been serviced; and

a memory controller coupled to the system memory through the memory bus, the memory controller having;

a memory request queue to receive and store memory requests, the memory request queue issuing read requests and write requests to the system memory in response to a flow control signal;

a response queue coupled to receive a memory request response having a status signal identifying read requests and write requests that have been serviced by the system memory; and

a memory request flow control circuit coupled to the response queue to receive the status signals and having separate read and write request monitor circuits to monitor a number of outstanding read requests and a number of outstanding write requests issued to the system memory, respectively, the memory request flow control circuit coupled to the memory request queue to provide the flow control signal responsive to the number of outstanding read and write requests to separately control issuance of read requests and issuance of write requests to the system memory.

34. The memory system of claim 33 wherein the memory request flow control circuit comprises a control circuit operable to generate a flow control signal halting issuance of read requests to the system memory in response to the read request monitor circuit determining the number of outstanding read requests exceeds a read request threshold and further operable to generate a flow control signal halting issuance of write requests to the system memory in response to the write request monitor circuit determining the number of outstanding write requests exceeds a write request threshold.

35. The memory system of claim 34 wherein the read request threshold and the write request threshold are unequal.

36. The memory system of claim 34 wherein the write request threshold is greater than the read request threshold.

37. The memory system of claim 34 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read request monitor circuit determining the number of outstanding read requests is less than a read request resume threshold and further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write request monitor circuit determining the number of outstanding write requests is less than a write request resume threshold.

38. The memory system of claim 34 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read request monitor circuit determining the number of outstanding read requests issued to the system memory is zero.

39. The memory system of claim 34 wherein the control circuit is further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write request monitor circuit determining the number of outstanding write requests issued to the system memory is zero.

40. The memory system of claim 33 wherein the memory request queue is further operable to issue along with each memory request a request identification uniquely identifying the respective memory request.

41. The memory system of claim 40 wherein the memory request flow control circuit is operable to generate and couple to the memory request queue the request identification for each memory request, and wherein the memory request flow control circuit is further operable to generate the flow control signal on the basis of a comparison between the request identification coupled to the memory request queue and the read status signals and the write status signals received from the response queue.

42. A processor-based system, comprising:

a processor having a processor bus;

a system controller coupled to the processor bus, the system controller having a peripheral device port, the system controller further comprising a controller coupled to a system memory port;

at least one input device coupled to the peripheral device port of the system controller;

at least one output device coupled to the peripheral device port of the system controller;

at least one data storage device coupled to the peripheral device port of the system controller; and

a memory system, comprising;

a memory bus for transmitting memory requests and responses thereon;

a plurality of memory modules coupled to the memory bus, each of the modules having;

a plurality of memory devices;

a memory hub coupled to the plurality of devices and the memory bus for receiving memory requests and generating signals in response thereto to operate the plurality of memory devices and service read and write requests, the memory hub including a memory write buffer coupled to the memory bus to store write requests, a memory read queue coupled to the memory devices to receive read data from the memory devices and store the read data for coupling to the memory bus, and further including a response generator to generate a read response including a read status signal identifying read requests corresponding to the read data and to generate a write response including a write status signal identifying write requests that have been serviced; and

a memory controller coupled to the memory bus, the memory controller having;

a memory request queue storing at least one memory request and operable to issue from an output port to the memory modules each memory request stored in the memory request queue responsive to a flow control signal;

a response queue coupled to receive the read responses and write responses, the response queue being operable to couple at least the read data from each read response signal to a data output port and to couple the read status signal from each read response and the write status signal from each write response to a flow control port; and

a buffer management unit coupled to receive the read status signals and the write status signals from the response queue, the buffer management unit having a read buffer monitor circuit to determine from the read status signals a number of outstanding read requests issued by the memory request queue and having a write buffer monitor circuit to determine from the write status signals a number of outstanding write requests issued by the memory request queue, the buffer management unit further having a flow control circuit coupled to the read and write buffer monitor circuits to generate a flow control signal provided to the memory request queue controlling issuance of read requests to the memory modules based on the number of outstanding read requests issued by the memory request queue and controlling issuance of write requests to the system memory based on the number of outstanding write requests issued by the memory request queue.

43. The processor-based system of claim 42 wherein the flow control circuit of the buffer management unit comprises a control circuit operable to generate a flow control signal halting issuance of read requests to the system memory in response to the read buffer monitor circuit determining the number of outstanding read requests exceeds a read request threshold and further operable to generate a flow control signal halting issuance of write requests to the system memory in response to the write buffer monitor circuit determining the number of outstanding write requests exceeds a write request threshold.

44. The processor-based system of claim 43 wherein the read request threshold and the write request threshold are unequal.

45. The processor-based system of claim 43 wherein the write request threshold is greater than the read request threshold.

46. The processor-based system of claim 43 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read buffer monitor circuit determining the number of outstanding read requests is less than a read request resume threshold and further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write buffer monitor circuit determining the number of outstanding write requests is less than a write request resume threshold.

47. The processor-based system of claim 43 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read buffer monitor circuit determining the number of outstanding read requests issued to the system memory is zero.

48. The processor-based system of claim 43 wherein the control circuit is further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write buffer monitor circuit determining the number of outstanding write requests issued to the system memory is zero.

49. The processor-based system of claim 42 wherein the memory request queue is further operable to issue from the output port along with each memory request a request identification uniquely identifying the respective memory request.

50. The processor-based system of claim 49 wherein the buffer management unit is operable to generate and couple to the memory request queue the request identification for each memory request, and wherein the buffer management unit is further operable to generate the flow control signal on the basis of a comparison between the request identification coupled to the memory request queue and the read status signals and the write status signals received from the response queue.

51. A processor-based system, comprising:

a processor having a processor bus;

a system controller coupled to the processor bus, the system controller having a peripheral device port, the system controller further comprising a controller coupled to a system memory port;

at least one input device coupled to the peripheral device port of the system controller;

at least one output device coupled to the peripheral device port of the system controller;

at least one data storage device coupled to the peripheral device port of the system controller; and

a memory system, comprising;

a memory bus for transmitting memory requests and responses thereon;

a system memory having a plurality of memory modules coupled to the memory bus, each of the modules having;

a plurality of memory devices;

a memory hub coupled to the plurality of devices and the memory bus for receiving memory requests and generating signals in response thereto to operate the plurality of memory devices and service read and write requests, the memory hub including a memory write buffer coupled to the memory bus to store write requests, a memory read queue coupled to the memory devices to receive read data from the memory devices and store the read data for coupling to the memory bus, and further including a response generator to generate a read response including a read status signal identifying read requests corresponding to the read data and to generate a write response including a write status signal identifying write requests that have been serviced; and

a memory controller coupled to the system memory through the memory bus, the memory controller having;

a memory request queue to receive and store memory requests, the memory request queue issuing read requests and write requests to the system memory in response to a flow control signal;

a response queue coupled to receive a memory request response having a status signal identifying read requests and write requests that have been serviced by the system memory; and

a memory request flow control circuit coupled to the response queue to receive the status signals and having separate read and write request monitor circuits to monitor a number of outstanding read requests and a number of outstanding write requests issued to the system memory, respectively, the memory request flow control circuit coupled to the memory request queue to provide the flow control signal responsive to the number of outstanding read and write requests to separately control issuance of read requests and issuance of write requests to the system memory.

52. The processor-based system of claim 51 wherein the memory request flow control circuit comprises a control circuit operable to generate a flow control signal halting issuance of read requests to the system memory in response to the read request monitor circuit determining the number of outstanding read requests exceeds a read request threshold and further operable to generate a flow control signal halting issuance of write requests to the system memory in response to the write request monitor circuit determining the number of outstanding write requests exceeds a write request threshold.

53. The processor-based system of claim 52 wherein the read request threshold and the write request threshold are unequal.

54. The processor-based system of claim 52 wherein the write request threshold is greater than the read request threshold.

55. The processor-based system of claim 52 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read request monitor circuit determining the number of outstanding read requests is less than a read request resume threshold and further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write request monitor circuit determining the number of outstanding write requests is less than a write request resume threshold.

56. The processor-based system of claim 52 wherein the control circuit is further operable to generate a flow control signal resuming issuance of read requests to the system memory in response to the read request monitor circuit determining the number of outstanding read requests issued to the system memory is zero.

57. The processor-based system of claim 52 wherein the control circuit is further operable to generate a flow control signal resuming issuance of write requests to the system memory in response to the write request monitor circuit determining the number of outstanding write requests issued to the system memory is zero.

58. The processor-based system of claim 51 wherein the memory request queue is further operable to issue along with each memory request a request identification uniquely identifying the respective memory request.

59. The processor-based system of claim 58 wherein the memory request flow control circuit is operable to generate and couple to the memory request queue the request identification for each memory request, and wherein the memory request flow control circuit is further operable to generate the flow control signal on the basis of a comparison between the request identification coupled to the memory request queue and the read status signals and the write status signals received from the response queue.

60. A method for managing issuance of read and write requests to a system memory, comprising:

separately monitoring a number of outstanding read requests and a number of outstanding write requests issued to the system memory;

separately controlling further issuance of read and write requests to the system memory based on the numbers of outstanding read and write requests, respectively.

61. The method of claim 60 wherein separately controlling further issuance of read and write requests to the system memory based on the number of outstanding read and write requests comprises halting further issuance of read requests in response to the number of outstanding read requests exceeds a read request threshold and halting further issuance of write requests in response to the number of outstanding write requests exceeds a write request threshold.

62. The method of claim 61 wherein the read request threshold and the write request threshold are unequal.

63. The method of claim 62 wherein the write request threshold is greater than the read request threshold.

64. The method of claim 61, further comprising resuming issuance of read requests in response to the number of outstanding read requests decreasing to less than a read resume threshold.

65. The method of claim 61, further comprising resuming issuance of write request in response to the number of outstanding write requests decreasing to less than a write resume threshold.

66. The method of claim 60 wherein separately monitoring the number of outstanding read requests and write requests issued to the system memory comprises incrementing a read request counter in response to issuance of a read request and decrementing the read request counter in response to receiving an indication that the corresponding read request has been serviced by the system memory and incrementing a write request counter in response to issuance of a write request and decrementing the write request counter in response to receiving an indication that the corresponding write request has been serviced by the system memory.

67. A method for managing the issuance of read and write requests to a system memory, comprising:

monitoring a number of outstanding read requests and a number of outstanding write requests issued to the system memory; and

independently halting and resuming issuance of read requests and write requests to the system memory to maintain the number of outstanding read requests between first and second read thresholds and to maintain the number of outstanding write requests between first and second write thresholds, respectively.

68. The method of claim 67 wherein the first read threshold is greater than the second read threshold and the first write threshold is greater than the second write threshold, and the first write threshold is unequal to the first read threshold.

69. The method of claim 67 wherein resuming issuance of read requests to the system memory comprises resuming issuance of the read requests in response to the number of outstanding read requests being equal to zero.

70. The method of claim 67 wherein resuming issuance of write requests to the system memory comprises resuming issuance of the write requests in response to the number of outstanding write requests being equal to zero.

71. The method of claim 67, further comprising generating for each memory request a request identification uniquely identifying the respective memory request.

72. The method of claim 71 wherein monitoring the number of outstanding read and write requests comprises monitoring the servicing of the particular read and write requests issued to the system memory based on the request identification.

73. The method of claim 67 wherein monitoring the number of outstanding read requests and write requests issued to the system memory comprises incrementing a read request counter in response to issuance of a read request and decrementing the read request counter in response to receiving an indication that the corresponding read request has been serviced by the system memory and incrementing a write request counter in response to issuance of a write request and decrementing the write request counter in response to receiving an indication that the corresponding write request has been serviced by the system memory.

74. A method for managing the issuance of read and write requests to a system memory, comprising:

monitoring the number of outstanding read requests issued to the system memory;

halting the issuance of read requests to the system memory in response to the number of outstanding read requests exceeding a read request threshold;

resuming the issuance of read requests to the system memory in response to the number of outstanding read requests decreasing to less than a read resume threshold;

monitoring the number of outstanding write requests issued to the system memory;

halting the issuance of write requests to the system memory in response to the number of outstanding write requests exceeding a write request threshold; and

resuming the issuance of write requests to the system memory in response to the number of outstanding write requests decreasing to less than a write resume threshold.

75. The method of claim 74 wherein the read request threshold and the write request threshold are unequal.

76. The method of claim 75 wherein the write request threshold is greater than the read request threshold.

77. The method of claim 74 wherein resuming issuance of read requests to the system memory comprises resuming issuance of the read requests in response to the number of outstanding read requests being equal to zero.

78. The method of claim 74 wherein resuming issuance of write requests to the system memory comprises resuming issuance of the write requests in response to the number of outstanding write requests being equal to zero.

79. The method of claim 74, further comprising generating for each read and write request a request identification uniquely identifying the respective memory request.

80. The method of claim 79 wherein monitoring the number of outstanding read and write requests comprises monitoring the servicing of the particular read and write requests issued to the system memory based on the request identification.

81. The method of claim 74 wherein monitoring the number of outstanding read requests issued to the system memory comprises incrementing a read request counter in response to issuance of a read request and decrementing the read request counter in response to receiving an indication that the corresponding read request has been serviced by the system memory and monitoring the number of outstanding write requests issued to the system memory comprises incrementing a write request counter in response to issuance of a write request and decrementing the write request counter in response to receiving an indication that the corresponding write request has been serviced by the system memory.