System and method for communicating the synchronization status of memory modules during initialization of the memory modules

• US 7,222,213 B2
• Filed: 05/17/2004
• Issued: 05/22/2007
• Est. Priority Date: 05/17/2004
• Status: Active Grant

• Current Assignee: Micron Technology, Inc.
• Original Assignee: Micron Technology, Inc.
• Inventors: James, Ralph
• Primary Examiner(s): Verbrugge; Kevin
• Application Number:
  US10/848,606
• Publication Number:
  US 20050257021A1
• Time in Patent Office: 1,100 Days
• Field of Search: None
• US Class Current: 711/5
• CPC Class Codes: G06F 13/1684 using multiple buses

Abstract

A memory system includes a memory hub controller coupled to a plurality of memory modules each of which includes a memory hub. The memory hub controller and the memory hubs each include at least one receiver that is synchronized to an internal clock signal during initialization. The memory hub controller and the memory hubs each transmit an initialization complete signal downstream when at least one receiver in the controller or hub is initialized and, in the case of the memory hubs, when a downstream initialization signal has also been received. Similarly, the memory hubs transmit an initialization signal upstream to another memory hub or the controller when both of its receivers are initialized and an upstream initialization signal has also been received. Receipt of an upstream initialization signal by the memory hub controller signifies that all of the receivers have been initialized.

Claims

1. A method of operating a memory system having a memory hub controller coupled to a plurality of memory hubs each of which includes at least one receiver that is initialized before use, the method comprising:

transmitting a downstream initialization complete signal from the memory hub controller to one of the memory hubs when initialization of a receiver in the memory hub controller has been completed;

determining if a respective downstream initialization complete signal is being received by each of the memory hubs;

determining if initialization of at least one receiver in each of the memory hubs has been completed;

if the respective downstream initialization complete signal is being received by each of the memory hubs except for a final memory hub furthest downstream from the memory hub controller and initialization of at least one receiver in the memory hub has been completed, transmitting a downstream initialization complete signal from the memory hub;

if the respective downstream initialization complete signal is being received by the final memory hub and initialization of at least one receiver in the final memory hub has been completed, transmitting an upstream initialization complete signal from the memory hub;

if the respective upstream initialization complete signal is being received by each of the memory hubs determining if an upstream initialization complete signal is being received by the memory hub;

if the respective upstream initialization complete signal is being received by each of the memory hubs and initialization of all receivers in the memory hub has been completed, transmitting an upstream initialization complete signal from the memory hub; and

if a respective upstream initialization complete signal is being received by the memory hub controller, transitioning the memory system to normal operation.

2. The method of claim 1, further comprising switching each of the memory hubs to a normal operating mode responsive to all of the memory hubs transmitting a respective upstream initialization complete signal.

3. The method of claim 1 wherein each of the initialization complete signals comprises the transitioning of a predetermined series of binary values to a complement of the binary values.

4. The method of claim 3 wherein each of the predetermined series of binary values are used by the memory hub controller and the memory hubs initialize the receivers in the memory hub controller and the memory hubs.

5. The method of claim 3 wherein each of the predetermined series of binary values and the complement of each of the predetermined series of binary values are used by the memory hub controller and the memory hubs initialize the receivers in the memory hub controller and the memory hubs.

6. The method of claim 1, further comprising:

transmitting from the memory hub controller and each of the memory hubs a respective initialization signal; and

receiving at the memory hub controller and each of the memory hubs a respective one of the initialization signals.

7. The method of claim 6 wherein each of the initialization complete signals comprises a change in the nature of a respective one of the initialization signals.

8. The method of claim 7 wherein each of the initialization signals comprises a predetermined series of binary values.

9. The method of claim 8 wherein the change in the nature of each of the initialization signals comprises a transitioning of the predetermined series of binary values to a complement of the predetermined series of binary values.

10. The method of claim 1 wherein a plurality of the memory hubs each comprise an upstream receiver, an upstream transmitter, a downstream receiver, and downstream transmitter.

11. In a memory system having at least one memory hub each having a downstream receiver, a downstream transmitter, an upstream transmitter and an upstream receiver, and a memory hub controller having a downstream transmitter and an upstream receiver, the memory hub controller having its downstream transmitter coupled to the downstream receiver of a first of the memory hubs and its upstream receiver coupled to the upstream transmitter of the first of the memory hubs, each of the memory hubs having its downstream receiver coupled to the downstream transmitter of an upstream one of the memory modules, its upstream transmitter coupled to the upstream receiver of the upstream one of the memory modules, each of the receivers including an initialization circuit for initializing the respective receiver, a method of determining when all of the receivers have been initialized, comprising:

in the memory hub controller;

transmitting a downstream initialization complete signal from the downstream transmitter when the initialization of the upstream receiver has been completed;

in each of the memory hubs except for a memory hub furthest downstream from the memory hub controller;

determining if a downstream initialization complete signal is being received by the downstream receiver;

determining if initialization of at least one of the downstream receiver and the upstream receiver has been completed; and

if the downstream initialization complete signal is being received by the downstream receiver and initialization of at least one of the downstream receiver and the upstream receiver has been completed, transmitting a downstream initialization complete signal from the downstream transmitter;

in the memory hub furthest downstream from the memory hub controller;

determining if a downstream initialization complete signal is being received by the downstream receiver;

determining if initialization of at least the downstream receiver has been completed; and

if the downstream initialization complete signal is being received by the downstream receiver and initialization of at least the downstream receiver has been completed, transmitting an upstream initialization complete signal from the upstream transmitter;

in each of the memory hubs except for a memory hub furthest downstream from the memory hub controller;

determining if an upstream initialization complete signal is being received by the upstream receiver; and

if the upstream initialization complete signal is being received by the upstream receiver and initialization of both the downstream receiver and the upstream receiver has been completed, transmitting an upstream initialization complete signal from the upstream transmitter; and

in the memory hub controller;

determining if an upstream initialization complete signal is being received by the upstream receiver; and

if the upstream initialization complete signal is being received by the upstream receiver, determining that all of the receivers in the memory hub controllers and all of the memory hubs have been initialized.

12. The method of claim 11 wherein the act of determining if initialization of at least one of the downstream receiver and the upstream receiver has been completed comprises determining if initialization of the downstream receiver has been completed.

13. The method of claim 11 wherein the act of determining if initialization of at least one of the downstream receiver and the upstream receiver has been completed comprises determining if initialization of both the downstream receiver and the upstream receiver have been completed.

14. The method of claim 11, further comprising switching the memory hub controller to a normal operating mode responsive to the memory hub controller determining that all of the receivers in the memory hub controllers and all of the memory hubs have been initialized.

15. The method of claim 11, further comprising switching each of the memory hubs to a normal operating mode responsive to the upstream transmitter in the respective memory hub transmitting a respective upstream initialization complete signal.

16. The method of claim 11 wherein each of the initialization complete signals comprises the transitioning of a predetermined series of binary values to a complement of the binary values.

17. The method of claim 16 wherein each of the predetermined series of binary values are used by the memory hub controller and the memory hubs initialize the receivers in the memory hub controller and the memory hubs.

18. The method of claim 16 wherein each of the predetermined series of binary values and the complement of each of the predetermined series of binary values are used by the memory hub controller and the memory hubs initialize the receivers in the memory hub controller and the memory hubs.

19. The method of claim 11, further comprising:

transmitting from each of the transmitters an initialization signal; and

receiving at each of the receivers a respective one of the initialization signals transmitted by a respective transmitter.

20. The method of claim 19 wherein each of the initialization complete signals comprises a change in the nature of a respective one of the initialization signals.

21. The method of claim 20 wherein each of the initialization signals comprises a predetermined series of binary values.

22. The method of claim 21 wherein the change in the nature of each of the initialization signals comprises a transitioning of the predetermined series of binary values to a complement of the predetermined series of binary values.

23. A method of operation of a memory hub controller including a transmitter and a receiver having an initialization circuit for initializing the receiver, the method comprising:

transmitting an initialization complete signal from the transmitter when the initialization of the receiver has been completed;

determining if the initialization complete signal is being received by the receiver; and

if the initialization complete signal is being received by the receiver, transitioning the memory hub controller to a normal operating mode.

24. The method of claim 23 wherein the received initialization complete signal comprises the transitioning of a predetermined series of binary values to a complement of the binary values.

25. The method of claim 24, further comprising using the predetermined series of binary values to initialize the receiver in the memory hub controller.

26. The method of claim 25, further comprising using the complement of the predetermined series of binary values to initialize the receiver in the memory hub controller.

27. The method of claim 23, further comprising:

transmitting from the transmitter a respective initialization signal;

receiving at the receiver a respective initialization signal; and

using the initialization signal received by the receiver to initialize the receiver.

28. The method of claim 27 wherein each of the initialization complete signals comprises a change in the nature of a respective one of the initialization signals.

29. The method of claim 28 wherein each of the initialization signals comprises a predetermined series of binary values.

30. The method of claim 29 wherein the change in the nature of each of the initialization signals comprises transitioning the respective predetermined series of binary values to a complement of the predetermined series of binary values.

31. A method of operation a memory hub including an upstream transmitter, a downstream transmitter, an upstream receiver, and a downstream receiver, the method comprising:

determining if a downstream initialization complete signal is being received by the downstream receiver;

determining if initialization of at least one of the downstream receiver and the upstream receiver has been completed;

if the downstream initialization complete signal is being received by the downstream receiver and initialization of at least one of the downstream receiver and the upstream receiver has been completed, transmitting a downstream initialization complete signal from the downstream transmitter;

determining if an upstream initialization complete signal is being received by the upstream receiver; and

if the upstream initialization complete signal is being received by the upstream receiver and initialization of both the downstream receiver and the upstream receiver has been completed, transmitting an upstream initialization complete signal from the upstream transmitter.

32. The method of claim 31, further comprising transitioning the memory hub to a normal operating mode responsive to the upstream receiver receiving the upstream initialization complete signal and initialization completion of both the downstream receiver and the upstream receiver.

33. The method of claim 31 wherein each of the initialization complete signals comprises the transitioning of a predetermined series of binary values to a complement of the binary values.

34. The method of claim 33, further comprising using the predetermined series of binary values to initialize the upstream and downstream receivers in the memory hub.

35. The method of claim 34, further comprising using the complement of the predetermined series of binary values to initialize the upstream and downstream receivers in the memory hub.

36. The method of claim 31, further comprising:

transmitting from the upstream transmitters an upstream initialization signal;

transmitting from the downstream transmitter a downstream initialization signal;

receiving at the upstream receiver an upstream initialization signal;

receiving at the downstream receiver a downstream initialization signal;

using the upstream initialization signal to initialize the upstream receiver; and

using the downstream initialization signal to initialize the downstream receiver.

37. The method of claim 36 wherein each of the initialization complete signals comprises a change in the nature of a respective one of the initialization signals.

38. The method of claim 37 wherein each of the initialization signals comprises a predetermined series of binary values.

39. The method of claim 38 wherein the change in the nature of each of the initialization signals comprises transitioning the respective predetermined series of binary values to a complement of the predetermined series of binary values.

40. A memory system, comprising:

a memory hub controller, comprising;

an upstream receiver including an initialization circuit for initializing the receiver, the upstream receiver being operable to determine if an upstream initialization complete signal is being received by the upstream receiver; and

a downstream transmitter transmitting a downstream initialization complete signal when the initialization of the upstream receiver has been completed;

a terminating memory module, comprising;

a plurality of memory devices; and

a memory hub coupled to the plurality of memory devices, the memory hub comprising;

a downstream receiver including an initialization circuit for initializing the receiver, the downstream receiver being operable to determine if a downstream initialization complete signal is being received by the downstream receiver, the downstream receiver further being operable to determine if initialization of the downstream receiver has been completed; and

an upstream transmitter transmitting an upstream initialization complete signal from the upstream transmitter if the downstream initialization complete signal is being received by the downstream receiver and initialization of at least the downstream receiver has been completed; and

at least one intermediate memory module, each intermediate memory module comprising;

a plurality of memory devices; and

a memory hub coupled to the plurality of memory devices, the memory hub comprising;

a downstream receiver coupled to the downstream transmitter in either the memory hub controller or in the memory hub of another of the intermediate memory modules, the downstream receiver including an initialization circuit for initializing the receiver, the downstream receiver being operable to determine if a downstream initialization complete signal is being received by the downstream receiver, the downstream receiver further being operable to determine if initialization of at least one of the downstream receiver and the upstream receiver has been completed;

a downstream transmitter coupled to the downstream receiver in the memory hub of either the terminating memory module or another of the intermediate memory modules, the downstream transmitter being operable to transmit a downstream initialization complete signal if the downstream initialization complete signal is being received by the downstream receiver and initialization of at least one of the downstream receiver and the upstream receiver has been completed;

an upstream receiver coupled to the upstream transmitter in the memory hub of either the terminating memory module or another of the intermediate memory modules, the upstream receiver including an initialization circuit for initializing the receiver, the upstream receiver being operable to determine if an upstream initialization complete signal is being received by the upstream receiver; and

an upstream transmitter coupled to the upstream receiver in either the memory hub controller or in the memory hub of another of the intermediate memory modules, the upstream transmitter being operable to transmit an upstream initialization complete signal if an upstream initialization complete signal is being received by the upstream receiver and initialization of both the downstream receiver and the upstream receiver has been completed.

41. The memory system of claim 40 wherein the memory devices in each of the memory modules comprise dynamic random access memory devices.

42. The memory system of claim 40 wherein the downstream transmitter in the memory hub of each of the intermediate memory modules is operable to transmit the downstream initialization complete signal if the downstream initialization complete signal is being received by the downstream receiver and initialization of the downstream receiver but not necessarily the upstream receiver has been completed.

43. The memory system of claim 40 wherein the downstream transmitter in the memory hub of each of the intermediate memory modules is operable to transmit the downstream initialization complete signal if the downstream initialization complete signal is being received by the downstream receiver and initialization of both the downstream receiver and the upstream receiver has been completed.

44. The memory system of claim 40 wherein the memory hub controller is further operable to switch the memory hub controller to a normal operating mode responsive to the receiver in the memory hub controller receiving the upstream initialization complete signal.

45. The memory system of claim 40 wherein each of the initialization complete signals comprises the transitioning of a predetermined series of binary values to a complement of the binary values.

46. The memory system of claim 45 wherein the receivers in the memory hub controller and in each of the memory hubs are operable to use a respective one of the predetermined series of binary values to initialize the receivers.

47. The memory system of claim 45 wherein the receivers in the memory hub controller and in each of the memory hubs are operable to use a respective one of the predetermined series of binary values and the complement of the respective one of the predetermined series of binary values to initialize the receivers.

48. The memory system of claim 40 wherein each of the transmitters is further operable to transmit a respective initialization signal, and each of the receivers is operable to receive a respective one of the initialization signals transmitted by a respective transmitter.

49. The memory system of claim 48 wherein each of the initialization complete signals comprises a change in the nature of a respective one of the initialization signals.

50. The memory system of claim 49 wherein each of the initialization signals comprises a predetermined series of binary values.

51. The memory system of claim 50 wherein the change in the nature of each of the initialization signals comprises a transitioning of the predetermined series of binary values to a complement of the predetermined series of binary values.

52. A memory module, comprising:

a plurality of memory devices; and

a memory hub coupled to the plurality of memory devices, the memory hub comprising;

a downstream receiver including an initialization circuit for initializing the receiver, the downstream receiver being operable to determine if a downstream initialization complete signal is being received by the downstream receiver, the downstream receiver further being operable to determine if initialization of the downstream receiver has been completed;

a downstream transmitter coupled to the downstream receiver in the memory hub, the downstream transmitter being operable to transmit a downstream initialization complete signal if the downstream initialization complete signal is being received by the downstream receiver and initialization of the downstream receiver has been completed;

an upstream receiver including an initialization circuit for initializing the receiver, the upstream receiver being operable to determine if an upstream initialization complete signal is being received by the upstream receiver; and

an upstream transmitter coupled to the upstream receiver, the upstream transmitter being operable to transmit an upstream initialization complete signal if an upstream initialization complete signal is being received by the upstream receiver and initialization of both the downstream receiver and the upstream receiver has been completed.

53. The memory module of claim 52 wherein the memory devices comprise dynamic random access memory devices.

54. The memory module of claim 52 wherein the downstream transmitter is operable to transmit the downstream initialization complete signal if the downstream initialization complete signal is being received by the downstream receiver and initialization of both the downstream receiver and the upstream receiver has been completed.

55. The memory module of claim 52 wherein each of the initialization complete signals comprises the transitioning of a predetermined series of binary values to a complement of the binary values.

56. The memory module of claim 55 wherein the receivers are operable to use a respective one of the predetermined series of binary values to initialize the receivers.

57. The memory module of claim 55 wherein the receivers are operable to use a respective one of the predetermined series of binary values and the complement of the respective one of the predetermined series of binary values to initialize the receivers.

58. The memory module of claim 52 wherein each of the transmitters is further operable to transmit a respective initialization signal, and each of the receivers is operable to receive a respective one of the initialization signals.

59. The memory module of claim 58 wherein each of the initialization complete signals comprises a change in the nature of a respective one of the initialization signals.

60. The memory module of claim 59 wherein each of the initialization signals comprises a predetermined series of binary values.

61. The memory module of claim 60 wherein the change in the nature of each of the initialization signals comprises a transitioning of the predetermined series of binary values to a complement of the predetermined series of binary values.

62. A processor-based system, comprising:

a processor having a processor bus;

a system controller coupled to the processor bus, the system controller having a peripheral device port;

at least one input device coupled to the peripheral device port of the system controller;

at least one output device coupled to the peripheral device port of the system controller;

at least one data storage device coupled to the peripheral device port of the system controller; and

a first upstream data bus;

a first downstream data bus;

a memory hub controller coupled to the processor bus, the memory hub controller comprising;

an upstream receiver including an initialization circuit for initializing the receiver, the upstream receiver being operable to determine if an upstream initialization complete signal is being received by the upstream receiver; and

a downstream transmitter transmitting a downstream initialization complete signal when the initialization of the upstream receiver has been completed;

a terminating memory module, comprising;

a plurality of memory devices; and

a memory hub coupled to the plurality of memory devices, the memory hub comprising;

a downstream receiver including an initialization circuit for initializing the receiver, the downstream receiver being operable to determine if a downstream initialization complete signal is being received by the downstream receiver, the downstream receiver further being operable to determine if initialization of the downstream receiver has been completed; and

an upstream transmitter transmitting an upstream initialization complete signal from the upstream transmitter if the downstream initialization complete signal is being received by the downstream receiver and initialization of at least the downstream receiver has been completed; and

at least one intermediate memory module, each intermediate memory module comprising;

a plurality of memory devices; and

a memory hub coupled to the plurality of memory devices, the memory hub comprising;

a downstream receiver coupled to the downstream transmitter in either the memory hub controller or in the memory hub of another of the intermediate memory modules, the downstream receiver including an initialization circuit for initializing the receiver, the downstream receiver being operable to determine if a downstream initialization complete signal is being received by the downstream receiver, the downstream receiver further being operable to determine if initialization of at least one of the downstream receiver and the upstream receiver has been completed;

a downstream transmitter coupled to the downstream receiver in the memory hub of either the terminating memory module or another of the intermediate memory modules, the downstream transmitter being operable to transmit a downstream initialization complete signal if the downstream initialization complete signal is being received by the downstream receiver and initialization of at least one of the downstream receiver and the upstream receiver has been completed;

an upstream receiver coupled to the upstream transmitter in the memory hub of either the terminating memory module or another of the intermediate memory modules, the upstream receiver including an initialization circuit for initializing the receiver, the upstream receiver being operable to determine if an upstream initialization complete signal is being received by the upstream receiver; and

an upstream transmitter coupled to the upstream receiver in either the memory hub controller or in the memory hub of another of the intermediate memory modules, the upstream transmitter being operable to transmit an upstream initialization complete signal if an upstream initialization complete signal is being received by the upstream receiver and initialization of both the downstream receiver and the upstream receiver has been completed.

63. The processor-based system of claim 62 wherein the memory devices in each of the memory modules comprise dynamic random access memory devices.

64. The memory system of claim 62 wherein the downstream transmitter in the memory hub of each of the intermediate memory modules is operable to transmit the downstream initialization complete signal if the downstream initialization complete signal is being received by the downstream receiver and initialization of the downstream receiver but not necessarily the upstream receiver has been completed.

65. The memory system of claim 62 wherein the downstream transmitter in the memory hub of each of the intermediate memory modules is operable to transmit the downstream initialization complete signal if the downstream initialization complete signal is being received by the downstream receiver and initialization of both the downstream receiver and the upstream receiver has been completed.

66. The memory system of claim 62 wherein the memory hub controller is further operable to switch the memory hub controller to a normal operating mode responsive to the receiver in the memory hub controller receiving the upstream initialization complete signal.

67. The memory system of claim 62 wherein each of the initialization complete signals comprises the transitioning of a predetermined series of binary values to a complement of the binary values.

68. The memory system of claim 67 wherein the receivers in the memory hub controller and in each of the memory hubs are operable to use a respective one of the predetermined series of binary values to initialize the receivers.

69. The memory system of claim 67 wherein the receivers in the memory hub controller and in each of the memory hubs are operable to use a respective one of the predetermined series of binary values and the complement of the respective one of the predetermined series of binary values to initialize the receivers.

70. The memory system of claim 62 wherein each of the transmitters is further operable to transmit a respective initialization signal, and each of the receivers is operable to receive a respective one of the initialization signals transmitted by a respective transmitter.

71. The memory system of claim 70 wherein each of the initialization complete signals comprises a change in the nature of a respective one of the initialization signals.

72. The memory system of claim 71 wherein each of the initialization signals comprises a predetermined series of binary values.

73. The memory system of claim 72 wherein the change in the nature of each of the initialization signals comprises a transitioning of the predetermined series of binary values to a complement of the predetermined series of binary values.