Method and system for synchronizing communications links in a hub-based memory system

• US 7,529,273 B2
• Filed: 05/11/2006
• Issued: 05/05/2009
• Est. Priority Date: 03/29/2004
• Status: Active Grant

• Current Assignee: Micron Technology, Inc.
• Original Assignee: Micron Technology, Inc.
• Inventors: James, Ralph
• Primary Examiner(s): Ngo; Ricky
• Assistant Examiner(s): Yuen; Kan
• Application Number:
  US11/433,131
• Publication Number:
  US 20060218318A1
• Time in Patent Office: 1,090 Days
• Field of Search: 370/248, 370/249, 370/503, 370/512, 370/520, 711/154, 711/167
• US Class Current: 370/503
• CPC Class Codes: G06F 13/1684 using multiple buses
• CPC Class Codes: G06F 13/1689 Synchronisation and timing concerns synchronisation on a memory bus G06F13/4234

Abstract

A method is disclosed for synchronizing communications links in a memory hub system. The system includes a system controller and a plurality of memory hubs coupled in series, with pairs of downstream and upstream links being coupled between adjacent modules and the controller. The method includes synchronizing each upstream and downstream link. In a clockwise order starting with the downstream link coupled between the controller and the first memory module, the next adjacent clockwise link is signaled that the prior clockwise link has been synchronized. The method detects through the upstream link coupled between the controller and the first memory module when all links have been synchronized. In a clockwise order starting with the downstream link coupled between the controller and the first memory module, each link is enabled. The method detects through the upstream link coupled between the controller and first memory module when all links have been enabled.

Claims

1. A memory hub comprising:

downstream and upstream reception ports, each reception port operable in an initialization mode to synchronize reception of test data from a respective off-hub transmission port and further operable to enter a normal mode in response to receiving an enable command from the respective off-hub transmission port, each reception port operable to generate a completion signal in response to receiving inverted test data from the respective off hub transmission port and further operable to generate an enable signal in response to receiving the enable command from the respective off-hub transmission port; and

downstream and upstream transmission ports, each transmission port operable in the initialization mode to synchronize transmission of test data to a respective off-hub reception port and further operable to enter the normal mode in response to receiving an enable signal from a respective reception port of the memory hub, each transmission port operable to transmit inverted test data to the respective off-hub reception port in response to receiving a completion signal from the respective reception port of the memory hub and operable to generate an enable command for the respective off-hub reception port in response to receiving the enable signal from the respective reception port of the memory hub.

2. The memory hub of claim 1 wherein the downstream and upstream reception ports each comprise a reception port operable to adjust a phase of a generated receive clock signal relative to the test data received from the respective off-hub transmission port during the initialization mode.

3. The memory hub of claim 1 wherein the downstream and upstream transmission ports each comprise a transmission port operable to generate a no-operation command as the enable command.

4. The memory hub of claim 1, further comprising local hub circuitry coupled to the reception and transmission ports, the local control circuitry operable to process memory requests during the normal mode and to develop corresponding memory signals on a memory bus output.

5. The memory hub of claim 4 wherein the memory signals comprise address, data, and control signals.

6. The memory hub of claim 1 wherein the reception ports include optical interfaces adapted to receive data words from an optical communications link.

7. The memory hub of claim 6 wherein the downstream reception port and the upstream transmission port are adapted to be coupled to the same optical communications link, and wherein the downstream transmission port and the upstream reception port are adapted to be coupled to the same optical communications link.

8. The memory hub of claim 7 wherein the optical communications link comprises an optical fiber.

9. The memory hub of claim 1 wherein the downstream and upstream reception ports each comprise a reception port operable to generate an inversion signal as the completion signal in response to receiving inverted test data.

10. A memory module comprising:

a plurality of memory devices; and

a memory hub comprising;

downstream and upstream reception ports, each reception port operable in an initialization mode to synchronize reception of test data from a respective off-hub transmission port and further operable to enter a normal mode in response to receiving an enable command from the respective off-hub transmission port, each reception port operable to generate a completion signal in response to receiving inverted test data from the respective off hub transmission port and further operable to generate an enable signal in response to receiving the enable command from the respective off-hub transmission port; and

downstream and upstream transmission ports, each transmission port operable in the initialization mode to synchronize transmission of test data to a respective off-hub reception port and further operable to enter the normal mode in response to receiving an enable signal from a respective reception port of the memory hub, each transmission port operable to transmit inverted test data to the respective off-hub reception port in response to receiving a completion signal from the respective reception port of the memory hub and operable to generate an enable command for the respective off-hub reception port in response to receiving the enable signal from the respective reception port of the memory hub.

11. The memory hub of claim 10 wherein the downstream and upstream reception ports each comprise a reception port operable to adjust a phase of a generated receive clock signal relative to the test data received from the respective off-hub transmission port during the initialization mode.

12. The memory hub of claim 10 wherein the downstream and upstream transmission ports each comprise a transmission port operable to generate a no-operation command as the enable command.

13. The memory hub of claim 10, further comprising local hub circuitry coupled to the reception and transmission ports, the local control circuitry operable to process memory requests during the normal mode and to develop corresponding memory signals on a memory bus output.

14. The memory hub of claim 10 wherein the downstream and upstream reception ports each comprise a reception port operable to generate an inversion signal as the completion signal in response to receiving inverted test data.

15. A memory system comprising:

a system controller;

a plurality of memory modules, each memory module being coupled to adjacent memory modules through respective high-speed communications links, at least one of the memory modules being coupled to the system controller through a respective high-speed communications link, and each memory module comprising;

a plurality of memory devices;

and a memory hub, comprising;

downstream and upstream reception ports, each reception port operable in an initialization mode to synchronize reception of test data from a respective off-hub transmission port and further operable to enter a normal mode in response to receiving an enable command from the respective off-hub transmission port, each reception port operable to generate a completion signal in response to receiving inverted test data from the respective off-hub transmission port and further operable to generate the enable signal in response to receiving an enable command from the respective off-hub transmission port; and

downstream and upstream transmission ports, each transmission port operable in the initialization mode to synchronize transmission of test data to a respective off-hub reception port and further operable to enter the normal mode in response to receiving an enable signal from a respective reception port of the memory hub, each transmission port operable to transmit inverted test data to the respective off-hub reception port in response to receiving a completion signal from the respective reception port of the memory hub and operable to generate an enable command for the respective off-hub reception port in response to receiving the enable signal from the respective reception port of the memory hub.

16. The memory hub of claim 15 wherein the downstream and upstream reception ports each comprise a reception port operable to adjust a phase of a generated receive clock signal relative to the test data received from the respective off-hub transmission port during the initialization mode.

17. The memory hub of claim 15 wherein the downstream and upstream transmission ports each comprise a transmission port operable to generate a no-operation command as the enable command.

18. The memory hub of claim 15, further comprising local hub circuitry coupled to the reception and transmission ports, the local control circuitry operable to process memory requests during the normal mode and to develop corresponding memory signals on a memory bus output.

19. The memory hub of claim 15 wherein the downstream and upstream reception ports each comprise a reception port operable to generate an inversion signal as the completion signal in response to receiving inverted test data.

20. A computer system comprising:

a processor;

a system controller coupled to the processor through respective downstream and upstream high-speed communications links;

a memory system, comprising;

a system controller;

a plurality of memory modules, each memory module being coupled to adjacent memory modules through respective high-speed communications links, at least one of the memory modules being coupled to the system controller through a respective high-speed communications link, and each memory module comprising;

a plurality of memory devices;

downstream and upstream reception ports, each reception port operable in an initialization mode to synchronize reception of test data from a respective off-hub transmission port and further operable to enter a normal mode in response to receiving an enable command from the respective off-hub transmission port, each reception port operable to generate a completion signal in response to receiving inverted test data from the respective off-hub transmission port and further operable to generate an enable signal in response to receiving the enable command from the respective off-hub transmission port; and

downstream and upstream transmission ports, each transmission port operable in the initialization mode to synchronize transmission of test data to a respective off-hub reception port and further operable to enter the normal mode in response to receiving an enable signal from a respective reception port of the memory hub, each transmission port operable to transmit inverted test data to the respective off-hub reception port in response to receiving a completion signal from the respective reception port of the memory hub and operable to generate an enable command for the respective off-hub reception port in response to receiving the enable signal from the respective reception port of the memory hub.

21. The memory hub of claim 20 wherein the downstream and upstream reception ports each comprise a reception port operable to adjust a phase of a generated receive clock signal relative to the test data received from the respective off-hub transmission port during the initialization mode.

22. The memory hub of claim 20 wherein the downstream and upstream transmission ports each comprise a transmission port operable to generate a no-operation command as the enable command.

23. The memory hub of claim 20, further comprising local hub circuitry coupled to the reception and transmission ports, the local control circuitry operable to process memory requests during the normal mode and to develop corresponding memory signals on a memory bus output.

24. The memory hub of claim 20 wherein the downstream and upstream reception ports each comprise a reception port operable to generate an inversion signal as the completion signal in response to receiving inverted test data.