Flash / Phase-Change Memory in Multi-Ring Topology Using Serial-Link Packet Interface

• US 20080016269A1
• Filed: 07/05/2007
• Published: 01/17/2008
• Est. Priority Date: 03/17/2004
• Status: Active Grant

• Current Assignee: Super Talent Electronics, Inc.
• Original Assignee: Super Talent Electronics, Inc.
• Inventors: Chow, David, Lee, Charles, Yu, Frank
• Granted Patent: US 7,475,174 B2
• Time in Patent Office: Days
• US Class Current: 711/103
• CPC Class Codes: G06F 13/1684 using multiple buses
• CPC Class Codes: G11C 13/0004 comprising amorphous/crystalline phase transition cells
• CPC Class Codes: G11C 16/102 External programming circuits, e.g. EPROM programmers; In-circuit programming or reprogramming; EPROM emulators
• CPC Class Codes: G11C 2216/30 Reduction of number of input/output pins by using a serial interface to transmit or receive addresses or data, i.e. serial access memory

Abstract

A multi-ring memory controller sends request packets to multiple rings of serial flash-memory chips. Each of the multiple rings has serial flash-memory chips with serial links in a uni-directional ring. Each serial flash-memory chip has a bypassing transceiver with a device ID checker that bypasses serial packets to a clock re-synchronizer and bypass logic for retransmission to the next device in the ring, or extracts the serial packet to the local device when an ID match occurs. Serial packets pass through all devices in the ring during one round-trip transaction from the controller. The average latency of one round is constant for all devices on the ring, reducing data-dependent performance, since the same packet latency occurs regardless of the data location on the ring. The serial links can be a Peripheral Component Interconnect (PCI) Express bus. Packets have modified-PCI-Express headers that define the packet type and data-payload length.

Claims

1. A multi-ring serial-bus memory system comprising:

a multi-ring memory controller for generating request packets that contain flash commands, and for receiving completion packets in response to the flash commands;

a first-ring serial link output of the multi-ring memory controller for outputting request packets to a first ring;

a first-ring serial link input of the multi-ring memory controller for receiving completion packets from the first ring in response to request packets sent through the first-ring serial link output;

a first ring of serial flash-memory chips, each serial flash-memory chip in the first ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the first ring is connected to the serial output of a following serial flash-memory chip in the first ring, and wherein the serial input of an initial serial flash-memory chip in the first ring is connected to the first-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the first ring is connected to the first-ring serial link input;

a second-ring serial link output of the multi-ring memory controller for outputting request packets to a second ring;

a second-ring serial link input of the multi-ring memory controller for receiving completion packets from the second ring in response to request packets sent through the second-ring serial link output;

a second ring of serial flash-memory chips, each serial flash-memory chip in the second ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the second ring is connected to the serial output of a following serial flash-memory chip in the second ring, and wherein the serial input of an initial serial flash-memory chip in the second ring is connected to the second-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the second ring is connected to the second-ring serial link input; and

a bypassing transceiver in each serial flash-memory chip, the bypassing transceiver comparing a device identifier of a request packet to a current device identifier for the serial flash-memory chip and bypassing and retransmitting the request packet through the serial output when the device identifier mismatches the current device identifier, and decoding the request packet and processing a flash command to generate a completion packet for transmission over the serial output when the device identifier matches the current device identifier,

whereby request packets and completion packets are bypassed by serial flash-memory chips in rings connected to the multi-ring memory controller.

2. The multi-ring serial-bus memory system of claim 1 wherein each serial flash-memory chip comprises:

a flash-memory array of electrically-erasable programmable read-only memory (EEPROM) cells;

row and column decoders for selecting EEPROM cells in the flash-memory array for reading, writing, or erasing in response to a flash address;

a serial-bus interface to the serial input and to the serial output of the serial flash-memory chip, the serial-bus interface connected to pins of the serial flash-memory chip, for receiving serial data from the serial input and for transmitting serial data over the serial output;

a serial engine, coupled to the serial-bus interface, for converting serial data from the serial input to parallel data;

an internal controller, coupled to the serial engine, for responding to flash commands sent to the serial input in request packets, and for generating completion packets that are sent through the serial output in response to the flash commands; and

data buffers, coupled between the flash-memory array and the internal controller, for buffering data read from the EEPROM cells in response to the internal controller decoding a read flash command in a read-request packet, the data being loaded into a data payload of a completion packet;

wherein the internal controller programs data into the EEPROM cells through the data buffers in response to a program flash command in a write-request packet received over the serial input,

whereby the serial flash-memory chip has a serial-packet interface for commands, address, and data.

3. The multi-ring serial-bus memory system of claim 2 wherein the write-request packet contains a program flash command;

wherein the internal controller generates a vendor-defined message packet with a completion status for transmission through the serial output after the EEPROM cells have been programmed, the vendor-defined message packet being part of a different serial-bus transaction than the write-request packet that initiated programming of the EEPROM cells;

whereby the vendor-defined message packet is generated after completion of a program operation.

4. The multi-ring serial-bus memory system of claim 3 wherein the write-request packet contains a cache-program flash command;

wherein the internal controller generates a message-request packet for transmission through the serial output before completion of programming the EEPROM cells, the message-request packet being part of a same serial-bus transaction for the write-request packet that initiated programming of the EEPROM cells.

5. The multi-ring serial-bus memory system of claim 4 wherein an erase flash operation is initiated by the internal controller receiving an erase flash command in a vendor-defined message packet received by the serial input;

wherein the internal controller generates a second message packet for transmission through the serial output after completion of the erase flash operation, the second message packet being part of a different serial-bus transaction than the vendor-defined message packet that initiated erasing of the EEPROM cells;

whereby the second message packet is generated after completion of an erase flash operation.

6. The multi-ring serial-bus memory system of claim 5 wherein the internal controller resets the serial flash-memory chip in response to a reset-flash command in the vendor-defined message packet received by the serial input.

7. The multi-ring serial-bus memory system of claim 6 wherein the internal controller generates a completion packet with a copy of a status register as a data payload in response to a configuration-read-request packet received by the serial input;

wherein the status register contains status flags or an identifier of the serial flash-memory chip.

8. The multi-ring serial-bus memory system of claim 7 wherein each packet sent through the serial output or received by the serial input contains a header having a type field and a format field that define a type and a format for each packet,

wherein packet types include the read-request packet, the write-request packet, and a message packet sent to the serial flash-memory chip, and the completion packet and a message packet generated by the internal controller.

9. The multi-ring serial-bus memory system of claim 8 wherein the write-request packet contains a data payload containing data to program into the EEPROM cells, but the read-request packet contains no data payload;

wherein the completion packet generated in response to the read-request packet contains a data payload containing data read from the EEPROM cells.

10. The multi-ring serial-bus memory system of claim 9 wherein the read-request packet contains the flash address that is sent to the row and column decoders to select data in the EEPROM cells for reading;

wherein the write-request packet contains the flash address that is sent to the row and column decoders to select EEPROM cells for programming.

11. The multi-ring serial-bus memory system of claim 3 wherein a serial link between the serial output of the prior serial flash-memory chip and the serial input of the following serial flash-memory chip is a Universal-Serial-Bus (USB), a Peripheral Component Interconnect (PCI) Express bus, a Firewire IEEE 1394 bus, a Serial ATA bus, or a Serial Attached Small-Computer System Interface bus.

12. The multi-ring serial-bus memory system of claim 4 wherein the flash address has lower address bits that indicate when a flash command conveyed by the request packet is the cache-program flash command, the program flash command, or a copy-back-program flash command;

wherein the lower address bits are not necessary to uniquely locate EEPROM cells within the flash-memory array,

whereby lower address bits in the flash address select a type of write operation.

13. The multi-ring serial-bus memory system of claim 3 wherein the bypassing transceiver further comprises:

a receiver coupled to the serial input, for receiving differential serial data;

a transmitter coupled to the serial output, for sending differential serial data;

a device ID checker for comparing the device identifier of the request packet to the current device identifier for the serial flash-memory chip;

a receive state machine, coupled to receive serial data from the Device ID checker when the device identifier matches the current device identifier;

a transmit state machine for transmitting serial data generated by the serial flash-memory chip in response to the flash command in the request packet; and

a clock synchronizer and bypass logic, coupled to the transmit state machine and coupled to the device ID checker, for bypassing request packets and completion packets to the transmitter when the device identifier mismatches the current device identifier, and for synchronizing bypassed packets and serial data from the transmit state machine for transmission by the transmitter.

14. The multi-ring serial-bus memory system of claim 13 further comprising:

a third-ring serial link output of the multi-ring memory controller for outputting request packets to a third ring;

a third-ring serial link input of the multi-ring memory controller for receiving completion packets from the third ring in response to request packets sent through the third-ring serial link output;

a third ring of serial flash-memory chips, each serial flash-memory chip in the third ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the third ring is connected to the serial output of a following serial flash-memory chip in the third ring, and wherein the serial input of an initial serial flash-memory chip in the third ring is connected to the third-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the third ring is connected to the third-ring serial link input,

whereby the multi-ring memory controller drives request packets to three rings of the serial flash-memory chips.

15. A serial-ring non-volatile memory sub-system comprising:

a serial-ring memory controller means for generating request packets that contain non-volatile-memory commands, and for receiving completion packets in response to the non-volatile-memory commands;

wherein the serial-ring memory controller means further comprises a first-ring serial link output means for outputting request packets to a first ring and a first-ring serial link input means for receiving completion packets from the first ring in response to the request packets sent through the first-ring serial link output means;

a first ring of serial non-volatile memory devices, each serial non-volatile memory device in the first ring having a serial input and a serial output and a non-volatile-memory array, wherein the serial output of a prior serial non-volatile memory device in the first ring is connected to the serial output of a following serial non-volatile memory device in the first ring, and wherein the serial input of an initial serial non-volatile memory device in the first ring is connected to the first-ring serial link output means, and wherein the serial output of a last serial non-volatile memory device in the first ring is connected to the first-ring serial link input means; and

bypassing transceiver means, in each serial non-volatile memory device, for comparing a device identifier of a request packet to a current device identifier for the serial non-volatile memory device and bypassing and retransmitting the request packet through the serial output when the device identifier mismatches the current device identifier, and for decoding the request packet and processing a non-volatile-memory command to generate a completion packet for transmission over the serial output when the device identifier matches the current device identifier,

whereby the first ring of serial non-volatile memory devices is controlled by the serial-ring memory controller means.

16. The serial-ring non-volatile memory sub-system of claim 15 wherein the serial-ring memory controller means further comprises a second-ring serial link output means for outputting request packets to a second ring and a second-ring serial link input means for receiving completion packets from the second ring in response to request packets sent through the second-ring serial link output means;

a second ring of serial non-volatile memory devices, each serial non-volatile memory device in the second ring having a serial input and a serial output and a non-volatile-memory array, wherein the serial output of a prior serial non-volatile memory device in the second ring is connected to the serial output of a following serial non-volatile memory device in the second ring, and wherein the serial input of an initial serial non-volatile memory device in the second ring is connected to the second-ring serial link output means, and wherein the serial output of a last serial non-volatile memory device in the second ring is connected to the second-ring serial link input means;

whereby request packets and completion packets are bypassed by serial non-volatile memory devices in rings connected to the serial-ring memory controller means.

17. The serial-ring non-volatile memory sub-system of claim 16 wherein each serial non-volatile memory device comprises:

serial-bus interface means for receiving serial packets from the serial input and for transmitting serial packets to the serial output;

wherein the serial packets comprise a memory-read-request packet, a memory-write-request packet, a configuration-read-request packet, and an input message packet input to the serial non-volatile-memory device, and a completion packet and an output message packet output from the serial non-volatile-memory device;

non-volatile memory means for storing data in non-volatile memory cells that do not lose data when power is removed;

controller means, coupled to the non-volatile memory means and to the serial-bus interface means, for performing operations identified by commands in the serial packets, the operations including;

reading data from the non-volatile memory means at a non-volatile address included in a header for the memory-read-request packet to generate a data payload for the completion packet;

writing data to the non-volatile memory means at the non-volatile address included in a header for the memory-write-request packet, the data being sent in a data payload in the memory-write-request packet;

reading a status from a configuration register identified by a header in the configuration-read-request packet to generate a data payload for the completion packet;

erasing a block of memory in the non-volatile memory means in response to an erase indicator in a header in the input message packet and generating the output message packet once erasing is completed; and

resetting the serial non-volatile-memory device in response to a reset indicator in a header in the input message packet,

whereby operations are performed by the serial non-volatile-memory device in response to commands in serial packets received over the serial input include generation of completion packets with the data payload read from the non-volatile memory means.

18. The serial-ring non-volatile memory sub-system of claim 17 further comprising:

transaction-layer means, coupled to the controller means, for generating the completion packet by attaching a completion-packet header to the data payload, and for generating the output message packet by generating a message header indicating a completion status;

data-link layer means, coupled to the controller means, for encapsulating a transaction-layer packet generated by the controller means by adding a sequence number to a header and a checksum to generate a data-link packet; and

physical-layer means, in the serial-bus interface means, for framing the data-link packet for transmission over the serial output.

19. The serial-ring non-volatile memory sub-system of claim 15 wherein the non-volatile memory means comprises flash-memory cells or phase-change-memory cells.

20. A Peripheral Component Interconnect (PCI) Express flash-memory serial-ring system comprising:

a multi-ring memory controller for generating request packets that contain flash commands, and for receiving completion packets in response to the flash commands;

a first-ring serial link output of the multi-ring memory controller for outputting request packets to a first ring;

a first-ring serial link input of the multi-ring memory controller for receiving completion packets from the first ring in response to request packets sent through the first-ring serial link output;

a first ring of serial flash-memory chips, each serial flash-memory chip in the first ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the first ring is connected to the serial output of a following serial flash-memory chip in the first ring, and wherein the serial input of an initial serial flash-memory chip in the first ring is connected to the first-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the first ring is connected to the first-ring serial link input;

a second-ring serial link output of the multi-ring memory controller for outputting request packets to a second ring;

a second-ring serial link input of the multi-ring memory controller for receiving completion packets from the second ring in response to request packets sent through the second-ring serial link output;

a second ring of serial flash-memory chips, each serial flash-memory chip in the second ring having a serial input and a serial output and a flash-memory array, wherein the serial output of a prior serial flash-memory chip in the second ring is connected to the serial output of a following serial flash-memory chip in the second ring, and wherein the serial input of an initial serial flash-memory chip in the second ring is connected to the second-ring serial link output, and wherein the serial output of a last serial flash-memory chip in the second ring is connected to the second-ring serial link input;

a bypassing transceiver in each serial flash-memory chip, the bypassing transceiver comparing a device identifier of a request packet to a current device identifier for the serial flash-memory chip and bypassing and retransmitting the request packet through the serial output when the device identifier mismatches the current device identifier, and decoding the request packet and processing the flash command to generate a completion packet for transmission over the serial output when the device identifier matches the current device identifier,

wherein each serial flash-memory chip comprises;

a flash memory array of non-volatile electrically-erasable programmable read-only memory (EEPROM) cells;

address decoders, receiving a flash address, the address decoders selecting a subset of the EEPROM cells for reading, writing, or erasing;

a high-voltage generator for generating elevated voltages above a power-supply voltage for programming and erasing the EEPROM cells;

data buffers for storing data being written to the EEPROM cells;

a command register receiving a non-volatile-memory command;

control logic, responsive to the non-volatile-memory command in the command register, for controlling reading, writing, and erasing of the EEPROM cells;

a serial interface to external pins of the PCI Express flash-memory chip that connect to the serial input and to the serial output that are externally connected to different external devices, the serial interface having a physical layer;

wherein the serial input connects to half of a PCI Express serial bus having differential data lines that carry data serially;

wherein the serial output connects to half of a PCI Express serial bus having differential data lines that carry data serially;

a controller, connected between the serial interface and the command register and data buffers, the controller comprising;

a data-link layer that encapsulates transaction-layer packets for transmission over the serial output after framing by the physical layer;

a transaction layer that generates headers to attach to data payloads to generate the transaction-layer packets;

read operation means, responsive to a memory-read-request packet received by the serial input having a header with the flash address, for sending a read command to the command register and sending the flash address to the address decoders, and transferring data read from the EEPROM cells from the data buffers to the transaction layer as a data payload, the transaction layer attaching the data payload to a header to generate a completion packet with the read data, the completion packet being sent over the serial output as a response to the memory-read-request packet;

program operation means, responsive to a memory-write-request packet received over the serial input having a header with the flash address, for sending a write command to the command register and sending the flash address to the address decoders, and transferring data write from a data payload of the memory-write-request packet to the data buffers for writing to the EEPROM cells;

erase operation means, responsive to a message packet received over the serial input having a header with an erase indicator, for sending an erase command to the command register, and generating a message packet for transmission over the serial output once the EEPROM cells have been erased; and

reset operation means, responsive to a message packet received over the serial input having a header with a reset indicator, for sending a reset command to the control logic to reset the control logic and to reset the controller,

whereby operations indicated by commands in serial packets received over the serial input are executed and data is returned in data payloads of serial packets.