Mixed-precision memcomputing system

• US 10,114,613 B2
• Filed: 09/07/2016
• Issued: 10/30/2018
• Est. Priority Date: 09/07/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bekas, Konstantinos, Curioni, Alessandro, Eleftheriou, Evangelos S., Le Gallo-Bourdeau, Manuel, Sebastian, Abu, Tuma, Tomas
• Primary Examiner(s): Mai, Tan V.
• Application Number:
  US15/258,842
• Publication Number:
  US 20180067720A1
• Time in Patent Office: 783 Days
• Field of Search: 708513
• CPC Class Codes: G06F 17/12 Simultaneous equations , e.g. systems of linear equations
• CPC Class Codes: G06F 17/16 Matrix or vector computation , e.g. matrix-matrix or matrix-vector multiplication, matrix factorization matrix transposition G06F7/78
• CPC Class Codes: G06F 2207/4804 Associative memory or processor
• CPC Class Codes: G06F 7/48 using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
• CPC Class Codes: G06F 7/483 Computations with numbers represented by a non-linear combination of denominational numbers, e.g. rational numbers, logarithmic number system or floating-point numbers G06F7/4806, G06F7/4824, G06F7/49, G06F7/491, G06F7/544 take precedence

Abstract

A computing system includes computational memory and digital combinational circuitry operatively coupled with the computational memory. The computational memory is configured to perform computations at a prescribed precision. The digital combinational circuitry is configured to increase the precision of the computations performed by the computational memory. The computational memory and the digital combinational circuitry may be configured to iteratively perform a computation to a predefined precision. The computational memory may include circuitry configured to perform analog computation using values stored in the computational memory, and the digital combinational circuitry may include a central processing unit, a graphics processing unit and/or application specific circuitry. The computational memory may include an array of resistive memory elements having resistance or conductance values stored therein, the respective resistance or conductance values being programmable.

Claims

1. A computing system comprising:

computational memory configured to perform computations at a first precision; and

digital combinational circuitry operatively coupled with the computational memory and configured to increase the precision of the computations performed by the computational memory;

wherein the computational memory and the digital combinational circuitry are configured to iteratively perform a computation to a second precision that is a higher precision than the first precision.

2. The system of claim 1, wherein:

the computational memory comprises circuitry configured to perform analog computation using values stored in the computational memory; and

the digital combinational circuitry comprises at least one of a central processing unit, a graphics processing unit, and application specific circuitry.

3. The system of claim 1, wherein the computational memory and the digital combinational circuitry are implemented as discrete interconnected components.

4. The system of claim 1, wherein the computational memory and the digital combinational circuitry are integrated into a single chip.

5. The system of claim 1, wherein the computational memory comprises an array of resistive memory elements having resistance or conductance values stored therein, the respective resistance or conductance values being programmable.

6. The system of claim 5, wherein the computational memory is configured to perform a matrix multiplication computation.

7. The system of claim 5, wherein the computational memory further comprises a plurality of inputs, each input connected to a different plurality of resistive memory elements, wherein a current in each resistive memory element is a product of a voltage applied to the input connected to the resistive memory element and the conductance value of the corresponding resistive memory element.

8. The system of claim 7, wherein the computational memory further comprises a plurality of outputs, each output connected to a different plurality of resistive memory elements, wherein a current output from each output is a sum of currents in the plurality of resistive memory elements connected to the output.

9. The system of claim 5, wherein each of at least a subset of the resistive memory elements is selected from the group consisting of phase change memory, metal oxide resistive random-access memory (RAM), conductive bridge RAM, and magnetic RAM.

10. The system of claim 1, wherein the computational memory comprises a plurality of analog computing units, each of at least a subset of the analog computing units comprising at least one of transistors, resistors, capacitors and inductors.

11. The system of claim 1, wherein the computational memory comprises a plurality of inductive memory elements having inductance values stored therein, the respective inductance values being programmable.

12. The system of claim 1, wherein the computational memory comprises a plurality of capacitive memory elements having capacitance values stored therein, the respective capacitance values being programmable.

13. The system of claim 1, wherein the computational memory comprises a plurality of optical memory elements having transmission or absorption values stored therein, the respective transmission or absorption values being programmable.

14. The system of claim 1, further comprising circuitry configured to:

a) generate an initial solution;

b) compute a residual value representing an error in the initial solution using the digital combinational circuitry;

c) compute a solution based on the residual value using the computational memory;

d) update the solution based on the solution computed using the computational memory, the updating performed using the digital combinational circuitry;

e) compute an updated residual value representing an error in the current solution using the digital combinational circuitry; and

f) repeat c)-e) until the updated residual value is less than a predefined threshold.

15. The system of claim 1, wherein the computational memory and the digital combinational circuitry are configured to perform computations for a feedback control system.

16. The system of claim 15, wherein:

the digital combinatorial circuitry is configured to generate an error signal as a function of a reference signal and a sensor signal;

the computational memory is configured to generate a control signal as a function of the error signal; and

the sensor signal measures an operation based on the control signal.

17. The system of claim 16, wherein the digital combinatorial circuitry generates the error signal as a difference between the reference signal and the sensor signal.

18. The system of claim 16, wherein the computational memory comprises an array of resistive memory elements having resistance or conductance values stored therein, the respective resistance or conductance values being programmable, and wherein the computational memory is configured to generate the control signal as a function of the error signal by:

inducing a conductance change proportional to the error signal by applying one or more electrical pulses to at least one of the resistive memory elements;

generating a current measuring a conductance of the at least one of the memory resistive memory elements by applying a bias voltage thereto;

translating the current to a voltage signal; and

outputting the voltage signal as the control signal.

19. A method of computation, comprising:

performing a computation at a first precision using a computational memory;

increasing the precision of the computation using digital combinational circuitry; and

iteratively performing the computation and increasing the precision of the computation until a second precision that is a higher precision than the first precision is achieved.

20. The method of claim 19, further comprising:

a) generating an initial solution;

b) computing a residual value representing an error in the initial solution using the digital combinational circuitry;

c) computing a solution based on the residual value using the computational memory;

d) updating the solution based on the solution computed using the computational memory, the updating performed using the digital combinational circuitry;

e) computing an updated residual value representing an error in the current solution using the digital combinational circuitry; and

f) repeating c)-e) until the updated residual value is less than a predefined threshold.

21. A computer program product for performing computation comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer, to cause the computer to perform a method comprising:

performing a computation at a first precision using a computational memory;

increasing the precision of the computation using digital combinational circuitry; and

iteratively performing the computation and increasing the precision of the computation until a second precision that is a higher precision than the first precision is achieved.

22. The computer program product of claim 21, further comprising program instructions for:

a) generating an initial solution;

b) computing a residual value representing an error in the initial solution using the digital combinational circuitry;

c) computing a solution based on the residual value using the computational memory;

d) updating the solution based on the solution computed using the computational memory, the updating performed using the digital combinational circuitry;

e) computing an updated residual value representing an error in the current solution using the digital combinational circuitry; and

f) repeating c)-e) until the updated residual value is less than a predefined threshold.

23. A feedback control system, comprising:

computational memory configured to generate a control signal at a first precision; and

digital combinational circuitry operatively coupled with the computational memory and configured to generate an error signal as a function of the control signal and a reference signal, the reference signal being at a second precision that is a higher precision than the first precision.

24. A method of feedback control, the method comprising:

generating a control signal at a first precision using computational memory; and

generating an error signal as a function of the control signal and a reference signal using digital combinational circuitry, the reference signal being at a second precision that is a higher precision than the first precision.