Method and apparatus for producing programmable probability distribution function of pseudo-random numbers

• US 9,417,845 B2
• Filed: 03/04/2014
• Issued: 08/16/2016
• Est. Priority Date: 10/02/2013
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Lamb, Aaron Douglass
• Primary Examiner(s): Vincent, David
• Application Number:
  US14/195,988
• Publication Number:
  US 20150095274A1
• Time in Patent Office: 896 Days
• Field of Search: 706/12, 706/45
• US Class Current: 1/1
• CPC Class Codes: G06F 7/584 using finite field arithmetic, e.g. using a linear feedback shift register
• CPC Class Codes: G06N 3/047 Probabilistic or stochastic networks
• CPC Class Codes: G06N 3/049 Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
• CPC Class Codes: G06N 3/063 using electronic means

Abstract

Certain aspects of the present disclosure provide methods and apparatus for producing programmable probability distribution function of pseudo-random numbers that can be utilized for filtering (dropping and passing) neuron spikes. The present disclosure provides a simpler, smaller, and lower-power circuit than that typically used. It can be programmed to produce any of a variety of non-uniformly distributed sequences of numbers. These sequences can approximate true probabilistic distributions, but maintain sufficient pseudo-randomness to still be considered random in a probabilistic sense. This circuit can be an integral part of a filter block within an ASIC chip emulating an artificial nervous system.

Claims

1. A method for reducing spikes in an artificial nervous system, the method comprising:

generating, by an apparatus, a sequence of random numbers;

performing, by the apparatus, bit-level operations on the generated sequence of random numbers to generate a first sequence of pseudo-random numbers with a programmable probability distribution function (PDF), wherein performing the bit-level operations on the generated sequence of random numbers comprises;

performing AND operation on bits of the sequence of random numbers;

passing the ANDed bits through a cascade of OR gates to obtain bit-mask values; and

applying the bit-mask values to bits of the sequence of random numbers to generate the first sequence of pseudo-random numbers with the programmable PDF;

generating, by the apparatus, another sequence of random numbers;

performing, by the apparatus, bit-level operations between the first sequence and the other sequence to generate a second sequence of pseudo-random numbers with a programmable PDF; and

dropping, by the apparatus, spikes associated with one or more artificial neurons of the artificial nervous system in accordance with the PDF of the second sequence of pseudo-random numbers.

2. The method of claim 1, wherein:

the sequence of random numbers is generated using first Linear Feedback Shift Registers (LFSRs), and

the other sequence of random numbers is generated using second LFSRs separate from the first LFSRs.

3. The method of claim 1, further comprising:

performing AND operation between the bits passed through the cascade of OR gates and a first bit-mask to obtain a range limited sequence of random numbers.

4. The method of claim 3, further comprising:

performing OR operation between bits of the range limited sequence and a second bit-mask to obtain another sequence of random numbers with a PDF having whitened low-value portions.

5. The method of claim 1, further comprising:

decoupling the first sequence from the second sequence using a controllable multiplexor.

6. The method of claim 5, further comprising:

performing bit-level operations using an output of the multiplexer, bits of the first sequence and bits of the other sequence to generate the second sequence of pseudo-random numbers with the programmable PDF.

7. The method of claim 1, further comprising:

performing OR operation between the second sequence of pseudo-random numbers and a bit-mask to adjust the programmable PDF of the second sequence.

8. The method of claim 1, wherein:

the sequence of random numbers is generated using a first Gold Code Generator, and

the other sequence of random numbers is generated using a second Gold Code Generator separate from the first Gold Code Generator.

9. An apparatus, comprising:

a first circuit configured to generate a sequence of random numbers;

a second circuit configured to perform bit-level operations on the generated sequence of random numbers to generate a first sequence of pseudo-random numbers with a programmable probability distribution function (PDF), wherein, to perform the bit-level operations on the generated sequence of random numbers, the second circuit is configured to;

perform AND operation on bits of the sequence of random numbers;

pass the ANDed bits through a cascade of OR gates to obtain bit-mask values; and

apply the bit-mask values to bits of the sequence of random numbers to generate the first sequence of pseudo-random numbers with the programmable PDF;

a third circuit configured to generate another sequence of random numbers;

a fourth circuit configured to perform bit-level operations between the first sequence and the other sequence to generate a second sequence of pseudo-random numbers with a programmable PDF; and

a fifth circuit configured to drop spikes associated with artificial neurons of an artificial nervous system comprising the apparatus in accordance with the PDF of the second sequence of Pseudo-random numbers.

10. The apparatus of claim 9, wherein:

the first circuit configured to generate the sequence of random numbers comprises first Linear Feedback Shift Registers (LFSRs), and

the third circuit configured to generate the other sequence of random numbers comprises second LFSRs separate from the first LFSRs.

11. The apparatus of claim 9, wherein the second circuit is further configured to:

perform AND operation between the bits passed through the cascade of OR gates and a first bit-mask to obtain a range limited sequence of random numbers.

12. The apparatus of claim 11, wherein the second circuit is further configured to:

perform OR operation between bits of the range limited sequence and a second bit-mask to obtain another sequence of random numbers with a PDF having whitened low-value portions.

13. The apparatus of claim 9, further comprising:

a controllable multiplexor configured to decouple the first sequence from the second sequence.

14. The apparatus of claim 13, wherein the fourth circuit is further configured to:

perform bit-level operations using an output of the multiplexer, bits of the first sequenc and bits of the other sequence to generate the second sequence of pseudo-random numbers with the programmable PDF.

15. The apparatus of claim 9, further comprising:

a fifth circuit configured to perform OR operation between the second sequence of pseudo-random numbers and a bit-mask to adjust the programmable PDF of the second sequence.

16. The apparatus of claim 9, wherein:

the first circuit configured to generate the sequence of random numbers comprises a first Gold Code Generator, and

the third circuit configured to generate the other sequence of random numbers comprises a second Gold Code Generator separate from the first Gold Code Generator.

17. An apparatus, comprising:

means for generating a sequence of random numbers;

means for performing bit-level operations on the generated sequence of random numbers to generate a first sequence of pseudo-random numbers with a programmable probability distribution function (PDF), wherein means for performing bit-level operations on the generated sequence of random numbers comprises;

means for performing AND operation on bits of the sequence of random numbers;

means for passing the ANDed bits through a cascade of OR gates to obtain bit-mask values; and

means for applying the bit-mask values to bits of the sequence of random numbers to generate the first sequence of pseudo-random numbers with the programmable PDF;

means for generating another sequence of random numbers;

means for performing bit-level operations between the first sequence and the other sequence to generate a second sequence of pseudo-random numbers with a programmable PDF; and

means for dropping spikes associated with artificial neurons of an artificial nervous system comprising the apparatus in accordance with the PDF of the second sequence of pseudo-random numbers.

18. The apparatus of claim 17, wherein:

the means for generating the sequence of random numbers comprises means for using first Linear Feedback Shift Registers (LFSRs), and

the means for generating the other sequence of random numbers comprises means for using second LFSRs separate from the first LFSRs.

19. The apparatus of claim 17, further comprising:

means for performing AND operation between the bits passed through the cascade of OR gates and a first bit-mask to obtain a range limited sequence of random numbers.

20. The apparatus of claim 19, further comprising:

means for performing OR operation between bits of the range limited sequence and a second bit-mask to obtain another sequence of random numbers with a PDF having whitened low-value portions.

21. The apparatus of claim 17, further comprising:

means for decoupling the first sequence from the second sequence using a controllable multiplexor.

22. The apparatus of claim 21, further comprising:

means for performing bit-level operations using an output of the multiplexer, bits of the first sequence and bits of the other sequence to generate the second sequence of pseudo-random numbers with the programmable PDF.

23. The apparatus of claim 17, further comprising:

means for performing OR operation between the second sequence of pseudo-random numbers and a bit-mask to adjust the programmable PDF of the second sequence.

24. The apparatus of claim 17, wherein:

the means for generating the sequence of random numbers comprises means for using a first Gold Code Generator, and

the means for generating the other sequence of random numbers comprises means for using a second Gold Code Generator separate from the first Gold Code Generator.

25. A non-transitory computer-readable medium having instructions executable to:

generate, by an apparatus, a sequence of random numbers;

perform, by the apparatus, bit-level operations on the generated sequence of random numbers to generate a first sequence of pseudo-random numbers with a programmable probability distribution function (PDF), wherein performing the bit-level operations on the generated sequence of random numbers comprises;

performing AND operation on bits of the sequence of random numbers;

passing the ANDed bits through a cascade of OR gates to obtain bit-mask values; and

applying the bit-mask values to bits of the sequence of random numbers to generate the first sequence of pseudo-random numbers with the programmable PDF;

generate, by the apparatus, another sequence of random numbers;

perform, by the apparatus, bit-level operations between the first sequence and the other sequence to generate a second sequence of pseudo-random numbers with a programmable PDF; and

drop spikes associated with artificial neurons of an artificial nervous system comprising the apparatus in accordance with the PDF of the second sequence of pseudo-random numbers.

26. The computer-readable medium of claim 25, wherein the computer-readable medium further comprising instructions executable to:

generate the sequence of random numbers by using first Linear Feedback Shift Registers (LFSRs), and

generate the other sequence of random numbers by using second LFSRs separate from the first LFSRs.

27. The computer-readable medium of claim 25, further comprising instructions executable to:

perform AND operation between the bits passed through the cascade of OR gates and a first bit-mask to obtain a range limited sequence of random numbers.

28. The computer-readable medium of claim 27, further comprising instructions executable to:

perform OR operation between bits of the range limited sequence and a second bit-mask to obtain another sequence of random numbers with a PDF having whitened low-value portions.

29. The computer-readable medium of claim 25, further comprising instructions executable to:

decouple the first sequence from the second sequence using a controllable multiplexor.

30. The computer-readable medium of claim 29, further comprising instructions executable to

perform bit-level operations using an output of the multiplexer, bits of the first sequence and bits of the other sequence to generate the second sequence of pseudo-random numbers with the programmable PDF.

31. The computer-readable medium of claim 25, further comprising instructions executable to:

perform OR operation between the second sequence of pseudo-random numbers and a bit-mask to adjust the programmable PDF of the second sequence.

32. The computer-readable medium of claim 25, further comprising instructions executable to:

generate the sequence of random numbers by using a first Gold Code Generator, and

generate the other sequence of random numbers by using a second Gold Code Generator separate from the first Gold Code Generator.