Apparatus and method for partial evaluation of synaptic updates based on system events

• US 8,725,662 B2
• Filed: 09/21/2011
• Issued: 05/13/2014
• Est. Priority Date: 09/21/2011
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Brain Corporation
• Inventors: Nageswaran, Jayram Moorkanikara, Izhikevich, Eugene M., Piekniewski, Filip
• Primary Examiner(s): Gaffin, Jeffrey A
• Assistant Examiner(s): Afolabi, Ola Olude
• Application Number:
  US13/239,259
• Publication Number:
  US 20130073499A1
• Time in Patent Office: 965 Days
• Field of Search: 706/27
• US Class Current: 706/12
• CPC Class Codes: G06N 3/049 Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
• CPC Class Codes: G06N 3/063 using electronic means
• CPC Class Codes: G06N 3/08 Learning methods

Abstract

Apparatus and methods for partial evaluation of synaptic updates in neural networks. In one embodiment, a pre-synaptic unit is connected to a several post synaptic units via communication channels. Information related to a plurality of post-synaptic pulses generated by the post-synaptic units is stored by the network in response to a system event. Synaptic channel updates are performed by the network using the time intervals between a pre-synaptic pulse, which is being generated prior to the system event, and at least a portion of the plurality of the post synaptic pulses. The system event enables removal of the information related to the portion of the post-synaptic pulses from the storage device. A shared memory block within the storage device is used to store data related to post-synaptic pulses generated by different post-synaptic nodes. This configuration enables memory use optimization of post-synaptic units with different firing rates.

Claims

1. A method of operating a communications channel coupled to a post-synaptic unit in a computerized spiking neuronal network, the method comprising:

modifying the communications channel based on a first group of pulses associated with the post-synaptic unit, the first group of pulses occurring between a preceding trigger communicated via the communications channel and a system event;

maintaining the communications channel substantially unmodified between the system event and the preceding trigger; and

storing, in a shared memory block of a storage apparatus, information related to the first group of pulses and a second group of pulses, the second group of pulses being associated with one other post-synaptic unit.

2. The method of claim 1, wherein the system event is generated by a network entity in data communication with the post-synaptic unit and is based at least in part on a portion of the information being stored in the shared memory block, the portion of the information being related to at least one pulse of the first group of pulses.

3. The method of claim 2, wherein the system event is useful for removal of at least the portion from the shared memory block.

4. The method of claim 1, wherein the system event is generated based at least in part on a size of the shared memory block.

5. The method of claim 1, wherein:

the system event comprises a current trigger being communicated via the communications channel; and

the modifying the communications channel comprises determining an updated channel weight based at least in part on the preceding trigger, the system event, and at least a portion of the first group of pulses.

6. The method of claim 5, wherein:

the system event is generated by a network entity in data communication with the post-synaptic unit and is based at least in part on a first portion of the information being stored in the shared memory block, the first portion of the information being related to at least one pulse of the first group of pulses; and

the system event is useful for removal of at least the first portion of the information from the shared memory block.

7. The method of claim 6, further comprising modifying a state of the post-synaptic unit based at least in part on the updated channel weight.

8. The method of claim 5, wherein the determining the updated channel weight comprises:

performing a plurality of first updates based at least on a first plurality of intervals between the preceding trigger and generation time of a given pulse within the portion; and

performing a second update based at least on a second interval between the preceding trigger and the system event.

9. An apparatus configured to operate a communications channel coupled to a post-synaptic unit in a computerized spiking neuronal network, the apparatus comprising:

means for modifying the communications channel based on a first group of pulses associated with the post-synaptic unit, the first group of pulses occurring between a preceding trigger communicated via the communications channel and a system event;

means for maintaining the communications channel substantially unmodified between the system event and the preceding trigger; and

means for storing information related to the first group of pulses in a shift register.

10. The apparatus of claim 9, further comprising:

means for generating the system event by a pre-synaptic unit based at least in part on an idle interval exceeding a predetermined threshold, the idle interval comprising a time elapsed from a latest pulse of the first group of pulses being generated by the post-synaptic unit; and

means for generating the preceding trigger by the pre-synaptic unit.

11. The apparatus of claim 10, wherein the system event is configured to effectuate a modification of at least one channel connected to the pre-synaptic unit, the at least one channel comprising the communications channel.

12. The apparatus of claim 11, wherein the system event is configured to maintain a state of the post-synaptic unit, the state associated with a model used in operating the post-synaptic unit.

13. A method of operating a node of a spiking network, the method comprising:

responsive to a system event, storing in a storage device a plurality of intervals between a first trigger and a plurality of pulses generated by the node; and

performing a first update of a channel based at least in part on the plurality of intervals; and

wherein the first trigger is communicated to the node via the communications channel prior to the system event.

14. The method of claim 13, wherein:

first individual ones of the plurality of pulses are being generated prior to the system event; and

second individual ones of the plurality of intervals are configured based on information related to first individual ones of the plurality of pulses.

15. The method of claim 14, wherein:

the information related to the first individual ones of the plurality of pulses is stored in a block of a shared memory, a size of the block being larger than the size of another block configured to store the intervals in the storage device; and

the system event enables removal of the information from the shared memory, thereby enabling size reduction of the shared memory.

16. The method of claim 13, further comprising:

subsequent to performing the first update, performing a second update of the communications channel based on a second interval between a second trigger and a latest pulse of the plurality of pulses generated by the node;

wherein;

the first update and the second update cooperate to determine an updated channel weight; and

the second trigger is communicated via the communications channel subsequent to the system event.

17. The method of claim 16, further comprising:

storing, in a shared block, first information related to the plurality of pulses; and

storing, in the shared block, second information related to a group of pulses being generated by one other post-synaptic unit;

wherein;

the system event enables removal of data corresponding to at least one of (i) at least a portion of the first information, and/or (ii) at least a portion of the second information, from the shared block, the removed data corresponding to a first set of pulses; and

where the first set of pulses precedes a second set of pulses for which data remains stored in the shared block.

18. The method of claim 17, further comprising modifying a state of the node based at least in part on the updated channel weight, the second update performed subsequent to the first update.

19. The method of claim 13, further comprising:

storing, in a shared block, first information related to the plurality of pulses; and

storing, in the shared block, second information related to a group of pulses being generated by one other post-synaptic unit;

wherein;

the system event enables removal of data corresponding to at least one of (i) at least a portion of the first information, and/or (ii) at least a portion of the second information, from the shared block, the removed data corresponding to a first set of pulses; and

the first set of pulses precedes a second set of pulses for which data remains stored in the shared block.

20. The method of claim 19, wherein the storage device comprises a shift-register.

21. The method of claim 13, wherein:

the system event is generated by a network entity in data communication with the node and is based at least in part on a portion of information being stored in a shared memory block of the storage device, the portion being related to at least one pulse of the plurality of pulses; and

the system event is useful for removal of at least the portion from the shared memory block.

22. The method of claim 13, wherein the system event is generated by a pre-synaptic unit based at least in part on an idle interval exceeding a predetermined threshold, the idle interval comprising a time elapsed from a latest pulse of the plurality of pulses being generated by the node.

23. The method of claim 22, wherein the storage device comprises a shift register.

24. A method of optimizing operation of a shared storage of computerized network apparatus comprising at least one node coupled to a channel, the method comprising:

storing, in the shared storage, information related to a plurality of pulses associated with the at least one node;

updating the communications channel in response to a system event by at least a plurality of updates based on a plurality of intervals between a trigger being communicated through the communications channel, and the plurality of pulses; and

storing, in the shared storage, information related to a group of pulses associated with one other node;

wherein;

the updating the communications channel enables removal of at least a portion of the information from the shared storage;

the at least one node is characterized by a first output pulse rate;

the one other node is characterized by a second output pulse rate, the second output pulse rate being lower than the first output pulse rate; and

the shared storage comprises;

a first memory area configured to store data related to the plurality of pulses associated with the at least one node; and

at least a second memory area configured to store data related to the group of pulses associated with the one other node, the second memory area being smaller than the first memory area.

25. The method of claim 24, wherein:

the at least one node is characterized by a state; and

the system event is configured to maintain the state.

26. The method of claim 24, wherein receiving the system event comprises communicating a second triggering pulse via the communications channel.

27. The method of claim 26, further comprising:

modifying a state of the at least one node based at least in part on the second triggering pulse;

wherein updating the communications channel is executed prior to the modifying the state.