SYSTEM AND METHOD FOR PARALLELIZING CONVOLUTIONAL NEURAL NETWORKS
4 Assignments
0 Petitions
Accused Products
Abstract
A parallel convolutional neural network is provided. The CNN is implemented by a plurality of convolutional neural networks each on a respective processing node. Each CNN has a plurality of layers. A subset of the layers are interconnected between processing nodes such that activations are fed forward across nodes. The remaining subset is not so interconnected.
-
Citations
22 Claims
-
1. (canceled)
-
2. A system comprising:
-
a plurality of parallel neural networks, wherein the plurality of parallel neural network each receive a same input and collectively generate a predicted output based on the input, wherein each of the neural networks comprises a respective plurality of layers, wherein each plurality of layers comprises an interconnected layer and a non-interconnected layer, and wherein processing data through the layers of each of the plurality of parallel neural networks comprises; providing output from the interconnected layer to at least one layer of at least one different parallel neural network of the plurality of parallel neural networks; and providing output from the non-interconnected layer only to a layer of the same parallel neural network. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method comprising:
-
processing data using each of a plurality of parallel neural networks, wherein the plurality of parallel neural network each receive a same input and collectively generate a predicted output based on the input, wherein each of the neural networks comprises a respective plurality of layers, wherein each plurality of layers comprises an interconnected layer and a non-interconnected layer, wherein processing data using each of the plurality of parallel neural networks comprises processing the data through the layers of each of the plurality of parallel neural networks comprises, and wherein processing the data through the layers of each of the plurality of parallel neural networks comprises; providing output from the interconnected layer to at least one layer of at least one different parallel neural network of the plurality of parallel neural networks; and providing output from the non-interconnected layer only to a layer of the same parallel neural network. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A computer storage medium encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
-
processing data using each of a plurality of parallel neural networks, wherein the plurality of parallel neural network each receive a same input and collectively generate a predicted output based on the input, wherein each of the neural networks comprises a respective plurality of layers, wherein each plurality of layers comprises an interconnected layer and a non-interconnected layer, wherein processing data using each of the plurality of parallel neural networks comprises processing the data through the layers of each of the plurality of parallel neural networks comprises, and wherein processing the data through the layers of each of the plurality of parallel neural networks comprises; providing output from the interconnected layer to at least one layer of at least one different parallel neural network of the plurality of parallel neural networks; and providing output from the non-interconnected layer only to a layer of the same parallel neural network.
-
Specification