×

BATCH PROCESSING IN A NEURAL NETWORK PROCESSOR

  • US 20160342890A1
  • Filed: 09/03/2015
  • Published: 11/24/2016
  • Est. Priority Date: 05/21/2015
  • Status: Active Grant
First Claim
Patent Images

1. A method for generating a respective neural network output for each of a plurality of inputs, wherein the generating comprises processing each input through each of a plurality of neural network layers to generate the respective neural network output for the input, wherein the neural network layers are arranged in a directed graph structure, and wherein each neural network layer has a respective batch size, the method comprising, for each of the neural network layers:

  • receiving a plurality of inputs to be processed at the neural network layer;

    forming one or more batches of inputs from the plurality of inputs, each batch having a number of inputs equal to the respective batch size for the neural network layer;

    selecting a number of the one or more batches of inputs to process, where a count of the inputs in the number of the one or more batches is greater than, less than, or equal to the respective associated batch size of a subsequent layer in the directed graph structure; and

    processing the number of the one or more batches of inputs to generate the respective neural network layer output.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×