Ensemble learning based image classification systems

• US 10,482,374 B1
• Filed: 07/03/2019
• Issued: 11/19/2019
• Est. Priority Date: 10/22/2018
• Status: Active Grant

• Current Assignee: Gyrfalcon Technology Inc.
• Original Assignee: Gyrfalcon Technology Inc.
• Inventors: Yang, Lin, Dong, Patrick Z., Young, Charles Jin, Dong, Jason Z., Lin, Michael, Sun, Baohua
• Primary Examiner(s): Dang, Duy M
• Application Number:
  US16/503,402
• Time in Patent Office: 139 Days
• CPC Class Codes: G06F 18/214 Generating training patterns; Bootstrap methods, e.g. bagging or boosting
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06F 18/2413 based on distances to training or reference patterns
• CPC Class Codes: G06F 18/254 of classification results, e.g. of results related to same input data
• CPC Class Codes: G06F 18/259 Fusion by voting
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 20/20 Ensemble learning
• CPC Class Codes: G06N 3/045 Combinations of networks
• CPC Class Codes: G06N 3/063 using electronic means
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G06N 7/00 Computing arrangements based on specific mathematical models
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/809 of classification results, e.g. where the classifiers operate on the same input data
• CPC Class Codes: G06V 10/955 using specific electronic processors
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60

Abstract

An ensemble learning based image classification system contains multiple cellular neural networks (CNN) based integrated circuits (ICs) operatively coupling together as a set of base learners of an ensemble for an image classification task. Each CNN based IC is configured with at least one distinct deep learning model in form of filter coefficients. The ensemble learning based image classification system further contains a controller configured as a meta learner of the ensemble and a memory based data buffer for holding various data used in the ensemble by the controller and the CNN based ICs. Various data may include input imagery data to be classified. Various data may also include extracted feature vectors or image classification outputs out of the set of base learners. The extracted feature vectors or image classification outputs are then used by the meta learner to further perform the image classification task.

Claims

1. An ensemble learning based image classification system comprising:

a plurality of cellular neural networks (CNN) based integrated circuits (ICs) with one of the plurality of CNN based ICs configured as a meta learner of an ensemble for an image classification task while the remaining CNN based ICs operatively coupling together as a set of base learners, each base learner being configured with at least one of a plurality of distinct deep learning models;

a controller configured for managing data and computation flow of the ensemble; and

a memory based data buffer for holding input imagery data to be classified via the ensemble.

2. The ensemble learning based image classification system of claim 1, wherein said each of the plurality of CNN based ICs further comprising:

a plurality of cellular neural networks (CNN) processing engines operatively coupled to at least one input/output data bus, the plurality of CNN processing engines being connected in a loop with a clock-skew circuit, each CNN processing engine comprising;

a CNN processing block configured for simultaneously performing convolutional operations using the input imagery data and pre-trained filter coefficients of the at least one of the plurality of distinct deep learning models;

a first set of memory buffers operatively coupling to the CNN processing block for storing relevant portion of the input imagery data; and

a second set of memory buffers operative coupling to the CNN processing block for storing the pre-trained filter coefficients.

3. The ensemble learning based image classification system of claim 1, wherein the set of base learners are configured for outputting respective feature vectors.

4. The ensemble learning based image classification system of claim 3, wherein the respective feature vectors are concatenated together to form an image input for the meta learner.

5. The ensemble learning based image classification system of claim 1, wherein the controller is further configured for performing computations of fully-connected layers.

6. The ensemble learning based image classification system of claim 1, wherein the memory based data buffer comprises static random access memory.