Classification system and method using combined information testing

• US 5,999,893 A
• Filed: 05/02/1997
• Issued: 12/07/1999
• Est. Priority Date: 05/02/1997
• Status: Expired due to Fees

• Current Assignee: the united states of america as represented by the secretary of the navy
• Original Assignee: the united states of america as represented by the secretary of the navy
• Inventors: Willett, Peter K., Lynch, Robert S. Jr.
• Primary Examiner(s): Hoff, Marc S.
• Assistant Examiner(s): Patterson, Kendrick P.
• Application Number:
  US08/858,186
• Time in Patent Office: 949 Days
• Field of Search: 704/266, 704/240, 712/221, 712/222, 382/228, 364/150, 364/194, 702/181
• US Class Current: 702/181
• CPC Class Codes: G06F 18/21 Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation

Abstract

A classification system uses sensors to obtain information from which feaes which characterized a source or object to classified can be extracted. The features are extracted from the information and compiled into a feature vector which is then quantized to one of one of M discrete symbols. After N feature vectors have been quantized, a test vector having components which are defined by the number of occurrences of each of the M symbols in N the quantized vectors is built. The system combines the test vector with training data to simultaneously estimate symbol probabilities for each class and classify the test vector using a decision rule that depends only on the training and test data. The system classifies the test vector using either a Combined Bayes test or a Combined Generalized likelihood ratio test.

Claims

1. An information classification system combining training data and test data to classify a source which comprises:

a vector processor formulating a plurality of feature vectors depicting characteristics of said test data and for receiving said plurality of feature vectors wherein each of said plurality of feature vectors is quantized to one of M symbols and for generating a quantized test vector y having as components the number of occurrences of each of the M symbols in said plurality of quantized feature vectors received;

means for storing quantized training data, said quantized training data having one quantized training vector x_c for each class of a plurality of output classes; and

a classification processor, responsive to said quantized test vector and said quantized training data, for estimating sysmbol probabilities for each output class and for classifying the quantized test vector y unto one of said plurity output classes, wherein said classification processor estimates the symbol probabilities for each output class and classifies the quantized test vector using a combined Bayes test given by ##EQU15## wherein X_k,i is the number of occurrences of the i^th symbol in a quantized training vector for class k;

x_l,i is the number of occurrences of the i^th symbol in a quantized training vector for class l;

y_i is the number of occurrences of the i^th symbol in the quantized test vector;

##EQU16## is the total number of occurrences of the M symbols in the training data for class k;

##EQU17## is the total number of occurrences of the M symbols in the training data for class l; and

##EQU18## is the total number of occurrences of the M symbols in the quantized feature vectors.

2. An information classification system combining training data and test data to classify a source which comprises:

a vector processor formulating a plurality of feature vectors depicting characteristics of said test data and for receiving said plurality of feature vectors wherein each of said plurality of feature vectors is quantized to one of M symbols and for generating a quantized test vector y having as components the number of occurrences of each of the M symbols in said plurality of quantized feature vectors received;

means for storing quantized training data, said quantized training data having one quantized training vector x_c for each class of a plurality of output classes; and

a classification processor, responsive to said quantized test vector and said quantized training data, for estimating sysmbol probabilities for each output class and for classifying the quantized test vector y unto one of said plurity output classes, wherein said classification processor estimates the symbol probabilities for each one of C output classes and classifies the quantized test vector into one of the C output classes using a combined Bayes test given by ##EQU19## in which x_k,i is the number of occurrences of the i^th symbol in a quantized training vector for class k, y_i is the number of occurrences of the i^th symbol in the quantized test vector, N_k is the total number of occurrences of the M symbols in the training data for class k, N_l is the total number of occurrences of the M symbols in the training data for class l, and is the total number of occurrences of the M symbols in the quantized feature vectors.