Methods of identifying patterns in biological systems and uses thereof

• US 20030172043A1
• Filed: 01/24/2002
• Published: 09/11/2003
• Est. Priority Date: 05/01/1998
• Status: Active Grant

• Current Assignee: Curtis Anderson, Health Discovery Corporation, James Roberts, Joe Mckenzie, Jules B. Paderewski, Julian N. Stern, Memorial Health Systems Incorporated, Timothy P. O'Hayer
• Original Assignee: Curtis Anderson, Garry L. Carls, Glynn Bergeron, James Roberts, Joe Mckenzie, John E. Matthews, Jules B. Paderewski, Julian N. Stern, Memorial Health Systems Incorporated, Peter J. Farley, Simpson K. Russell, Timothy P. O'Hayer
• Inventors: Weston, Jason, Guyon, Isabelle
• Granted Patent: US 7,117,188 B2
• Time in Patent Office: Days
• US Class Current: 706/48
• CPC Class Codes: G06F 18/2115 by evaluating different subsets according to an optimisation criterion, e.g. class separability, forward selection or backward elimination
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 20/10 using kernel methods, e.g. support vector machines [SVM]
• CPC Class Codes: G16B 25/00 ICT specially adapted for hybridisation; ICT specially adapted for gene or protein expression
• CPC Class Codes: G16B 25/10 Gene or protein expression profiling; Expression-ratio estimation or normalisation
• CPC Class Codes: G16B 40/00 ICT specially adapted for biostatistics; ICT specially adapted for bioinformatics-related machine learning or data mining, e.g. knowledge discovery or pattern finding
• CPC Class Codes: G16B 40/20 Supervised data analysis
• CPC Class Codes: G16B 40/30 Unsupervised data analysis
• CPC Class Codes: Y02A 90/10 Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

The methods, systems and devices of the present invention comprise use of Support Vector Machines and RFE (Recursive Feature Elimination) for the identification of patterns that are useful for medical diagnosis, prognosis and treatment. SVM-RFE can be used with varied data sets.

Claims

1. A computer-implemented method for identifying patterns in data, the method comprising:

(a) inputting into a classifier a training set having known outcomes, the classifier comprising a decision function having a plurality of weights, each having a weight value, wherein the training set comprises features corresponding to the data and wherein each feature has a corresponding weight;

(b) optimizing the plurality of weights so that classifier error is minimized;

(c) computing ranking criteria using the optimized plurality of weights;

(d) eliminating at least one feature corresponding to the smallest ranking criterion;

(e) repeating steps (a) through (d) for a plurality of iterations until a subset of features of pre-determined size remains; and

(f) inputting into the classifier a live set of data wherein the features within the live set are selected according to the subset of features.

2. The method of claim 1, wherein the classifier is a support vector machine.

3. The method of claim 1, wherein the classifier is a soft margin support vector machine.

4. The method of claim 1, wherein the ranking criterion corresponding to a feature is calculated by squaring the optimized weight for the corresponding feature.

5. The method of claim 1, wherein the decision function is a quadratic function.

6. The method of claim 1, wherein step (d) comprises eliminating a plurality of features corresponding to the smallest ranking criteria in a single iteration of steps (a) through (d).

7. The method of claim 1, wherein step (d) comprises eliminating a plurality of features corresponding to the smallest ranking criteria in at least the first iteration of steps (a) through (d) and in later iterations, eliminating one feature for each iteration.

8. The method of claim 1, wherein step (d) comprises eliminating a plurality of features corresponding to the smallest ranking criteria so that the number of features is reduced by a factor of two for each iteration.

9. The method of claim 1, wherein the training set and the live set each comprise gene expression data obtained from DNA micro-arrays.

10. The method of claim 1, further comprising pre-processing the training set and the live set so that the features are comparably scaled.