Methods and systems for facilitating analysis of feature extraction outputs
First Claim
1. A method of facilitating analysis of feature extraction outputs across multiple extractions, said method comprising:
- inputting a feature extraction output of an extraction resulting from feature extraction of an array;
extracting global statistics and array processing parameters from the feature extraction output;
populating a table or file with the extracted global statistics and array processing parameters of the extraction; and
repeating said inputting, extracting and populating for at least one additional feature extraction output of another extraction, so that said table or file includes global statistics that can be readily cross-compared over multiple extractions with reference to a single table or file.
1 Assignment
0 Petitions
Accused Products
Abstract
Methods, systems and computer readable media for facilitating analysis of feature extraction outputs across multiple extractions. A feature extraction output of an extraction resulting from feature extraction of an array is inputted, and global statistics and array processing parameters are extracted from the feature extraction output. A table/file is populated with the extracted global statistics and array processing parameters of the extraction. The inputting, extracting and populating steps are repeated for at least one additional feature extraction output of another extraction, so that the table/file includes global statistics that can be readily cross-compared over multiple extractions with reference to a single table or file. Methods, systems and computer readable media are provided for setting threshold values for metrics that global statistics are provided for. An evaluation metric may be set by a user, based upon the threshold values set for the metrics. A metric set including the metrics and optionally one or more thresholds and optionally an evaluation metric may be stored and/or applied to additional global statistics for those metrics to evaluate the quality of one or more extractions. A set of reports are provided for facilitating analysis of feature extraction outputs across multiple extractions. A diagnostic tool is provided for identifying and diagnosing potential problems in feature extraction outputs.
60 Citations
79 Claims
-
1. A method of facilitating analysis of feature extraction outputs across multiple extractions, said method comprising:
-
inputting a feature extraction output of an extraction resulting from feature extraction of an array;
extracting global statistics and array processing parameters from the feature extraction output;
populating a table or file with the extracted global statistics and array processing parameters of the extraction; and
repeating said inputting, extracting and populating for at least one additional feature extraction output of another extraction, so that said table or file includes global statistics that can be readily cross-compared over multiple extractions with reference to a single table or file. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 25, 26, 27, 28, 29, 30, 31, 32)
-
-
21. A method of facilitating analysis of feature extraction outputs across multiple extractions, said method comprising:
-
querying a file containing global statistics and array processing parameters for each of a plurality of extractions to select a subset of records, each record containing global statistics and array processing parameters for a different extraction;
selecting a metric for which global statistics are reported in the subset of the extractions;
plotting a chart of the metric values from the global statistic values in the subset of extractions reported for the metric;
calculating summary statistics characterizing the distribution of the plotted metric values; and
setting a threshold value for the distribution. - View Dependent Claims (22, 23, 24)
-
-
33. A set of reports for facilitating analysis of feature extraction outputs across multiple extractions, said set comprising:
-
a statistics table containing global statistics for metrics, array processing parameters and user annotations for multiple extractions, each row of said table containing data for a single extraction, said data including at least global statistics and an array processing parameter, including a unique identifier for the extraction, wherein said table contains data for at least two different extractions; and
a QC chart displaying at least one plot of a metric values from global statistics for the metric across a plurality of said extractions. - View Dependent Claims (35, 36)
-
-
34. The set of claim 34, wherein said QC chart and said statistics table are dynamically linked.
-
37. A retrospective system for facilitating analysis of feature extraction outputs across multiple extractions, said system comprising:
-
a processor; and
a retrospective tool programmed to receive an input of a feature extraction output of an extraction resulting from feature extraction of an array, extract global statistics and array processing parameters from the feature extraction output, and populate a table or file with the extracted global statistics and array processing parameters of the extraction. - View Dependent Claims (38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 62, 63)
-
-
53. A feature extraction system for facilitating analysis of feature extraction outputs across multiple extractions, said system comprising:
-
a processor; and
a feature extraction tool programmed to extract global statistics and array processing parameters from a batch of feature extraction outputs produced by the feature extraction system, and populate a table or file on the fly with the extracted global statistics and array processing parameters extracted from the batch of feature extraction outputs.
-
-
54. A diagnostic tool for identifying and diagnosing potential problems in feature extraction outputs, said tool comprising:
-
a processor;
a set of diagnostic rules;
a rules software language executable by said processor to execute said rules against at least one of feature extraction global statistics and feature extraction data, to determine whether logic provided in a rule is met or violated by the global statistic data value or feature data value compared; and
programming for outputting potential problems identified by executing said rules against the at least one data value. - View Dependent Claims (55, 56, 57, 58, 59, 60, 61)
-
-
64. A method of evaluating the quality of feature extraction outputs from a plurality of arrays expected to produce the same results, said method comprising:
-
inputting feature extraction outputs of the extractions resulting from feature extraction of the arrays;
extracting global statistics and array processing parameters from the feature extraction outputs;
populating a table or file with the extracted global statistics and array processing parameters of the extractions;
plotting at least one metric against the global statistics reported for that metric for the extractions; and
analyzing the at least one plot to identify potential outliers.
-
-
65. A method of correlating a change in an array processing parameter for an extraction with changes in feature extraction outputs, said method comprising:
-
inputting feature extraction outputs of extractions resulting from feature extraction of arrays having a first set of array processing parameters;
extracting global statistics and array processing parameters from the feature extraction outputs;
inputting feature extraction outputs of extractions resulting from feature extraction of arrays having a second set of array processing parameters, wherein the second set is the same as the first set except for a change in one or a small percentage of the array processing parameters;
extracting global statistics and array processing parameters from the feature extraction outputs from the arrays having the second set of array processing parameters;
populating a table or file with all extracted global statistics and array processing parameters of the extractions;
plotting at least one metric against the global statistics reported for that metric for the extractions; and
comparing the values in the at least one plot to establish whether there is a significant difference between values from the arrays having the first set of array processing parameters versus values from the arrays having the second set of array processing parameters.
-
-
66. A method of developing a microarray product, said method comprising:
-
inputting feature extraction output of an extraction resulting from feature extraction of an existing array;
extracting global statistics and array processing parameters from the feature extraction output;
inputting feature extraction output of an extraction resulting from feature extraction of an array similar to the existing array, but in which at least one factor was changed;
extracting global statistics and array processing parameters from the feature extraction output from the array similar to the existing array;
populating a table or file with all extracted global statistics and array processing parameters of the extractions;
plotting at least one metric against the global statistics reported for that metric for the extractions; and
comparing the values in the at least one plot to establish whether the change of at least one factor had a positive, negative, or no impact on the feature extraction output as measured by the at least one metric. - View Dependent Claims (67)
-
-
68. A method of diagnosis of potential errors in feature extraction outputs, said method comprising:
-
inputting a feature extraction output of an extraction resulting from feature extraction of an array;
extracting global statistics and array processing parameters from the feature extraction output;
populating a table or file with the extracted global statistics and array processing parameters of the extraction; and
repeating said inputting, extracting and populating for at least one additional feature extraction output of another extraction, so that said table or file includes global statistics that can be readily cross-compared over multiple extractions with reference to a single table or file;
plotting a chart of global statistic values for a metric in said table or file for a plurality of extractions;
evaluating the values in the chart to identify potential outliers; and
correlating one or more array processing parameters that are different between two sets of the global statistic values, one set predominantly containing the potential outliers and the other set containing predominantly non-outlier values; and
identifying the one or more array processing parameters as possibly causative of the potential errors. - View Dependent Claims (69)
-
-
70. A method of diagnosis of potential errors in feature extraction outputs, said method comprising:
-
executing a set of diagnostic rules against a global statistic or feature data value to determine whether the value complies with logic contained with the set of rules; and
outputting a warning and diagnosis of a potential error for an extraction when a rule is found to have been violated by not complying with the logic contained in a rule. - View Dependent Claims (71, 72, 73)
-
-
74. A computer readable medium carrying one or more sequences of instructions for facilitating analysis of feature extraction outputs across multiple extractions, wherein execution of one or more sequences of instructions by one or more processors causes the one or more processors to perform the steps of:
-
inputting a feature extraction output of an extraction resulting from feature extraction of an array;
extracting global statistics and array processing parameters from the feature extraction output;
populating a table or file with the extracted global statistics and array processing parameters of the extraction; and
repeating said inputting, extracting and populating for at least one additional feature extraction output of another extraction, so that said table or file includes global statistics that can be readily cross-compared over multiple extractions with reference to a single table or file.
-
-
75. A computer readable medium carrying one or more sequences of instructions for facilitating analysis of feature extraction outputs across multiple extractions, wherein execution of one or more sequences of instructions by one or more processors causes the one or more processors to perform the steps of:
-
querying a file containing global statistics and array processing parameters for each of a plurality of extractions to select a subset of records, each record containing global statistics and array processing parameters for a different extraction;
selecting a metric for which global statistics are reported in the subset of the extractions;
plotting a chart of the metric values from global statistic values in the subset of extractions reported for the metric;
calculating statistics characterizing the distribution of the plotted metric values; and
setting a threshold value for the distribution. - View Dependent Claims (76, 77, 78, 79)
-
Specification