METHOD AND SYSTEM FOR ANALYZING MULTI-VARIATE DATA USING CANONICAL DECOMPOSITION

• US 20070005391A1
• Filed: 08/10/2006
• Published: 01/04/2007
• Est. Priority Date: 07/12/2000
• Status: Active Grant

• Current Assignee: Cornell University
• Original Assignee: Cornell University
• Inventors: Schiff, Nicholas, Victor, Jonathan, Repucci, Michael
• Granted Patent: US 7,409,321 B2
• Time in Patent Office: Days
• US Class Current: 702/189
• CPC Class Codes: G06F 18/213 Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
• CPC Class Codes: G06F 2218/08 Feature extraction
• CPC Class Codes: G06Q 90/00 Systems or methods specially adapted for administrative, commercial, financial, managerial or supervisory purposes, not involving significant data processing

Abstract

A canonical decomposition (CD) method that includes building a multi-variate linear autoregressive (“MLAR”) model from an original data set or from a reduced set derived by data reduction methods from the original data set. The MLAR analysis is followed by seeking a coordinate transformation of the MLAR model to obtain the best possible match with one or more canonical forms representing relationships among components. For multi-variate data with a truly hierarchical structure, CD accurately extracts the underlying sources of the system.

Claims

1. A method of determining dynamic characteristics of data, the data being causal and having translation-invariant statistics with respect to a variable, which method comprises the steps of:

receiving signals representing the data, the signals originating from a set of components, the set of components having dynamic relationships with each other;

calculating a set of multi-linear autoregressive coefficients of the data, the multi-linear autoregressive coefficients yielding an array of square matrices, each square matrix reflecting the dynamic relationships among the components for a certain value of the variable;

storing the array of square matrices in a memory;

transforming each square matrix to a substantially canonical form corresponding to a selected canonical form suitable for analyzing the dynamic relationships, yielding a set of canonical form matrices representing a transformation of the components;

analyzing the selected canonical form and transformed components to determine the dynamic characteristics of the data with respect to the variable; and

means for outputting the transformation of the components.

2. A method according to claim 1, wherein the dynamic relationships are hierarchical.

3. A method according to claim 1, wherein the dynamic relationships are dependent.

4. A method according to claim 1, wherein the dynamic relationships are independent.

5. A method according to claim 1, wherein the dynamic relationships are partially dependent and partially independent.

6. A method according to claim 1, wherein the receiving step further comprises applying a data reduction method to the data.

7. A method according to claim 6, wherein the data reduction method comprises Principal Component Analysis.

8. A method according to claim 1, wherein the variable is time.

9-13. -13. (canceled)

14. A method for determining an orthogonal rotation for analyzing data, the data being causal and having translation-invariant statistics with respect to a variable, the data originating from a set of components, the set of components having dynamic relationships to each other, which method comprises the steps of:

creating a multi-variate linear autoregressive model of the data, the model describing influences of one component on another component with respect to the variable;

storing the model in a memory;

decorrelating random terms in the model so that the decorrelated random terms are orthogonalized to produce a new model with autoregression coefficients, the random terms driving channels of the components;

identifying an orthogonal rotation that preserves the influences from the creating step and the orthogonality of the random terms from the decorrelating step, and that transforms the new model autoregression coefficients into a canonical form; and

a means for outputting the transformation of the components.

15. A method according to claim 14, wherein the creating step further comprises performing data reduction on the data.

16. A method according to claim 15, wherein the data reduction performed is Principal Component Analysis decomposition.

17. A method according to claim 14, wherein the components are temporal, T_p,n, and are modeled according to:

18. A method according to claim 14, wherein a set of residuals R_MLAR is calculated according to:

19. A method according to claim 14, wherein the canonical form has zero and nonzero elements, the nonzero elements being located in positions only along the main diagonal and anywhere at locations right of the main diagonal

20. A method according to claim 14, further comprising predicting future dynamic characteristics of the data using the canonical form.

21-38. -38. (canceled)

39. A method of identifying canonical forms of equally-sized square matrices under orthogonal transformation, comprising the steps of:

multiplying the matrices by a series of Jacobi rotations being applied about a pair of axes;

identifying a canonical form through iterative orthogonal rotations of the matrices; and

storing the canonical form in a memory.

40. A method according to claim 39, wherein the canonical form is a triangular canonical form.

41. A method according to claim 39, wherein the canonical form has nonzero elements along a main diagonal and in locations just right of the main diagonal.

42. A method according to claim 39, wherein the canonical form has nonzero elements along a main diagonal and nonzero elements just right of the main diagonal, and one of the nonzero elements just right of the main diagonal is wrapped around to a lower left corner.

43. A method according to claim 39, wherein the canonical form has nonzero elements along a main diagonal and has nonzero elements just right and just left of the main diagonal, and one of the elements right of the main diagonal is wrapped around to a lower left corner and one of the elements left of the main diagonal is wrapped around to an upper right corner.

44. A method according to claim 39, wherein the canonical form is a diagonal canonical form.

45. A method according to claim 39, wherein the canonical form is a block triangular canonical form including at least one of triangular canonical form, restricted triangular canonical form, unidirectional cyclic canonical form, bidirectional cyclic canonical form, and diagonal canonical form.