INDEXING OF LARGE SCALE PATIENT SET

• US 20190317951A1
• Filed: 06/26/2019
• Published: 10/17/2019
• Est. Priority Date: 12/19/2012
• Status: Active Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: WANG, FEI, WANG, JUN
• Granted Patent: US 11,860,902 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/2246 Trees, e.g. B+trees
• CPC Class Codes: G06F 16/278 Data partitioning, e.g. horizontal or vertical partitioning
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/316 Indexing structures
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 50/70 for mining of medical data, e.g. analysing previous cases of other patients

Abstract

Systems and methods for indexing data include formulating an objective function to index a dataset, a portion of the dataset including supervision information. A data property component of the objective function is determined, which utilizes a property of the dataset to group data of the dataset. A supervised component of the objective function is determined, which utilizes the supervision information to group data of the dataset. The objective function is optimized using a processor based upon the data property component and the supervised component to partition a node into a plurality of child nodes.

Claims

1. A method for indexing data, comprising:

determining a data property component of an objective function indexing a dataset, the data property component configured to utilize a property of the dataset for grouping data of the dataset, and for maximizing a variance of the dataset to reduce computational costs during the indexing;

determining a supervised component of the objective function which utilizes supervision information from the dataset to group data of the dataset; and

optimizing the objective function using a processor based upon the data property component and the supervised component to partition a node into a plurality of child nodes.

2. The method as recited in claim 1, wherein the optimizing the objective function includes recursively optimizing the objective function at each node to provide a binary space partitioning tree.

3. The method as recited in claim 1, wherein the maximizing a variance of the dataset comprises applying at least one of a principal component analysis (PCA) and maximum variance unfolding (MVU).

4. The method as recited in claim 3, wherein the maximizing the variance includes applying both the principal component analysis and the maximum variance unfolding.

5. The method as recited in claim 1, wherein the determining the data property component includes clustering data around a median of the dataset.

6. The method as recited in claim 1, wherein the determining the supervised component includes minimizing pairwise distance of similar data identified by the supervision information and maximizing pairwise distance of dissimilar data identified by the supervision information.

7. The method as recited in claim 1, wherein the determining the supervised component includes applying the dataset as a linear prediction function.

8. The method as recited in claim 1, wherein the objective function includes a tradeoff parameter to balance contributions from the data property component and the supervision component.

9. The method as recited in claim 1, wherein the supervision information includes must-links indicating pairs of data that are similar to each other and cannot-links indicating pairs of data that are dissimilar to each other.

10. The method as recited in claim 1, wherein the dataset includes patient medical information.

11. The method as recited in claim 1, wherein the objective function includes a tradeoff parameter to balance contributions from the data property component and the supervision component.

12. The method as recited in claim 1, wherein the determining the data property component includes applying the maximum variance unfolding by forming a projection as an inner product of a data matrix and a learned partition hyperplane and maximizing overall pairwise distances in a projected space.

13. The method as recited in claim 1, wherein the determining the data property component includes applying the maximum variance unfolding such that a binary partition produces a balanced tree.

14. The method as recited in claim 13, wherein applying the maximum variance unfolding comprises finding directions under which a projected data variance is maximized such that the binary partition of the directions increases a likelihood of producing the balanced tree.

15. A method for indexing data, comprising:

formulating an objective function to index a dataset, a portion of the dataset including supervision information;

determining a data property component of the objective function which utilizes a property of the dataset to group data of the dataset, the determining including maximizing a variance of the dataset by applying at least one of a principal component analysis (PCA) and maximum variance unfolding (MVU) to reduce computational costs during the indexing;

determining a supervised component of the objective function which utilizes the supervision information to group data of the dataset; and

optimizing the objective function using a processor based upon the data property component and the supervised component to partition a node into a plurality of child nodes.

16. The method as recited in claim 15, wherein the optimizing the objective function includes recursively optimizing the objective function at each node to provide a binary space partitioning tree.

17. The method as recited in claim 15, wherein the supervision information includes must-links indicating pairs of data that are similar to each other and cannot-links indicating pairs of data that are dissimilar to each other.

18. A method for indexing data, comprising:

determining a data property component of an objective function indexing a dataset, the data property component configured to utilize a property of the dataset to group data of the dataset, the determining including maximizing a variance of the dataset by applying at least one of a principal component analysis (PCA) and maximum variance unfolding (MVU) to reduce computational costs during the indexing;

determining a supervised component of the objective function which utilizes supervision information to group data of the dataset; and

optimizing the objective function using a processor based upon the data property component and the supervised component to partition a node into a plurality of child nodes.

19. The method as recited in claim 18, wherein the optimizing the objective function includes recursively optimizing the objective function at each node to provide a binary space partitioning tree.

20. The method as recited in claim 18, wherein the supervision information includes must-links indicating pairs of data that are similar to each other and cannot-links indicating pairs of data that are dissimilar to each other.