Method and system for reducing a data set

• US 20090119323A1
• Filed: 11/02/2007
• Published: 05/07/2009
• Est. Priority Date: 11/02/2007
• Status: Active Grant

• Current Assignee: Caterpillar Incorporated
• Original Assignee: Caterpillar Incorporated
• Inventors: HART, Gabriel Carl, MASON, James Robert, NIKOLOPOULOS, Christos, TAYLOR, Michael Lee, GRICHNIK, Anthony J., CLER, Meredith Jaye
• Granted Patent: US 7,805,421 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/335 Filtering based on additional data, e.g. user or group profiles filtering in web context G06F16/9535, G06F16/9536
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

System and methods are provided for applying a dimensionality reduction process to a data set. The method includes obtaining a data set including a first set of variables and identifying collections of the first set of variables for replacement by a second set of variables. The method also includes replacing the collections of the first set of variables with the second set of variables and eliminating the first set of variables from the data set.

Claims

1. A computer-implemented method for applying a dimensionality reduction process to a data set, comprising:

obtaining a data set including a first set of variables;

identifying collections of the first set of variables for replacement by a second set of variables;

replacing the collections of the first set of variables with the second set of variables; and

eliminating the first set of variables from the data set.

2. The method of claim 1, wherein the first set of variables includes multiple entries for an event within a predetermined amount of time.

3. The method of claim 2, wherein:

the first set of variables includes medical codes;

the event includes a diagnosis of an individual or creating a prescription for an individual; and

the entries include a date for occurrence of the event for each medical code.

4. The method of claim 1, wherein:

the first set of variables are related and occur within a predetermined period of time; and

the second set of variables include a numerical indicator representing a number of occurrences of the first set of variables within the predetermined period of time.

5. The method of claim 4, wherein:

the first set of variables represent diagnosis of an individual for one or more diseases; and

if the numerical indicator is below a threshold, the individual is diagnosed as not having the disease.

6. The method of claim 1, wherein:

the first set of variables include medical codes;

identifying includes combining the medical codes into a string and searching the string for a common pattern; and

replacing includes establishing the second set of variables based on the common pattern.

7. The method of claim 6, wherein the second set of variables includes a condensed string.

8. A computer-readable medium comprising instructions which, when executed by a processor, perform a method for applying a dimensionality reduction process to a data set, the method comprising:

obtaining a data set including a first set of variables;

identifying collections of the first set of variables for replacement by a second set of variables;

replacing the collections of the first set of variables with the second set of variables; and

eliminating the first set of variables from the data set.

9. The computer-readable medium of claim 8, wherein the first set of variables includes multiple entries for an event within a predetermined amount of time.

10. The computer-readable medium of claim 9, wherein:

the first set of variables includes medical codes;

the event includes a diagnosis of an individual or creating a prescription for an individual; and

the entries include a date for occurrence of the event for each medical code.

11. The computer-readable medium of claim 10, wherein:

the first set of variables are related and occur within a predetermined period of time; and

the second set of variables include a numerical indicator representing a number of occurrences of the first set of variables within the predetermined period of time.

12. The computer-readable medium of claim 11, wherein:

the first set of variables represent diagnosis of an individual for one or more diseases; and

if the numerical indicator is below a threshold, the individual is diagnosed as not having the disease.

13. The computer-readable medium of claim 8, wherein:

the first set of variables include medical codes;

identifying includes combining the medical codes into a string and searching the string for a common pattern; and

replacing includes establishing the second set of variables based on the common pattern.

14. The computer-readable medium of claim 13, wherein the second set of variables includes a condensed string.

15. The computer-readable medium of claim 8, wherein the method further includes using the data set to diagnose a patient for one or more diseases.

16. A system for applying a dimensionality reduction process to a data set, the system comprising:

a memory;

at least one input device; and

a central processing unit in communication with the memory and the at least one input device, wherein the central processing unit;

obtains a data set including a first set of variables;

identifies collections of the first set of variables for replacement by a second set of variables;

replaces the collections of the first set of variables with the second set of variables; and

eliminates the first set of variables from the data set.

17. The system of claim 16, wherein the first set of variables includes multiple entries for an event within a predetermined amount of time.

18. The system of claim 17, wherein:

the first set of variables includes medical codes;

the event includes a diagnosis of an individual or creating a prescription for an individual; and

the entries include a date for occurrence of the event for each medical code.

19. The system of claim 18, wherein:

the first set of variables are related and occur within a predetermined period of time; and

the second set of variables include a numerical indicator representing a number of occurrences of the first set of variables within the predetermined period of time.

20. The system of claim 19, wherein:

the first set of variables represent diagnosis of an individual for one or more diseases; and

if the numerical indicator is below a threshold, the individual is diagnosed as not having the disease.

21. The system of claim 16, wherein:

the first set of variables include medical codes;

identifying includes combining the medical codes into a string and searching the string for a common pattern; and

replacing includes establishing the second set of variables based on the common pattern.

22. The system of claim 21, wherein the second set of variables includes a condensed string.