AGGREGATION, PARTITIONING, AND MANAGEMENT OF HEALTHCARE DATA FOR EFFICIENT STORAGE AND PROCESSING

• US 20150302149A1
• Filed: 05/08/2015
• Published: 10/22/2015
• Est. Priority Date: 04/22/2014
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: WHITSITT, GREG, WHITACRE, MICAH, OLSON, ANDREW
• Granted Patent: US 10,373,712 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records

Abstract

Methods, systems, and computer-readable media are provided for aggregating, partitioning, and storing healthcare data. Healthcare data is collected from various disparate healthcare data sources. The data is aggregated into batches of the same type of data. From here, the data is partitioned according to the data'"'"'s originating healthcare data source. The aggregated and partitioned healthcare data is then stored in a long term storage data store. This system of storing healthcare data allows for efficient retrieval and processing by computing solutions that need access to batches of healthcare data. The system also reduces costs associated with storing data as duplicate storage is eliminated.

Claims

1. A computerized method carried out by at least one server having at least one processor for aggregating, partitioning, and storing raw healthcare data for efficient retrieval, the method comprising:

receiving healthcare data from a plurality of disparate healthcare data sources;

aggregating, using the at least one processor, one or more subsets of the healthcare data having the same file type into batches;

partitioning the batches according to healthcare data source; and

storing the aggregated and partitioned healthcare data in a long term storage data store.

2. The method of claim 1, further comprising, prior to aggregating the one or more subsets of healthcare data, filtering and removing one or more pieces of duplicate healthcare data.

3. The method of claim 1, further comprising:

receiving a request from a processing node for a subset of the one or more subsets of healthcare data having a particular type and healthcare data source;

accessing the subset of the one or more subsets of healthcare data from the long-term storage data store; and

delivering the subset of the one or more subsets of healthcare data to the processing node where the subset of the one or more subsets of healthcare data is processed to generate clinically relevant outcome information.

4. The method of claim 3, wherein the processing node performs batch processing of data.

5. The method of claim 1, wherein the long-term storage data store stores the healthcare data in a virtual file system.

6. The method of claim 1, further comprising partitioning healthcare data in slices based on a time when the healthcare data was received.

7. The method of claim 6, wherein the slices contain data for one of the following time periods:

one minute,

one hour,

one day,

one week,

one month, or

one year.

8. The method of claim 6, further comprising compacting multiple time slices that have been stored for a given period of time into larger slices to reduce storage space.

9. A computer-implemented system for aggregating, archiving, and managing healthcare data, the computer-implemented system comprising:

an extraction component that collects one or more pieces of healthcare data from a plurality of disparate originating healthcare data sources;

an aggregating component that aggregates a subset of the healthcare data having the same type into batches;

a partitioning component that sorts the healthcare data by originating healthcare data source; and

a long-term storage data store for storing the healthcare data records sorted by originating healthcare data source and type.

10. The system of claim 9, further comprising a filtering component that filters and removes duplicate pieces of healthcare data.

11. The system of claim 9, wherein the partitioning component further sorts the healthcare data into time slices based on when the healthcare data was received.

12. The system of claim 11, further comprising a compaction component that compacts multiple older time slices into larger slices to reduce needed storage space in the long-term storage data store.

13. The system of claim 9 wherein the plurality of disparate originating healthcare data sources include hospitals, clinics, or health centers.

14. One or more computer-storage media having computer-executable instructions embodied thereon that, when executed, perform a method of aggregating, partitioning, and storing healthcare data, the method comprising:

extracting a set of healthcare data from one or more healthcare data sources;

filtering and removing duplicate copies of one or more pieces of the set of healthcare data;

aggregating a subset of the set of healthcare data having the same type;

partitioning the aggregated subset of healthcare data by healthcare data source; and

storing the aggregated and partitioned subset of healthcare data in one or more long-term storage data stores.

15. The media of claim 14, further comprising labeling each piece of healthcare data of the set of healthcare data with metadata identifying the time the piece of healthcare data was received and further partitioning the aggregated subset of healthcare data into time slices based on a time the healthcare data was received.

16. The media of claim 15, further comprising compacting older time slices of data into larger slices such that the data requires less physical space for storage.

17. The media of claim 14, further comprising:

receiving a request from a processing node for a batch of healthcare data of a particular type and healthcare data source,

accessing the batch of healthcare data in the long-term storage data store,

delivering the batch of healthcare data to the processing node where the batch of healthcare data will be processed to produce a clinically relevant outcome.

18. The media of claim 17, wherein the request further specifies a time period for the batch of healthcare data.

19. The method of claim 14, wherein the aggregated and partitioned subset of healthcare data is stored in a hierarchy of folders based on type and healthcare data source.

20. The method of claim 14, wherein the pieces of healthcare data of the set of healthcare data are of varying file sizes.