METHOD AND APPARATUS FOR MANAGING HIERARCHICAL COLLECTIONS OF DATA

• US 20080109493A1
• Filed: 10/31/2007
• Published: 05/08/2008
• Est. Priority Date: 08/08/2005
• Status: Active Grant

• Current Assignee: Arthur Zaifman, Carsten Lund, Frederick True
• Original Assignee: Arthur Zaifman, Carsten Lund, Frederick True
• Inventors: True, Frederick, Zaifman, Arthur, Lund, Carsten
• Granted Patent: US 7,930,280 B2
• Time in Patent Office: Days
• US Class Current: 707/200
• CPC Class Codes: G06F 16/24539 using cached or materialised query results
• CPC Class Codes: G06F 16/24556 Aggregation; Duplicate elimination
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/2474 Sequence data queries, e.g. querying versioned data
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A method and system provide for management of a collection of data records. The data records have associated therewith an identifier or code that indicates the most coarse level of granularity with which the data record is associated in a hierarchy of sampling subsets created across a range of granularity levels.

Claims

1. A method for managing multiple subsets of data stored in a database, comprising:

storing a superset of sampling data as a plurality of data records, said superset including a plurality of sampling interval data sets, each sampling interval data set including sampling data corresponding to a first time interval of a first time length where said superset includes sampling data for a plurality of sequential time intervals;

sampling data in said superset over a second time interval of a second time length which is a multiple of said first time length to generate information identifying a subset of data for said superset, wherein said sampling creates a second sampling level associated with said identified subset of data wherein said second sampling level includes a plurality of second time intervals;

sampling said data of said identified subset of data over a third time interval of a third time length which is a multiple of said second time length to generate information identifying a second subset of data from said superset; and

assigning a code to each record in the superset wherein said code identifies the highest sampling level with which said record is associated.

2. The method of claim 1, wherein said examining includes parallel processing of records associated with different identified codes.

3. A method for managing a database of records across a plurality of sampling granularities, comprising:

storing a plurality of sets of data records, each set corresponding to a sample of data records over a first time interval, wherein said plurality of sets corresponds to a plurality of time intervals;

sampling said stored sets of data records to identify a plurality of subsets of said data records as corresponding to a plurality of second time intervals, each second time interval corresponds to a plurality of said first time intervals, said plurality of subsets comprising a first sampling level;

assigning a first code to each data record that is a member of said first sampling level;

sampling said plurality of subsets of data associated with said first sampling level to identify at least one further subset of said data records as corresponding to a third time interval, each said third time interval corresponding to a plurality of said second time intervals;

at least one further subset comprising a second sampling level; and

for each data record that is a member of said second sampling record, assigning a second code to replace said first code.

4. The method of claim 3, wherein said query is associated with said second sampling level, wherein said second code is identified and data records having said second code are used to respond to the query.

5. The method of claim 3, wherein said query is associated with said first sampling level, wherein said first code and said second code are identified, data records having said first code and data records having said second code being used to respond to the query.

6. The method of claim 5, wherein data records with said first code and data records with said second code are queried in parallel to respond to said received query.

7. An apparatus for managing a database of records across a plurality of sampling granularities, comprising:

means for storing a plurality of sets of data records, each set corresponding to a sample of data records over a first time interval, wherein said plurality of sets corresponds to a plurality of time intervals;

means for sampling said stored sets of data records to identify a plurality of subsets of said data records as corresponding to a plurality of second time intervals, each second time interval corresponds to a plurality of said first time intervals, said plurality of subsets comprising a first sampling level;

means for assigning a first code to each data record that is a member of said first sampling level;

means for sampling said plurality of subsets of data associated with said first sampling level to identify at least one further subset of said data records as corresponding to a third time interval, each said third time interval corresponding to a plurality of said second time intervals;

at least one further subset comprising a second sampling level; and

for each data record that is a member of said second sampling record, assigning a second code to replace said first code.

8. The apparatus of claim 7, wherein said query is associated with said second sampling level, wherein said second code is identified and data records having said second code are used to respond to the query.

9. The apparatus of claim 7, wherein said query is associated with said first sampling level, wherein said first code and said second code are identified, data records having said first code and data records having said second code being used to respond to the query.

10. The apparatus of claim 9, wherein data records with said first code and data records with said second code are queried in parallel to respond to said received query.