Methods, systems, and computer program products for database table aggregation

• US 8,275,751 B2
• Filed: 12/18/2008
• Issued: 09/25/2012
• Est. Priority Date: 12/18/2008
• Status: Active Grant

• Current Assignee: LYFT Incorporated
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Zaifman, Arthur, Rao, Saiprakash, Brown, Philip E.
• Primary Examiner(s): Vital, Pierre
• Assistant Examiner(s): Kim, Taelor
• Application Number:
  US12/338,136
• Publication Number:
  US 20100161681A1
• Time in Patent Office: 1,377 Days
• Field of Search: 702/66
• US Class Current: 707/661
• CPC Class Codes: G06F 16/212 with details for data modelling support
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409

Abstract

Methods, systems, and computer program products for database table aggregation are provided. A method includes encoding first and second components via a waveform definition, the first and second components specifying first and second criteria, respectively, for aggregating data. The method includes generating a complex periodic aggregation waveform (CPAW) having variable-sized square waves representing the components in a repeating pattern corresponding to the definition and the criteria, and which spans a first axis. The method includes providing a maximum byte count for aggregated data stored in a table defined by the first and/or second criteria, aggregating the data in accordance with the criteria, and creating a new table for overflow of data determined for the table when the maximum byte count is exceeded. The method includes updating the CPAW with results of the aggregation and generating a waveform representing the new table along a second axis.

Claims

1. A method for database table aggregation, comprising:

encoding first and second components via a waveform definition and attribute values of the respective first and second components, the first component specifying first criteria for aggregating data and the second component specifying second criteria for aggregating data;

generating a complex periodic aggregation waveform having variable-sized square waves respectively representing the first component and the second component in a repeating pattern that corresponds to the waveform definition and the first and second criteria, respectively, and which spans a length of a first axis that corresponds to a period of time for aggregating the data;

providing a maximum byte count for aggregated data stored in a first table defined by at least one of the first and second criteria, the maximum byte count specifying a threshold value;

aggregating the data for the duration of the period of time and in accordance with the attribute values of the respective first and second components;

creating a second table for overflow of data determined for the first table when the threshold value has been exceeded;

updating the complex periodic aggregation waveform to reflect results of the data aggregation, the updating including generating a waveform representing the second table along a second axis, the second axis depicted at a location corresponding to time in which the data aggregation for the first table was initiated;

outputting a graphical depiction of the updated complex periodic aggregation waveform;

wherein the method further comprises;

in response to receiving a date/time value and a read/write indicator value, wherein a read indicator specifies a read operation and a write indicator specifies a write operation;

searching the database of complex periodic aggregation waveforms until the date/time value is equal to or exceeds a unique identifier of a complex periodic aggregation waveform;

scanning the complex periodic aggregation waveform, found in response to the searching, until a period of time specified in one of the first and second criteria encloses the start date/time value;

searching a list of the tables until the start date/time value is equal to an identifier of one of the tables in the list;

determining whether the table found in response to the searching has an amount of aggregated data that exceeds a specified threshold;

performing one of the read operation and the write operation with respect to the table found in response to the searching based upon the read/write indicator value;

if the read/write indicator value is equal to the write operation, returning a maximum table name representing the table having the latest start date and time; and

if the read/write indicator value is equal to the read operation, returning the list of table names for a component indicating the threshold value has been exceeded.

2. The method of claim 1, further comprising:

providing the attribute values for the first component;

providing attribute values for attributes that define a period specification including the period of time, the period of time encapsulating;

a duration of time in which data is aggregated pursuant to the first criteria, and a duration of time in which data is aggregated pursuant to the second criteria; and

storing the attribute values of the first component, second component, and period specification in a database as a complex periodic aggregation encoding, and assigning a unique identifier to the complex periodic aggregation encoding, the unique identifier comprising a start date and time for aggregating the data.

3. The method of claim 2, wherein criteria used to define the period specification include:

the start date and time;

a duration;

a default aggregation duration;

a feedback arrival frequency; and

the first and second components.

4. The method of claim 1, wherein criteria used to define components include:

an aggregation duration that indicates a unit of time in which data is aggregated for a period duration, the period duration defining a rising and falling edge of a square wave that is defined by a component;

a count indicating a number of tables created for the aggregation duration, the number of tables including the first and second tables;

a relative start time indicating a time in which data aggregation is initiated for a component; and

priority value indicating a priority of a component that is evaluated when an overlap in component definitions occurs.

5. The method of claim 1, further comprising:

creating and storing tables containing aggregated data for the first component and the second component based upon the first and second criteria, respectively, each of the tables assigned an identifier corresponding to a start date and time in which data is aggregated and stored in the tables, the tables including the first and second tables;

wherein generating the complex periodic aggregation waveform includes depicting start dates and times for each of the tables at corresponding locations on the complex periodic aggregation waveform.

6. A system for database table aggregation, comprising:

a host system computer; and

an aggregation application executing on the host system computer, the aggregation application including an encoder, the encoder encoding first and second components via a waveform definition and attribute values of the respective first and second components, the first component specifying first criteria for aggregating data and the second component specifying second criteria for aggregating data;

the aggregation application generating a complex periodic aggregation waveform having variable-sized square waves respectively representing the first component and the second component in a repeating pattern that corresponds to the waveform definition and the first and second criteria, respectively, and which spans a length of a first axis that corresponds to a period of time for aggregating the data;

providing, via a user interface of the aggregation application, a maximum byte count for aggregated data stored in a first table defined by at least one of the first and second criteria, the maximum byte count specifying a threshold value;

the aggregation application aggregating the data for the duration of the period of time and in accordance with the attribute values of the respective first and second components;

the aggregation application creating a second table for overflow of data determined for the first table when the threshold value has been exceeded;

the aggregation application updating the complex periodic aggregation waveform to reflect results of the data aggregation, the updating including generating a waveform representing the second table along a second axis, the second axis depicted at a location corresponding to time in which the data aggregation for the first table was initiated;

the aggregation application outputting a graphical depiction of the updated complex periodic aggregation waveform to a user interface screen of a computer system;

wherein the aggregation application further implements;

in response to receiving a date/time value and a read/write indicator value via the user interface, wherein a read indicator specifies a read operation and a write indicator specifies a write operation;

the aggregation application searches the database of complex periodic aggregation waveforms until the date/time value is equal to or exceeds a unique identifier of a complex periodic aggregation waveform;

the aggregation application scans the complex periodic aggregation waveform, found in response to the searching, until a period of time specified in one of the first and second criteria encloses the start date/time value;

the aggregation application searches a list of the tables until the start date/time value is equal to an identifier of one of the tables in the list;

the aggregation application determines whether the table found in response to the searching has an amount of aggregated data that exceeds a specified threshold;

the aggregation application performs one of the read and the write operation with respect to the table found in response to the searching based upon the read/write indicator value;

if the read/write indicator value is equal to the write operation, the aggregation application returns a maximum table name representing the table having the latest start date and time; and

if the read/write indicator value is equal to the read operation, the aggregation application returns the list of table names for a component indicating the threshold value has been exceeded.

7. The system of claim 6, further comprising:

the aggregation application providing the attribute values for the first component via the user interface of the aggregation application;

the aggregation application providing, via the user interface of the attribute application, attribute values for attributes that define a period specification including the period of time, the period of time encapsulating;

a duration of time in which data is aggregated pursuant to the first criteria, and a duration of time in which data is aggregated pursuant to the second criteria; and

the aggregation application storing the attribute values of the first component, second component, and period specification in a database as a complex periodic aggregation encoding, and assigning a unique identifier to the complex periodic aggregation encoding, the unique identifier comprising a start date and time for aggregating the data.

8. The system of claim 7, wherein criteria used to define the period specification include:

the start date and time;

a duration;

a default aggregation duration;

a feedback arrival frequency; and

the first and second components.

9. The system of claim 6, wherein criteria used to define components include:

an aggregation duration that indicates a unit of time in which data is aggregated for a period duration, the period duration defining a rising and falling edge of a square wave that is defined by a component;

a count indicating a number of tables created for the aggregation duration, the number of tables including the first and second tables;

a relative start time indicating a time in which data aggregation is initiated for a component; and

priority value indicating a priority of a component that is evaluated when an overlap in component definitions occurs.

10. The system of claim 6, further comprising:

the aggregation application creating and storing tables containing aggregated data for the first component and the second component based upon the first and second criteria, respectively, each of the tables assigned an identifier corresponding to a start date and time in which data is aggregated and stored in the tables, the tables including the first and second tables;

wherein generating the complex periodic aggregation waveform includes depicting start dates and times for each of the tables at corresponding locations on the complex periodic aggregation waveform.

11. A computer program product for database table aggregation, the computer program product comprising a non-transitory storage medium having computer-readable program code embodied thereon, the program code causing a computer to implement:

encoding first and second components via a waveform definition and attribute values of the respective first and second components, the first component specifying first criteria for aggregating data and the second component specifying second criteria for aggregating data;

generating a complex periodic aggregation waveform having variable-sized square waves respectively representing the first component and the second component in a repeating pattern that corresponds to the waveform definition and the first and second criteria, respectively, and which spans a length of a first axis that corresponds to a period of time for aggregating the data;

providing a maximum byte count for aggregated data stored in a first table defined by at least one of the first and second criteria, the maximum byte count specifying a threshold value;

aggregating the data for the duration of the period of time and in accordance with the attribute values of the respective first and second components;

creating a second table for overflow of data determined for the first table when the threshold value has been exceeded;

updating the complex periodic aggregation waveform to reflect results of the data aggregation, the updating including generating a waveform representing the second table along a second axis, the second axis depicted at a location corresponding to time in which the data aggregation for the first table was initiated;

outputting a graphical depiction of the updated complex periodic aggregation waveform;

wherein the program code further causes a computer to implement;

in response to receiving a date/time value and a read/write indicator value, wherein a read indicator specifies a read operation and a write indicator specifies a write operation;

searching the database of complex periodic aggregation waveforms until the date/time value is equal to or exceeds a unique identifier of a complex periodic aggregation waveform;

scanning the complex periodic aggregation waveform, found in response to the searching, until a period of time specified in one of the first and second criteria encloses the start date/time value;

searching a list of the tables until the start date/time value is equal to an identifier of one of the tables in the list;

determining whether the table found in response to the searching has an amount of aggregated data that exceeds a specified threshold;

performing one of the read operation and the write operation with respect to the table found in response to the searching based upon the read/write indicator value;

if the read/write indicator value is equal to the write operation, returning a maximum table name representing the table having the latest start date and time; and

if the read/write indicator value is equal to the read operation, returning the list of table names for a component indicating the threshold value has been exceeded.

12. The computer program product of claim 11, further comprising program code implementing:

providing the attribute values for the first component;

providing attribute values for attributes that define a period specification including the period of time, the period of time encapsulating;

a duration of time in which data is aggregated pursuant to the first criteria, and a duration of time in which data is aggregated pursuant to the second criteria; and

storing the attribute values of the first component, second component, and period specification in a database as a complex periodic aggregation encoding, and assigning a unique identifier to the complex periodic aggregation encoding, the unique identifier comprising a start date and time for aggregating the data.

13. The computer program product of claim 12, wherein criteria used to define the period specification include:

the start date and time;

a duration;

a default aggregation duration;

a feedback arrival frequency; and

the first and second components.

14. The computer program product of claim 11, wherein criteria used to define components include:

an aggregation duration that indicates a unit of time in which data is aggregated for a period duration, the period duration defining a rising and falling edge of a square wave that is defined by a component;

a count indicating a number of tables created for the aggregation duration, the number of tables including the first and second tables;

a relative start time indicating a time in which data aggregation is initiated for a component; and

priority value indicating a priority of a component that is evaluated when an overlap in component definitions occurs.

15. The computer program product of claim 11, further comprising program code implementing:

creating and storing tables containing aggregated data for the first component and the second component based upon the first and second criteria, respectively, each of the tables assigned an identifier corresponding to a start date and time in which data is aggregated and stored in the tables, the tables including the first and second tables;

wherein generating the complex periodic aggregation waveform includes depicting start dates and times for each of the tables at corresponding locations on the complex periodic aggregation waveform.