Database index storage based on temporal data

• US 10,445,306 B1
• Filed: 09/22/2015
• Issued: 10/15/2019
• Est. Priority Date: 09/22/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Waugh, Robert Mark
• Primary Examiner(s): Lewis, Cheryl
• Application Number:
  US14/861,991
• Time in Patent Office: 1,484 Days
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/2455 Query execution

Abstract

An analytics service receives a request to store a first temporal data record specifying a time interval during which data for a computing resource was collected within a database. The analytics service uses the time interval for the first temporal data record to obtain a second temporal data record from the database specifying an end time that is greater than the start time of the time interval of the first temporal data record. The analytics service generates new temporal data records that correspond to non-overlapping time intervals as a result of a determination that there is an overlap between the time intervals of the first temporal data record and the second temporal data record.

Claims

1. A system, comprising:

one or more processors; and

memory including instructions that, when executed by the one or more processors, cause the system to at least;

receive a first temporal data record corresponding to a computing resource metric, the first temporal data record specifying a first temporal data region defined by a first start time and a first end time;

generate a database query configured such that a second temporal data record specifying a second temporal region defined by a second start time and a second end time, the second end time greater than the first start time is responsive to the database query;

submit the database query to obtain the second temporal data record;

if the second temporal data region of the second temporal data record overlaps the first temporal data region of the first temporal data record as determined by the second start time being less than the first end time;

generate one or more new temporal data records such that the new temporal data records correspond to non-overlapping temporal data regions;

record the one or more new temporal data records in the database; and

delete the first temporal data record and the second temporal data record; and

if the second temporal data region of the second temporal data record does not overlap the temporal data region of the first temporal data record as determined by the second start time being less than the first end time, record the first temporal data record in the database.

2. The system of claim 1, wherein the instructions further cause the system to append the second temporal data to include metadata of the first temporal data if the second temporal data region is the same as the first temporal data region.

3. The system of claim 1, wherein the first temporal data record is provided by a reporting agent of a computing resource of a computing resource service, the computing resource comprising generated data corresponding to the computing resource metric.

4. The system of claim 1, wherein the instructions further cause the system to update an index of the database to indicate that the one or more new temporal data records have been recorded in the database.

5. A computer-implemented method, comprising:

receiving a first temporal data record specifying a start time and an end time at which data associated with the first temporal data record was collected;

identifying a second temporal data record specifying a start time and an end time at which data associated with the second temporal data record was collected, wherein the end time of the second temporal data record is greater than the start time of the first temporal data record;

determining whether there is a temporal overlap between the first temporal data record and the second temporal data record at least in part by determining whether the start time of the second data record is less than the end time of the first temporal data record; and

generating one or more temporal data records based at least in part on the temporal overlap such that the one or more temporal data records correspond to non-overlapping time intervals.

6. The computer-implemented method of claim 5, wherein the second temporal data record is identified based at least in part on a response to a database query configured such that a temporal data record specifying an end time greater than the start time of the first temporal data record is responsive to the database query.

7. The computer-implemented method of claim 5, further comprising deleting the first temporal data record and the second temporal data record as a result of generation of the one or more temporal data records.

8. The computer-implemented method of claim 5, further comprising:

identifying a plurality of temporal data records specifying an end time that is greater than the start time of the first temporal data record; and

sorting the plurality of temporal data records based at least in part on a proximity between the end time of individual temporal data records of the plurality of temporal data records and the start time of the first temporal data record such that the second temporal data record is identified as a result of the second temporal data record including a proximity that is lesser than proximities for other temporal data records of the plurality of temporal data records.

9. The computer-implemented method of claim 5, further comprising:

storing the one or more temporal data records in a database comprising a plurality of temporal data records; and

updating an index of the database to indicate a presence of the one or more temporal data records in the database.

10. The computer-implemented method of claim 5, wherein the first temporal data record is received from a computing resource service comprising one or more computing resources, the first temporal record associated with a computing resource metric of at least one computing resource of the one or more computing resources.

11. The computer-implemented method of claim 5, wherein the first temporal record is received from a customer computer system of a computing resource service provider, the customer computer system configured to provide the first temporal record through an interface provided by the computing resource service provider.

12. The computer-implemented method of claim 5, further comprising:

receiving a third temporal data record specifying a start time and an end time at which data associated with the third temporal data record was collected;

identifying a fourth temporal data record specifying an end time that is greater than the start time of the first temporal data record;

determining whether there is a temporal overlap between the third temporal data record and the fourth temporal data record; and

recording the third temporal data record within a database as a result of there being no temporal overlap between the third temporal data record and the fourth temporal data record.

13. A non-transitory computer-readable storage medium comprising executable instructions that, when executed by one or more processors of a computer system, cause the computer system to at least:

obtain a first temporal data record specifying a time interval during which data for a computing resource metric was collected;

obtain a second temporal data record specifying an end time that is greater than a start time of the time interval;

determine whether there is an overlap between the time interval of the first temporal data record and a time interval that is defined by a start time of the second temporal data record and the end time, wherein there is an overlap if the start time of the second temporal data record is less than the end time of the first temporal data record; and

as a result of the overlap, generate new temporal data records that correspond to non-overlapping time intervals.

14. The non-transitory computer-readable storage medium of claim 13, wherein the instructions further cause the computer system to:

obtain a third temporal data record specifying a time interval during which data for another computing resource metric was collected;

obtain a fourth temporal data record specifying an end time that is greater than a start time of the time interval of the third temporal data record;

determine that there is no overlap between the time interval of the third temporal data record and a time interval of the fourth temporal record; and

record the third temporal data record in a database.

15. The non-transitory computer-readable storage medium of claim 13, wherein the instructions further cause the computer system to transmit a request to one or more servers to store the new temporal data records in a database comprising a plurality of temporal data records.

16. The non-transitory computer-readable storage medium of claim 15, wherein the instructions further cause the computer system to:

receive confirmation from the one or more servers that the new temporal data records are stored within the database;

delete the first temporal record; and

transmit a request to the one or more servers to delete the second temporal record from the database such that the second temporal record is deleted from the database and an index of the database is updated to remove any entries associated with the second temporal record.

17. The non-transitory computer-readable storage medium of claim 15, wherein the instructions further cause the computer system to update an index of the database to indicate that the new temporal data records are stored in the database, the index usable to identify a location in the database where the new temporal data records are stored in response to database queries.

18. The non-transitory computer-readable storage medium of claim 13, wherein the first temporal record is obtained from a reporting agent of a computing resource of a computing resource service provider.

19. The non-transitory computer-readable storage medium of claim 13, wherein the instructions further cause the computer system to generate a database query configured such that a temporal data record specifying an end time greater than the start time is responsive to the database query to obtain the second temporal data record.

20. The non-transitory computer-readable storage medium of claim 13, wherein the instructions further cause the computer system to append the second temporal data record to include metadata of the first temporal data record as a result of the overlap between the first temporal data record and the second temporal data record including the time interval of the second temporal data record.