Automatic updating of aggregations for aggregating data

• US 9,015,110 B2
• Filed: 12/20/2012
• Issued: 04/21/2015
• Est. Priority Date: 12/20/2012
• Status: Active Grant

• Current Assignee: Hulu LLC (The Walt Disney Company)
• Original Assignee: Hulu LLC (The Walt Disney Company)
• Inventors: Bajaria, Viral, Moriah, Shane, Haykinson, Ilya
• Primary Examiner(s): NGUYEN, KIM T
• Application Number:
  US13/722,789
• Publication Number:
  US 20140181019A1
• Time in Patent Office: 852 Days
• Field of Search: 707/609, 707/624
• US Class Current: 707/609
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/24556 Aggregation; Duplicate elimination
• CPC Class Codes: G06F 16/275 Synchronous replication

Abstract

In one embodiment, a method receives a specification for aggregating data from processing of beacons. A beacon is associated with an event occurring at a client while a user is interacting with a web application and including unstructured data. The method then parses the specification to automatically generate an aggregation to aggregate structured data that has been converted from the unstructured data and stores dependency information for changes to the aggregation. State information is analyzed and the dependency information to determine when a change in the state information indicates that a change should be made to the aggregation. The method then dynamically changes the aggregation based on the analyzing to generate a new aggregation to aggregate different data based on changed information.

Claims

1. A method comprising:

receiving a specification for aggregating data from processing of beacons, a beacon being associated with an event occurring at a client while a user is interacting with a web application and including unstructured data;

parsing, by a computer system, the specification to automatically generate an aggregation to aggregate structured data that has been converted from the unstructured data, the aggregation aggregating a first subset of data stored in a first table based on a first condition;

storing, by the computer system, dependency information for changes to the aggregation, the dependency information determined from the specification;

determining, by the computer system, state information based on the dependency information;

analyzing, by the computer system, the state information and the dependency information to determine when a change in the state information indicates that a change should be made to the aggregation; and

dynamically changing, by the computer system, the aggregation based on the analyzing to generate a new aggregation to aggregate different data, the new aggregation aggregating a second subset of data stored in the first table based on a second condition that was changed from the first condition.

2. The method of claim 1, further comprising:

receiving the state information;

comparing the state information to the dependency information; and

when the state information satisfies a condition of the dependency information, dynamically changing the aggregation to generate the new aggregation or and executing the new aggregation.

3. The method of claim 2, wherein the dependency information is associated with an action, wherein dynamically changing the aggregation to generate the new aggregation is based on the action.

4. The method of claim 1, wherein the aggregation is changed to the new aggregation to aggregate data from a different time range or date range.

5. The method of claim 1, further comprising:

applying the aggregation to a database to aggregate the data from the first table according to the aggregation; and

applying the new aggregation to the database to aggregate the data from the first table according to the new aggregation.

6. The method of claim 5, further comprising storing the data from the aggregation and the new aggregation in a second table separate from the first table.

7. The method of claim 6, further comprising:

receiving the structured data from a beacon processor; and

syncing the structured data into a series of transactions for the events in the first table, wherein the aggregated data in the second table aggregates a portion of the transactions.

8. The method of claim 1, further comprising:

storing the new aggregation in a queue; and

analyzing aggregations stored in the queue to apply the aggregations based on a priority.

9. A non-transitory computer-readable storage medium containing instructions, that when executed, control a computer system to be configured for:

receiving a specification for aggregating data from processing of beacons, a beacon being associated with an event occurring at a client while a user is interacting with a web application and including unstructured data;

parsing the specification to automatically generate an aggregation to aggregate structured data that has been converted from the unstructured data, the aggregation aggregating a first subset of data stored in a first table based on a first condition;

storing dependency information for changes to the aggregation, the dependency information determined from the specification;

determining state information based on the dependency information;

analyzing the state information and the dependency information to determine when a change in the state information indicates that a change should be made to the aggregation; and

dynamically changing the aggregation based on the analyzing to generate a new aggregation to aggregate different data, the new aggregation aggregating a second subset of data stored in the first table based on a second condition that was changed from the first condition.

10. The non-transitory computer-readable storage medium of claim 9, further configured for:

receiving the state information;

comparing the state information to the dependency information; and

when the state information satisfies a condition of the dependency information, dynamically changing the aggregation to generate the new aggregation and executing the new aggregation.

11. The non-transitory computer-readable storage medium of claim 10, wherein the dependency information is associated with an action, wherein dynamically changing the aggregation to generate the new aggregation is based on the action.

12. The non-transitory computer-readable storage medium of claim 9, wherein the aggregation is changed to the new aggregation to aggregate data from a different time range or date range.

13. The non-transitory computer-readable storage medium of claim 9, further configured for:

applying the aggregation to a database to aggregate the data from the first table according to the aggregation; and

applying the new aggregation to the database to aggregate the data from the first table according to the new aggregation.

14. The non-transitory computer-readable storage medium of claim 13, further comprising storing the data from the aggregation and the new aggregation in a second table separate from the first table.

15. The non-transitory computer-readable storage medium of claim 14, further configured for:

receiving the structured data from a beacon processor; and

syncing the structured data into a series of transactions for the events in the first table, wherein the aggregated data in the second table aggregates a portion of the transactions.

16. The non-transitory computer-readable storage medium of claim 9, further configured for:

storing the new aggregation in a queue; and

analyzing aggregations stored in the queue to apply the aggregations based on a priority.

17. A system comprising:

one or more computer processors; and

a non-transitory computer-readable storage medium comprising instructions, that when executed, control the one or more computer processors to be configured for;

receiving a specification for aggregating data from processing of beacons, a beacon being associated with an event occurring at a client while a user is interacting with a web application and including unstructured data;

parsing the specification to automatically generate an aggregation to aggregate structured data that has been converted from the unstructured data, the aggregation aggregating a first subset of data stored in a first table based on a first condition;

storing dependency information for changes to the aggregation, the dependency information determined from the specification;

determining state information based on the dependency information;

analyzing the state information and the dependency information to determine when a change in the state information indicates that a change should be made to the aggregation; and

dynamically changing the aggregation based on the analyzing to generate a new aggregation to aggregate different data, the new aggregation aggregating a second subset of data stored in the first table based on a second condition that was changed from the first condition.

18. The system of claim 17, further configured for:

receiving the state information;

comparing the state information to the dependency information; and

when the state information satisfies a condition of the dependency information, dynamically changing the aggregation to generate the new aggregation and executing the new aggregation.

19. The system of claim 17, further configured for:

applying the aggregation to a database to aggregate the data from the first table according to the aggregation; and

applying the new aggregation to the database to aggregate the data from the first table according to the new aggregation.

20. The system of claim 17, wherein the dependency information is associated with an action, wherein dynamically changing the aggregation to generate the new aggregation is based on the action.