System for merging and comparing real-time analytics data with conventional analytics data

• US 8,782,162 B1
• Filed: 07/20/2011
• Issued: 07/15/2014
• Est. Priority Date: 07/20/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Deshpande, Mayur Venktesh, Marifet, Kasem, Matthews, Jacob Burton, Wogulis, James Lee, Chou, Linus Page
• Primary Examiner(s): Lazaro, David
• Assistant Examiner(s): ABU ROUMI, MAHRAN Y
• Application Number:
  US13/187,423
• Time in Patent Office: 1,091 Days
• Field of Search: 709/238, 709/224, 709/217
• US Class Current: 709/213
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/321 Display for diagnostics, e.g. diagnostic result display, self-test user interface
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 17/40 Data acquisition and logging for input to computer G06F3/00
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data

Abstract

Machine-implemented methods for providing information to a graphical user interface for displaying web site traffic information are provided. In one aspect, a method includes acquiring low latency web site traffic data for a web site and acquiring historical web site traffic data for the web site. The method also includes combining, into combined web site traffic data, the low latency web site traffic data for the web site with the historical web site traffic data for the web site, and providing the combined web site traffic data to a graphical user interface for display. Systems, graphical user interfaces, and machine-readable media are also provided.

Claims

1. A machine-implemented method for providing information to a graphical user interface for displaying web site traffic information, the method comprising:

collecting, at a collecting tier, a first low latency web site traffic data for a web site;

pushing, from the collecting tier, the first low latency web site traffic data to a logging tier;

pushing, from the logging tier, the first low latency web site traffic data to a real-time analytics tier;

indexing, at the real-time analytics tier, using a first time stamp associated with the first low latency web site traffic data, an array element of an array, the array element comprising a time interval and a plurality of references, each corresponding to a respective aggregation table, each of the aggregation tables storing data of a different type;

comparing the first time stamp with the time interval;

determining, responsive to the first time stamp falling within the time interval, a reference from the plurality of references, the reference corresponding to an aggregation table of a data type of a first associated data associated with the first low latency web site traffic data;

updating the referenced aggregation table by incrementing a hit data corresponding to the first associated data;

collecting, at the collecting tier, a second low latency web site traffic data for the web site;

pushing, from the collecting tier, the second low latency web site traffic data to the logging tier;

pushing from the logging tier, the second low latency web site traffic data to the real-time analytics tier;

indexing, using a second time stamp associated with the second low latency web site traffic data, the array element;

comparing the second time stamp with the time interval;

storing, responsive to the second time stamp falling outside the time interval, a new time interval in the array element based on the second time stamp;

deleting all entries of the referenced aggregation table;

adding an entry to the referenced aggregation table, the entry comprising a second associated data associated with the second low latency web site traffic data and a hit data of one;

pushing, from the real-time analytics tier, the first low latency web site traffic data to a front-end tier when the first low latency web site traffic data is received within a threshold amount of time;

retrieving, at the front-end tier, historical traffic data for the web site from a memory element provided by a persistent tier;

combining, at the front-end tier, the first low latency web site traffic data with the historical web site traffic data into a combined web site traffic data;

formatting, at the front-end tier, the combined web site traffic data for display in a graphical user interface; and

providing, at the front-end tier, the combined web site traffic data to a graphical user interface for display.

2. The method of claim 1, wherein combining the first low latency web site traffic data with the historical web site traffic data further comprises

combining a type of web site traffic data selected from time data, geo-location data, activity type data, source data, target data, visitor data, visit data, hit data, advertisement data, or search term data.

3. The method of claim 1, wherein combining the first low latency web site traffic data with the historical web site traffic data further comprises

combining web site traffic data comprising plurality of types;

and

wherein providing the combined web site traffic data comprises

providing, at the front-end tier, the combined web site traffic data to a graphical user interface for concurrent display of the plurality of types.

4. The method of claim 1, further comprising:

receiving, at the front-end tier, a request for additional information on the combined web site traffic data from the graphical user interface; and

providing, in response to the request, additional information to the graphical user interface for display.

5. The method of claim 1, further comprising:

receiving, at the front-end tier, from the graphical user interface, a selection of a portion of the combined web site traffic data displayed in the graphical user interface; and

providing, in response to receiving the selection, additional information on the selection to the graphical user interface for display.

6. The method of claim 1, further comprising:

retrieving, at the front-end tier, a second historical traffic data for the web site from the memory element provided by the persistent tier;

combining, at the front-end tier, the second historical traffic data with the combined web site traffic data into a second combined web site traffic data; and

providing, at the front-end tier, the second combined web site traffic data to a graphical user interface for display.

7. The method of claim 6, further comprising

associating the combined web site traffic data and the second combined web site traffic data with a publisher.

8. A system for providing information to a graphical user interface for displaying web site traffic information, the system comprising:

a collecting tier, in connection with a network and a logging tier, the collecting tier having a server including a processor executing the steps of

collecting a first low latency web site traffic data, and

pushing the first low latency web site traffic data to a logging tier,

collecting a second low latency web site traffic data,

pushing the second low latency web site traffic data to the logging tier;

a logging tier, in connection with the collection tier and a real-time analytics tier, the logging tier having a server including a processor executing the steps of

pushing the first low latency web site traffic data to a real-time analytics tier,

pushing the second low latency web site traffic data to the real-time analytics tier;

a real-time analytics tier, in connection with the logging tier and a front-end tier, the real-time analytics tier having a server including a processor executing the steps of

indexing, using a first time stamp associated with the low latency web site traffic data, an array element of an array, the array element comprising a time interval and a plurality of references, each corresponding to a respective aggregation table, each of the aggregation tables storing data of a different type,

comparing the first time stamp with the time interval,

determining, responsive to the first time stamp falling within the time interval, a reference from the plurality of references, the reference corresponding to an aggregation table of a data type of a first associated data associated with the first low latency web site traffic data,

updating the referenced aggregation table by incrementing a hit data corresponding to the associated first low latency web site traffic data,

indexing, using a second time stamp associated with the second low latency web site traffic data, the array element,

comparing the second time stamp with the time interval,

storing, responsive to the second time stamp falling outside the time interval, a new time interval in the array element based on the second time stamp,

deleting all entries of the referenced aggregation table,

adding an entry to the referenced aggregation table, the entry comprising a second associated data associated with the second low latency web site traffic data and a hit data of one,

pushing the first low latency web site traffic data to a front-end tier when the first low latency web site traffic data is received within a threshold amount of; and

a front-end tier, in connection with the real-time analytics tier and a persistent tier, the front end tier having a server including a processor executing the steps of

retrieving a historical web site traffic data for the web site from a memory element provided by a persistent tier,

combining the first low latency web site traffic data with the historical web site traffic data into a combined web site traffic data,

formatting the combined web site traffic data for display in a graphical user interface, and

providing the combined web site traffic data to a graphical user interface for display.

9. The system of claim 8, wherein the front-end tier combining the first low latency web site traffic data with the historical web site traffic data further comprises

combining a type of web site traffic data selected from time data, geo-location data, activity type data, source data, target data, visitor data, visit data, hit data, advertisement data, or search term data.

10. The system of claim 8, wherein the front-end tier combining the first low latency web site traffic data with the historical web site traffic data further comprises

combining web site traffic data comprising plurality of types;

and

wherein the front-end tier providing the combined web site traffic data comprises

providing the combined web site traffic data to a graphical user interface for concurrent display of the plurality of types.

11. The system of claim 8, wherein the front-end tier further comprises:

receiving a request for additional information on the combined web site traffic data from the graphical user interface; and

providing, in response to the request, additional information to the graphical user interface for display.

12. The system of claim 8, wherein the front-end tier further comprises:

receiving from the graphical user interface, a selection of a portion of the combined web site traffic data displayed in the graphical user interface; and

providing, in response to receiving the selection, additional information on the selection to the graphical user interface for display.

13. The system of claim 8, wherein the front-end tier further comprises:

retrieving a second historical traffic data for the web site from the memory element provided by the persistent tier;

combining the second historical traffic data with the combined web site traffic data into a second combined web site traffic data; and

providing the second combined web site traffic data to a graphical user interface for display.

14. The system of claim 13, the front-end tier further comprising

associating the combined web site traffic data and the second combined web site traffic data with a publisher.