System and method for detecting and reporting online activity using real-time content-based network monitoring

• US 9,680,946 B2
• Filed: 06/15/2015
• Issued: 06/13/2017
• Est. Priority Date: 12/11/2000
• Status: Expired due to Term

• Current Assignee: Network Monitoring LLC
• Original Assignee: Peter K. Trzyna
• Inventors: Angeles, Patrick
• Primary Examiner(s): Shin, Kyung H
• Application Number:
  US14/739,992
• Publication Number:
  US 20150281386A1
• Time in Patent Office: 729 Days
• Field of Search: 709224, 709238, 709200, 709206, 709241, 709218, 707 10, 707E17111
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06F 16/9566 URL specific, e.g. using aliases, detecting broken or misspelled links
• CPC Class Codes: G06F 16/986 Document structures and storage, e.g. HTML extensions
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: H04L 43/00 Arrangements for monitoring or testing data switching networks
• CPC Class Codes: H04L 43/045 for graphical visualisation of monitoring data
• CPC Class Codes: H04L 43/06 Generation of reports
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 61/10 of different types
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 63/0281 Proxies
• CPC Class Codes: H04L 63/029 Firewall traversal, e.g. tunnelling or, creating pinholes
• CPC Class Codes: H04L 63/0823 : using certificates cryptographic mechanisms or cryptographic arrangements for entity authentication involving certificates H04L9/3263
• CPC Class Codes: H04L 63/166 : at the transport layer
• CPC Class Codes: H04L 67/02 : based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/535 : Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 69/329 : in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 : Network security protocols

Abstract

A computerized system and method for tracking and reporting online activity across a plurality of clients and servers is disclosed that intercepts and logs secure and non-secure HTTP request and response pages, analyzes each of the received page records, associates each page record to an event type based on user-defined parameters, identifies and extracts user-defined attributes of each page record based on its event type, and reports on the occurrence of the event along with its associated attributes.

Claims

1. A computer programmed digital electrical tracking system apparatus connected to a user browser and a Web server on the Internet, the apparatus adapted to:

provide the user browser with a Web page containing a URL specifying both an address of the tracking system and information that specifies a URL on the Web server;

upon receipt by the tracking system of a Web page request from the user browser, determine a Web server URL from the Web page request;

identify and extract captured information indicating that the user browser has requested the Web server URL, the captured information stored within one or more databases;

form parameter data based upon pre-determined selection parameters from the one or more databases;

encode an original URL as part of the tracking system'"'"'s URL path to construct at least one rewritten URL;

embed the rewritten URLs in a response such that a browser request to each of the rewritten embedded URLs is sent to the tracking system; and

cause the Web page specified by the Web server URL to be returned to the user browser; and

provide profiling and analysis of at least one session.

2. The apparatus of claim 1, wherein the apparatus causes the profiling by operations comprising identifying a site, associating of a logging page record with the sites, and associating at least one site page with event triggers, event pre-triggers and parse methods.

3. The apparatus of claim 1, wherein the apparatus causes the analysis by operations comprising reporting at least one of the following:

a session detail;

an event detail;

a purchase detail; and

a purchase summary.

4. The apparatus of claim 3, wherein the apparatus causes the generation of the session detail by operations comprising reporting at least one of the following:

activity start and end dates, by a site name;

a session identifier, a time at which the session was created;

a number of page views in the session;

a number of purchase events detected in the session;

a number of events detected in the session; and

the session'"'"'s duration and a user identifier.

5. The apparatus of claim 3, wherein the apparatus causes the generation of the event detail by operations comprising reporting at least one of the following:

activity start and end dates, by a site name,

a per event record that matches at least one of the parameters,

the session in which the event was detected;

a time of the event;

a site of the event;

an event type; and

a user identifier.

6. The apparatus of claim 3, wherein the apparatus causes the generation of the purchase detail by operations comprising reporting at least one of the following:

activity start and end dates, by a site name;

a per purchase item record that matches at least one of the parameters;

a purchase date;

a time at which the purchase occurred;

the site of the purchase;

a name of the purchased item;

a unit price of the item;

a quantity;

a price;

a user identifier; and

a credit-card type.

7. The apparatus of claim 6, wherein the apparatus returns the per purchase item record that matches a query containing the activity start and the end dates, by the site name.

8. The apparatus of claim 3, wherein the apparatus causes the generation of the purchase summary by operations comprising reporting at least one of the following:

activity start and end dates, by site;

a site record that matches at least one of the parameters;

the site name;

a number of purchases on the site;

a number of items purchased on the site;

a value of purchases on the site;

a number of page views on the site; and

a duration of all the sessions within the site.

9. The apparatus of claim 3, wherein the apparatus causes the generation of the purchase summary by operations that return a category code and a source code referral parameter for the sessions recorded by the rewritten embedded URLs.

10. The apparatus of claim 1, where the apparatus causes the Web page specified by the Web server URL to be returned to the user browser by operations comprising:

requesting the Web page from the Web server based on the Web server URL;

receiving the response from Web server; and

forwarding the response to the user browser.

11. The apparatus of claim 1, where the apparatus causes the Web page specified by the Web server URL to be returned to the user by operations comprising redirecting the user browser to the Web page on the Web browser.

12. The apparatus of claim 11, where the apparatus causes the redirection operation to be performed using an HTTP redirect.

13. The apparatus of claim 1, the apparatus is further adapted to:

dynamically maintaining the pre-determined selection parameters based upon revisable, operator-defined instructions on how to select and extract information from a text page; and

predicting future user activity by analyzing the parameter data.

14. The apparatus of claim 13, wherein the apparatus provides the predicting based on live traffic.

15. The apparatus of claim 13, wherein the apparatus provides the predicting based on based on stored client-server information.

16. The apparatus of claim 1, wherein the apparatus returns a purchase item record that matches a query containing activity start and end dates and site name.

17. A method of capturing on a computer programmed digital electrical tracking system information about activity of a user browser accessing a Web server, the method comprising:

providing a user browser with a Web page containing a URL specifying both an address of a tracking system and information that specifies a URL on a Web server;

upon receipt by the tracking system of a Web page request from the user browser, determining a Web server URL from the Web page request;

identifying and extracting captured information indicating that the user browser has requested the Web server URL, the captured information stored within a database;

forming parameter data based upon pre-determined selection parameters from the database;

encoding an original URL as part of the tracking system'"'"'s URL path to construct at least one rewritten URL;

embedding at least one of the rewritten URLs in a response such that a browser request to each of the rewritten embedded URLs is sent to the tracking system; and

providing site profiling and analysis of at least one session.

18. The method of claim 17, wherein the providing profiling comprises identifying a site, associating a logging page record with the site, and associating at least one site page with event triggers, event pre-triggers, and parse methods.

19. The method of claim 17, wherein the analysis comprises reporting at least one of the following:

a session detail of the session;

an event detail of an event;

a purchase detail of a purchase; and

a purchase summary of a purchase.

20. The method of claim 19, wherein the analysis includes the session detail, and generation of the session detail comprises reporting at least one of the following:

activity start and end dates, by a site name;

a session identifier;

a time at which the session was created;

a number of page views in the session;

a number of purchase events detected in the session;

a number of events detected in the session; and

the session'"'"'s duration and a user identifier.

21. The method of claim 19, wherein the analysis includes the event detail, and generation of the event detail comprises reporting at least one of the following:

activity start and end dates, by a site name;

a per event record that matches at least one of the parameters;

the session in which the event was detected;

a time of the event;

a site of the event;

an event type; and

a user identifier.

22. The method of claim 19, wherein the analysis includes the purchase detail, and generation of the purchase detail comprises reporting at least one of the following:

an activity start and end dates, by a site name;

a per purchase item that matches at least one of the parameters;

a purchase date;

a time at which the purchase occurred;

a site of the purchase;

a name of the purchased item;

a unit price of the item;

a quantity;

a price;

a user identifier; and

a credit-card type.

23. The method of claim 19, wherein the analysis includes the purchase summary, and generation of the purchase summary comprises reporting at least one of the following:

activity start and end dates, by a site,

a site record that matches at least one of the parameters;

at least one of the site name;

a number of purchases on the site;

a number of items purchased on the site;

a value of purchases on the site;

a number of page views on the site; and

a duration of all the sessions within the site.

24. The method of claim 19, wherein the analysis includes the purchase summary, and generation of the purchase summary returns a category code and a source code referral parameter for the sessions recorded by the rewritten embedded URLs.

25. The method of claim 17, wherein the Web page specified by the Web server URL is returned to the user browser by operations comprising:

requesting the Web page from the Web server based on the Web server URL;

receiving the response from Web server; and

forwarding the response to the user browser.

26. The method of claim 17, wherein the Web page specified by the Web server URL is returned to the user by operations comprising redirecting the user browser to the Web page on the Web browser.

27. The method of claim 26, wherein the redirecting is performed using an HTTP redirect.

28. The method of claim 17, further comprising:

dynamically maintaining the pre-determined selection parameters based upon revisable, operator-defined instructions on how to select and extract information from a text page; and

predicting future user activity by analyzing the parameter data.

29. The method of claim 17, wherein the analysis includes analysis performed on live traffic.

30. The method of claim 17, wherein the analysis includes analysis performed on stored client-server information.

31. The method of claim 17, further including returning a purchase item record that matches a query containing activity start and end dates and site name.