System and method for processing web activity data

• US 7,853,684 B2
• Filed: 10/15/2002
• Issued: 12/14/2010
• Est. Priority Date: 10/15/2002
• Status: Active Grant

• Current Assignee: SAS Institute Incorporated
• Original Assignee: SAS Institute Incorporated
• Inventors: Grant, Thomas E. Jr., Koch, Donald O.
• Primary Examiner(s): BATES, KEVIN T
• Application Number:
  US10/271,340
• Publication Number:
  US 20040073644A1
• Time in Patent Office: 2,982 Days
• Field of Search: 709/201, 709/202, 709/203, 709/223, 709/224, 709/217, 707/749, 707/736, 707/759
• US Class Current: 709/224
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

A computer-implemented system and method for analyzing user browsing activity. Records from a web log that were generated during web browsing sessions are accessed. The web log includes at least one record that is detached from other records generated during the same browsing session as the one record. A web log data characteristic of the detached session record is compared with a web log data characteristic of other records in the web log. Based upon the comparison, the detached session record is associated with at least another record from the web log. The association between the detached session record and the another record is used to analyze user browsing activity.

Claims

1. A method for analyzing browsing activity, comprising:

generating, using one or more processors, one or more records during a browsing session, each record having corresponding cookie data;

placing the one or more records and the corresponding cookie data from the browsing session into a web log, wherein cookie data corresponding to at least one record is not placed into the web log;

grouping the one or more records in the web log, wherein each group is associated with cookie data corresponding to records generated during a particular browsing session;

determining that the record without corresponding cookie data was generated during a particular browsing session and has been detached from other records with corresponding cookie data generated during the particular browsing session, wherein the other records form a group of session records associated with the particular browsing session and the detached session record is not included in the group of session records associated with the particular browsing session;

determining that the detached session record is associated with the particular browsing session by comparing a web log data characteristic of the detached session record with a web log data characteristic of at least one record in the group of session records in the web log that are associated with the particular browsing session;

including the detached session record in the group of session records associated with the particular browsing session based upon the comparison; and

using the association between the detached session record and the particular browsing session to analyze browsing activity.

2. The method of claim 1, wherein browsing activity includes one or more browser requests to a web server to access content of a website.

3. The method of claim 2, wherein the web log contains data related to the one or more browser requests to the web server.

4. The method of claim 1, wherein the record without the corresponding cookie data was detached from the other records with corresponding cookie data because the record without the corresponding cookie data was written to the web log without visitor tracking data.

5. The method of claim 4, wherein the visitor tracking data includes visitor identification data used to uniquely identify a browser.

6. The method of claim 5, wherein the visitor identification data includes cookie data generated by a web server.

7. The method of claim 4, wherein the visitor tracking data includes visitor identification data used to uniquely identify a browsing session.

8. The method of claim 1, wherein the detached record is logically related to the other records generated during the same browsing session as the detached record.

9. The method of claim 1, further comprising:

using reattachment criteria and the web log data characteristics of the records to determine that the detached session record is associated with at least one record in the group of session records.

10. The method of claim 9, wherein the reattachment criteria includes similarity of agent, and wherein the web log data characteristics include agent information.

11. The method of claim 9, wherein the reattachment criteria includes similarity of Internet Protocol (IP) address, and wherein the web log data characteristics include an IP address.

12. The method of claim 9, wherein the reattachment criteria includes entry point data, and wherein the web log data characteristics include entry point data.

13. The method of claim 12, wherein the entry point data includes entry to the home page of a website.

14. The method of claim 9, wherein the reattachment criteria includes record time criteria, and wherein the web log data characteristics include record time criteria.

15. The method of claim 9, wherein the reattachment criteria includes similarity of user agent information, similarity of IP address information, entry point data, and record time criteria.

16. The method of claim 15, wherein the web log data characteristics include user agent information, IP address information, entry point data, and record time information.

17. The method of claim 1, wherein the detached session record includes a session referrer, and wherein the detached session record represents a first website that referred a user to a second website.

18. The method of claim 17, wherein the detached session record represents a lost session referrer.

19. The method of claim 18, wherein the lost session referrer contained a banner advertisement that directed the user to the second website.

20. The method of claim 18, wherein the lost session referrer contained a search engine that directed the user to the second website.

21. The method of claim 18, wherein two or more of the session records in the group of session records associated with the particular browsing session contain session referrers that show referrals within the same website.

22. The method of claim 1, wherein the association is used to perform analysis as to where on the internet a web browser was prior to the first request of a particular browsing session in the web log.

23. The method of claim 22, wherein the analysis is used to design a website.

24. The method of claim 22, wherein the analysis is used to pay advertisers that refer users to a website.

25. The method of claim 22, wherein the analysis is used to pay referring websites.

26. The method of claim 22, wherein the analysis is used to structure advertising campaigns involving referring websites.

27. The method of claim 1, wherein a data mining application is used to analyze the browsing activity based upon the association.

28. The method of claim 1, wherein the web log records contain date-time fields, IP address fields, uniform resource identifier (URI) stem fields, cookie fields, referrer fields, and user agent fields.

29. The method of claim 1, further comprising:

grouping the records from the web log by agent data.

30. The method of claim 29, further comprising:

determining whether each record represents an entry page, when a record does not have a visitor identification information; and

placing the record in a visitor identification group based upon the entry point, if the record represents an entry point and if a visitor identification group is within a predetermined timeout threshold.

31. The method of claim 30, further comprising:

assigning a visitor identification to a record by comparing the IP address of the record to the IP addresses of other records within a visitor identification group.

32. A computer-implemented system, comprising:

one or more processors;

one or more computer-readable storage mediums containing software instructions executable on the one or more processors to cause the one or more processors to perform operations including;

generating one or more records during a browsing session, each record having corresponding cookie data;

placing the one or more records and the corresponding cookie data from the browsing session into a web log, wherein cookie data corresponding to at least one record is not placed into the web log;

grouping the one or more records in the web log, wherein each group is associated with cookie data corresponding to records generated during a particular browsing session;

determining that the record without corresponding cookie data was generated during a particular browsing session and has been detached from other records with corresponding cookie data generated during the particular browsing session, wherein the other records form a group of session records associated with the particular browsing session and the detached session record is not included in the group of session records associated with the particular browsing session;

determining that the detached session record is associated with the particular browsing session by comparing a web log data characteristic of the detached session record with a web log data characteristic of at least one record in the group of session records in the web log that are associated with the particular browsing session;

including the detached session record in the group of session records associated with the particular browsing session based upon the comparison; and

using the association between the detached session record and the particular browsing session to analyze browsing activity.

33. A computer-readable storage medium encoded with instructions that when executed on one or more processors within a computer system perform a method for analyze browsing activity, the method comprising:

generating one or more records during a browsing session, each record having corresponding cookie data;

placing the one or more records and the corresponding cookie data from the browsing session into a web log, wherein cookie data corresponding to at least one record is not placed into the web log;

grouping the one or more records in the web log, wherein each group is associated with cookie data corresponding to records generated during a particular browsing session;

determining that the record without corresponding cookie data was generated during a particular browsing session and has been detached from other records with corresponding cookie data generated during the particular browsing session, wherein the other records form a group of session records associated with the particular browsing session and the detached session record is not included in the group of session records associated with the particular browsing session;

determining that the detached session record is associated with the particular browsing session by comparing a web log data characteristic of the detached session record with a web log data characteristic of at least one record in the group of session records in the web log that are associated with the particular browsing session;

including the detached session record in the group of session records associated with the particular browsing session based upon the comparison; and

using the association between the detached session record and the particular browsing session to analyze browsing activity.