Rule-based validation of websites

• US 8,589,790 B2
• Filed: 01/27/2011
• Issued: 11/19/2013
• Est. Priority Date: 11/02/2008
• Status: Active Grant

• Current Assignee: ObservePoint, Inc.
• Original Assignee: ObservePoint, Inc.
• Inventors: Seolas, Robert K., Pestana, John, Broadbent, J. Tyler, Feuerlein, Alan Martin
• Primary Examiner(s): Hutton, Jr., Doug
• Assistant Examiner(s): DYER, ANDREW R
• Application Number:
  US13/015,387
• Publication Number:
  US 20110119220A1
• Time in Patent Office: 1,027 Days
• Field of Search: 715/234, 715/237
• US Class Current: 715/234
• CPC Class Codes: G06F 11/3608 using formal methods, e.g. model checking, abstract interpretation theorem proving G06N5/013
• CPC Class Codes: G06F 11/362 Software debugging
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

An automated website analysis system includes mechanisms for automatically auditing a website to validate that the scanned web page information conforms to validation rules. In one implementation, an auditing system requests web pages of an identified website pursuant to validating at least a portion of each requested web page. Embodiments include scanning page code of at least one of the web pages to identify scanned web page information, including a page tag. The scanned web page information is validated to determine whether is conforms to at least one validation rule by validating variables of the page tag against validation rules, including a vendor validation rule. Results of the validation are reported.

Claims

1. In a computerized environment comprising an auditing system and a website having one or more web pages that have one or more parent and child relationships, a method of the auditing system automatically identifying at least one page tag from scanned web page information for at least one web page and validating that the page tag conforms to at least one vendor validation rule, the method comprising the acts of:

requesting one or more web pages of an identified website pursuant to validating at least a portion of each of the one or more web pages;

scanning page code of at least one of the web pages to identify scanned web page information, including at least one page tag;

validating whether one or more variables of the at least one page tag conforms to at least one vendor validation rule for a vendor type of the page tag;

for each of the one or more web pages that failed validation;

identifying at least one corresponding page tag that failed validation;

identifying at least one variable of the corresponding page tag that failed validation;

calculating a percentage of web pages that passed validation; and

calculating a percentage of web pages that failed validation; and

reporting results of the validation, wherein the act of reporting comprises displaying a summary report of one or more web pages having the corresponding page tag that failed validation, the summary report including the identification of at least one corresponding page tag that failed validation, the identification of at least one variable of the corresponding page tag that failed validation, the percentage of web pages that passed validation, and the percentage of web pages that failed validation.

2. The method of claim 1, further comprising the acts of:

identifying that the page tag includes the one or more variables; and

determining the vendor type of the page tag.

3. The method of claim 1, wherein the act of validating comprises at least one of:

validating that a character length of at least one variable value is within a valid range;

validating that at least one variable value comprise a string when a string is expected;

or

validating that at least one variable value comprises an integer when an integer is expected.

4. The method of claim 1, wherein the act of validating comprises at least one of:

executing at least one regular expression that is on the at least one page tag;

or

executing at least one regular expression that is on a rendering of the at least one page tag.

5. The method of claim 1, further comprising:

accessing at least one user validation rule;

verifying that at least one precondition of the at least one user validation rule has been met; and

validating whether the at least one page tag conforms to at least one requirement of the at least one user validation rule.

6. The method of claim 1, wherein that act of scanning comprises identifying page data, the method further comprising:

accessing at least one user validation rule;

verifying that at least one precondition of the at least one user validation rule has been met; and

validating whether the page data conforms to at least one requirement of the at least one user validation rule.

7. The method of claim 1, further comprising:

rendering the at least one page tag to generate a string that includes the one or more variables; and

executing at least one regular expression that is on the string to identify the one or more variables.

8. In a computerized environment, one or more computer storage devices having computer-executable instructions stored thereon that, when executed cause one or more processors in a computer system to perform a perform a method of automatically identifying scanned web page information for at least one web page and validating that the scanned web page information conforms to at least one validation rule, the method comprising the acts of:

requesting one or more web pages of an identified website pursuant to validating at least a portion of each of the one or more web pages;

scanning page code of at least one of the web pages to identify scanned web page information, including at least one page tag;

validating whether one or more variables of the at least one page tag conforms to at least one vendor validation rule for a vendor type of the page tag; and

for each of the one or more web pages that failed validation;

identifying at least one corresponding page tag that failed validation;

identifying at least one variable of the corresponding page tag that failed validation;

calculating a percentage of web pages that passed validation; and

calculating a percentage of web pages that failed validation; and

reporting results of the validation, wherein the act of reporting comprises displaying a summary report of one or more web pages having the corresponding page tag that failed validation, the summary report including the identification of at least one corresponding page tag that failed validation, the identification of at least one variable of the corresponding page tag that failed validation, the percentage of web pages that passed validation, and the percentage of web pages that failed validation.

9. In a computerized environment comprising an auditing system including a memory and a website having one or more web pages that have one or more parent and child relationships, a method of the auditing system automatically identifying at least one page tag from scanned web page information for at least one web page and validating that the page tag conforms to at least one vendor validation rule and at least one user validation rule, the method comprising the acts of:

creating at least one user validation rule, where the step of creating comprises the acts of;

selecting a particular tag vendor type against which the at least one user validation rule should be run, wherein the a particular tag vendor type corresponds to a vendor type of the page tag;

specifying names of one or more tag vendor accounts established with the tag vendor;

specifying one or more preconditions to be met before the at least one user validation rule is run against page tags;

specifying one or more requirements to be met for the at least one user validation rule to pass validation; and

specifying one or more domains on which the at least one user validation rule be run;

receiving at least one web page of a website pursuant to validating at least a portion of the at least one web page;

parsing page code of the least one of the web page to identify web page information, including at least one page tag and one or more variables of the at least one page tag;

verifying whether the one or more variables conforms to at least one validation rule for the at least one page tag, the at least one vendor validation rule corresponding to the vendor type of the page tag;

verifying whether the one or more variables conform to the at least one user validation rule; and

sending a report of the verification to a user.

10. The method of claim 9, further comprising an act of determining the vendor type of the page tag by executing at least one regular expression that is on the page tag, or that is on a rendering of the page tag.

11. The method of claim 9, wherein the act of verifying conformity to the user validation rule comprises:

verifying that at least one precondition of the at least one user validation rule validation has been met; and

validating that the one or more variables conform to at least one requirement of the at least one user validation rule.

12. The method of claim 9, wherein the page tag comprises a tracking pixel.

13. The method of claim 9, wherein the act of sending the report comprises:

reporting that validation of the page tag failed; and

identifying at least one of the one or more variables that failed verification.

14. The method of claim 9, wherein the web page information includes page data, the act of verifying conformity to the user validation rule comprising:

verifying that at least one precondition of at least one user validation rule has been met; and

validating that the page data conforms to at least one requirement of the at least one user validation rule.

15. The method of claim 14, wherein validating that the page data conforms to at least one requirement of the at least one user validation rule comprises validating that a rendering of the page data conforms to the at least one requirement.

16. The method of claim 14, wherein the act of sending the report comprises reporting that validation that the page data conforms to the at least one requirement of the at least one user validation rule has failed.

17. The method of claim 9, wherein the at least one user validation rule is created by an operator of the website.