Method and system for website analysis

• US 20050262063A1
• Filed: 04/26/2005
• Published: 11/24/2005
• Est. Priority Date: 04/26/2004
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: Watchfire Corp. (Ontario) (International Business Machines Corporation)
• Inventors: McDougall, Derek, Conboy, Craig, Rolleston, Andrew
• Application Number:
  US11/114,796
• Publication Number:
  US 20050262063A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results

Abstract

The invention relates generally to computers and communications, and more specifically, to a method and system for analyzing Web sites and similar data structures. Tools exist for analyzing Web sites and locating problems, or simply collecting data, but the existing tools are very limited in what they can do, generally restricting the User to a selection of predetermined “tick-box” options. The invention provides an environment in which flexible and sophisticated search parameters may be defined by the User via regular expressions and a standard language specification. This allows the User to tailor his searches to match his specific Web site policy. The “extensible scan rules” of the invention also allow logic tests and analysis to be implemented, so that the search results are far more useful and relevant to the User.

Claims

1. A method of Web site analysis comprising the steps of:

establishing parameters for search and analysis of a Web page, including customized search rules, formatted according to a defined language specification;

analyzing said Web page to identify structure and content issues, and collect data, including executing said customized search rules; and

generating a report on the results of said analysis.

2. The method of claim 1, wherein said step of analyzing further comprises the step of storing collected data on a database.

3. The method of claim 2, wherein said customized search rules include logical tests.

4. The method of claim 2, wherein said step of executing comprises the step of compiling said customized search rules.

5. The method of claim 2, wherein said step of executing comprises the step of interpreting said customized search rules.

6. The method of claim 5, further comprising the step of entering said customized search rules using a text editor.

7. The method of claim 5, further comprising the step of parsing said customized search rules.

8. The method of claim 6, wherein said customized search rules are defined in XML (extensible mark-up language code).

9. The method of claim 5, wherein said step of interpreting comprises the step of creating objects from said rules using compiled code modules.

10. The method of claim 8, wherein said step of interpreting comprises the steps of:

parsing said XML code and generating an Xpath tree; and

walking said Xpath tree and creating objects from compiled C# code.

11. The method of claim 2, wherein said step of analyzing comprises the steps of:

executing logic and matching patterns;

processing on found matches, and

inserting processed data into a database.

12. The method of claim 5 further comprising the step of:

querying the User to input parameters for said analysis.

13. The method of claim 5 wherein the software code for effecting said method comprises a Runtime Module for interpreting and executing said rules.

14. The method of claim 5 wherein the software code for effecting said method comprises an Execution Environment Module for pre-processing said rules.

15. The method of claim 5 wherein the software code for effecting said method comprises a database for storing XRules Metadata, XRules Data and XRules XML code.

16. The method of claim 5 further comprising the step of identifying Web pages which exceed a certain threshold level for certain content issues.

17. A system for analyzing a Web site, said system comprising:

a Web server;

a Content Analysis server; and

a communication network for interconnecting said Web server and said Content Analysis server;

said Web server supporting said Web site; and

said Content Analysis server being operable to;

establishing parameters for search and analysis of a Web page, including customized search rules, formatted according to a defined language specification;

analyzing said Web page to identify structure and content issues, and collect data, including executing said customized search rules; and

generating a report on the results of said analysis.