Method and apparatus for scanning a web site in a distributed data processing system for problem determination

• US 6,615,259 B1
• Filed: 05/20/1999
• Issued: 09/02/2003
• Est. Priority Date: 05/20/1999
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Turek, John Joseph Edward, Shtalhaim, Menachem, Nguyen, Andrew Quoc Anh
• Primary Examiner(s): JAROENCHONWANIT, BUNJOB
• Application Number:
  US09/315,611
• Time in Patent Office: 1,566 Days
• Field of Search: 709/223, 709/224, 709/226, 709/200, 709/202, 370/242
• US Class Current: 709/224
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 41/0681 Configuration of triggering conditions
• CPC Class Codes: H04L 43/50 Testing arrangements
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 69/40 for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection management of faults, events, alarms or notifications in data switching networks H04L41/06
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A method and apparatus for identifying problems associated with a web site. A scan of a web site is initiated by a plurality of agents, wherein each of the plurality of agents are at a different location in the distributed data processing system. Results of the scan are obtained from the plurality of agents. The results of the scan are analyzed to determine if a problem is associated with the web site.

Claims

1. A method for scanning a target resource in a distributed data processing system, the method comprising the computer implemented steps of:

receiving a plurality of results from scans of a target resource made by a plurality of agents, wherein the plurality of agents arc located at different locations on the distributed data processing system;

analyzing the plurality of results to determine if a problem is present in the target resource by comparing the data about data streams resulting from the scan of the target to identify variations from different agents within the plurality of agents; and

responsive to identifying variations from different agents, comparing the data about data streams to at least one threshold, wherein the threshold indicates a level at which problem is present and associating the data about data stream with classifications.

2. The method of claim 1 further comprising:

initiating the scans of the target resource by the plurality of agents.

3. The method of claim 2, wherein the steps of initiating, receiving, and analyzing are performed by a single computer.

4. The method of claim 2, wherein the step of initiating is performed by a first computer while the steps of receiving and analyzing are performed by a second computer.

5. The method of claim 1, wherein the plurality of agents is a plurality of computers.

6. The method of claim 1, wherein the plurality of agents includes a Personal Digital Assistant device.

7. The method of claim 1, wherein the target resource is a computer.

8. The method of claim 1, wherein the target resource is a web site.

9. The method of claim 1, wherein the target resource is a file transfer protocol site.

10. The method of claim 1, wherein the plurality of results includes time needed to resolve a domain name address.

11. The method of claim 1, wherein the plurality of results includes time needed to download a document.

12. The method of claim 1 further comprising:

correlating results of the analysis to identify common attributes.

13. The method of claim 1, wherein the plurality of results are data about data streams resulting from the scan of the target.

14. The method of claim 1 further comprising:

sending a policy to each of the plurality of agents, wherein the policy identifies the web site to be scanned.

15. A computer program product in a computer readable medium for scanning a target resource in a distributed data processing system, the computer program product comprising:

first instructions for receiving a plurality of results from scans of a target resource made by a plurality of agents, wherein the plurality of agents arc located at different locations on the distributed data processing system;

second instructions for analyzing the plurality of results to determine if a problem is present in the target resource by comparing the data about data streams resulting from the scan of the target to identify variations from different agents within the plurality of agents; and

responsive to identifying variations from different agents, third instructions for comparing the data about data streams to at least one threshold, wherein the threshold indicates a level at which a problem is present and associating the data about data stream with classification.

16. The method of claim 15, further comprising:

comparing the data about data streams to prior data about data streams generated from scanning the target.

17. The method of claim 15, wherein the threshold is derived from historical data generated from prior scans of the web site.

18. A data processing system for scaning a target resource in a distributed data processing system, the data processing system comprising:

receiving means for receiving aplurality of result from scans of a target resource made by a pluarity of agents, wherein the pluarity of agents are located at different locations on the distributed data processing system;

analyzing means for analyzing the plurality of results to determine if a problem is presented in the target resource including first comparing means for comparing the data about data streams resulting from the scan of the target to identify variation from different agents within the pluarity of agents;

second comparing means, responsive to identify various from different agents, for comparing the data about data streams to at least one threshold, wherein the threshold indicates a level at which a problem is presented;

third comparing means for comparing the data about data streams with attributes associated with a plurality of classifications; and

associating means, responsive to comparing the data, for associating the data about data steams with classification.

19. A data processing system for scanning a target resource in a distributed data processing system, the data procuring system comprising:

receiving means for receiving a plurality of results from scans of a target resource made by a plurality of agents, wherein the plurality of agents arc located at different locations on the distributed data processing system;

analyzing means for analyzing the plurality of results to determine if a problem is present in the target resource including first comparing means for comparing the data about data streams resulting from the scan of the target to identify variations from different agents within the plurality of agents; and

second comparing means, responsive to identifying variations from different agents, for comparing the data about data streams to at least one threshold, wherein the threshold indicates a level at which a problem is present and associating the data about data stream with classifications.

20. The data processing system of claim 19 further comprising:

initiating means for initiating the scans of the target resource by the plurality of agents.

21. The data processing system of claim 20, wherein the steps of initiating, receiving, and analyzing are performed by a single computer.

22. The data processing system of claim 20, wherein the step of initiating is performed by a first computer while the steps of receiving and analyzing are performed by a second computer.

23. The data processing system of claim 19, wherein the plurality of agents is a plurality of computers.

24. The data processing system of claim 19, wherein the plurality of agents includes a Personal Digital Assistant device.

25. The data processing system of claim 19, wherein the target resource is a computer.

26. The data processing system of claim 19, wherein the target resource is a web site.

27. The data processing system of claim 19, wherein the target resource is a file transfer protocol site.

28. The data processing system of claim 19, wherein the plurality of results includes time needed to resolve a domain name address.

29. The data processing system of claim 19, wherein the plurality of results includes time needed to download a document.

30. The data processing system of claim 19 further comprising:

correlating means for correlating results of the analysis to identify common attributes.

31. The data processing system of claim 19 wherein the plurality of results are data about data streams resulting from the scan of the target.

32. The method of claim 19 further comprising:

sending means for sending a policy to each of the plurality of agents, wherein the policy identifies the web site to be scanned.

33. A method for scanning a target resource in a distributed data processing system, the method comprising the computer implemented steps of:

receiving a plurality of results from scans of a target resource made by a plurality of agents, wherein the plurality of agents are located at different locations on the distributed data processing system;

analyzing the plurality of results to determine if a problem is present in the target resource by comparing the data about data streams resulting from the scan of the target to identify variations from different agents within the plurality of agents and comparing the data about data stream, with attributes associated with a plurality of classification; and

responsive to comparing the data, comparing the data, comparing the data about data steams to at least one threshold, wherein the threshold indicates a level at which a problems is present and associating the data about data stream, with classifications.

34. The data processing system of claim 33, wherein the comparing means is a first comparing means and further comprising:

second comparing means for comparing the data about data streams to prior data about data streams generated from scanning the target.

35. The data processing system of claim 33 wherein the threshold is derived from historical data generated from prior scans of the web site.