Software system and associated methods for facilitating the analysis and management of web sites

• US 5,870,559 A
• Filed: 04/11/1997
• Issued: 02/09/1999
• Est. Priority Date: 10/15/1996
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Mercury Interactive Corp. (HP Inc.)
• Inventors: Weinberg, Amir, Leshem, Eran
• Primary Examiner(s): Harrell, Robert B.
• Assistant Examiner(s): Ovedovitz, David M.
• Application Number:
  US08/840,103
• Time in Patent Office: 669 Days
• Field of Search: 395/200.54, 395/200.53
• US Class Current: 709/224
• CPC Class Codes: G06F 11/32 with visual or acoustical indication of the functioning of the machine
• CPC Class Codes: G06F 11/323 Visualisation of programs or trace data
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A visual Web site analysis program, implemented as a collection of software components, provides a variety of features for facilitating the analysis and management of Web sites and Web site content. A mapping component scans a Web site over a network connection and builds a site map which graphically depicts the URLs and links of the site. Site maps are generated using a unique layout and display methodology which allows the user to visualize the overall architecture of the Web site. Various map navigation and URL filtering features are provided to facilitate the task of identifying and repairing common Web site problems, such as links to missing URLs. A dynamic page scan feature enables the user to include dynamically-generated Web pages within the site map by capturing the output of a standard Web browser when a form is submitted by the user, and then automatically resubmitting this output during subsequent mappings of the site. The Web site analysis program is implemented using an extensible architecture which includes an API that allows plug-in applications to manipulate the display of the site map. Various plug-ins are provided which utilize the API to extend the functionality of the analysis program, including an action tracking plug-in which detects user activity and behavioral data (link activity levels, common site entry and exit points, etc.) from server log files and then superimposes such data onto the site map.

Claims

1. An extensible software architecture for facilitating the mapping and analysis of web sites, comprising, on a computer-readable medium:

a mapping component which has executable code for scanning a web site and for generating a graphical site map of the web site, the graphical map represented by the mapping component as a map data structure which comprises a collection of node objects and link objects, the node objects representing content objects of the web site and the link objects representing links within the web site between the content objects, the node and link objects stored within the map data structure in association with display attributes which specify how the content objects and links are graphically displayed on a display screen within the graphical map; and

an application program interface (API) which includes methods that enable plug-in applications of the mapping component to access the node and link objects of the map data structure to obtain information about the web site, and which includes methods that enable the plug-in applications to modify the display attributes of at least the node and link objects to convey site-related information to a user via the graphical site map.

2. The software architecture according to claim 1, wherein the API includes one or more methods that enable the plug-in applications to selectively modify the respective colors of the content objects and links within the graphical map.

3. The software architecture according to claim 1, wherein the API includes one or more methods that enable the plug-in applications to selectively modify the respective visibilities of the content objects and links within the graphical map.

4. The software architecture according to claim 1, wherein the API includes one or more methods that enable the plug-in applications to add menu options to a user menu of the mapping component.

5. The software architecture according to claim 1, wherein the API includes one or more methods that enable the plug-in applications to attach custom attributes to the node and link objects.

6. The software architecture according to claim 1, wherein the mapping component stores scanning status information in the map data structure in association with the node objects, and the API includes one or more methods that enable the plug-in applications to access the scanning status information.

7. The software architecture according to claim 6, wherein the scanning status information of a node object that has been scanned by the mapping component indicates whether or not the corresponding content object was found by the mapping component during the scanning of the content object.

8. The software architecture according to claim 1, wherein the link objects include respective annotation attributes which specify link annotations that are displayed within the graphical map, and the API includes one or more methods that enable the plug-in applications to selectively modify the link annotation attributes.

9. The software architecture according to claim 1, wherein the mapping component includes executable code for retrieving content objects from the web site and for parsing retrieved content objects to identify links to other content objects, and the API includes one or more methods that enable the plug-in applications to access contents of content objects retrieved by the mapping component, the API thereby allowing the plug-in applications to access web site content which is retrieved during web site scanning but which is not stored within the map data structure.

10. The software architecture according to claim 1, further comprising a plug-in application which runs in conjunction with the mapping component and uses the API to superimpose data onto graphical site maps generated by the mapping component.

11. The software architecture according to claim 10, wherein the plug-in application uses the API to highlight links of the graphical map which satisfy a prespecified criteria.

12. The software architecture according to claim 10, wherein the plug-in application presents the user with a graphical color-coding key which indicates a color coding scheme used by the plug-in application to superimpose data onto the graphical site map.

13. The software architecture according to claim 10, wherein the plug-in application superimposes link activity data onto the graphical site map.

14. The software architecture according to claim 13, wherein the plug-in application generates the link activity data by processing a server log access file maintained by the web site to identify paths traveled by visitors to the web site.

15. The software architecture according to claim 1, wherein the mapping component displays the content objects as respective icons within the graphical map, and displays the links as respective lines between pairs of icons.

16. The software architecture according to claim 1, wherein the mapping component graphically represents parent-child relationships between content objects of the web site by positioning children objects around their respective immediate parent objects within the graphical map.

17. The software architecture according to claim 1, wherein the mapping component has executable code which allows a user to initiate a scan of a dynamically-generated web page and to add a graphical representation of the dynamically-generated web page to the graphical map.

18. An extensible software package for facilitating the management and analysis of web sites, comprising, on a computer-readable medium:

a mapping component which has executable code for scanning a web site over a network connection and for generating a graphical site map of the web site, and which includes a graphical user interface which provides controls for allowing a user to navigate and analyze the graphical map, the graphical map including visual representations of content objects and links of the web site detected during scanning of the web site;

an application program interface (API) which allows other executable components to communicate with the mapping component, the API including methods for at least (i) accessing web site information retrieved by the mapping component, and (ii) selectively modifying the visual representations of the content objects and links within the graphical map; and

an application which runs in conjunction with the mapping component and communicates with the mapping component via the API, the application configured to superimpose information onto the graphical site map by using the API methods to modify the visual representations of the content objects and/or the links.

19. The software package according to claim 18, wherein the graphical user interface of the mapping component presents the user with a menu option which allows the user to selectively invoke the application.

20. The software package according to claim 18, wherein the API includes at least one method for selectively modifying display colors of the content objects and links within the graphical map.

21. The software package according to claim 18, wherein the API includes at least one method for displaying an annotation within the map in association with a content object or a link visually represented within the graphical map.

22. The software package according to claim 18, wherein the application superimposes visitor activity data on the site map via the API, the visitor activity data representing actions taken by visitors to the web site during navigation of the web site.

23. The software package according to claim 22, wherein the application generates the visitor activity data by analyzing a server access log file of the web site in combination with link data retrieved by the mapping component to identify probable navigation paths taken by visitors to the web site.

24. The software package according to claim 22, wherein the application displays different links of the web site in different colors to represent different respective thresholds of link activity.

25. The software package according to claim 18, wherein the mapping component generates a map data structure in which the content objects and links are represented as respective node and link objects, the node and link objects containing display attributes which specify how the corresponding content objects and links are to be visually represented within the graphical map, at least some of the display attributes changeable via the API.

26. The software architecture according to claim 18, wherein the mapping component displays the content objects as respective icons within the graphical map, and displays the links as respective lines between pairs of icons.

27. A plug-in application for extending the functionality of a software package that provides web site scanning and mapping capabilities, the software package including executable code for scanning a web site and for generating a graphical site map of the web site, the plug-in application configured to run in conjunction with the software package and to communicate with the software package via an application program interface (API) of the software package, the plug-in application including executable code for displaying web-site-related data on the site map via the API, the plug-in application further including executable code for adding at least one menu option to a graphical user interface (GUI) of the software package via the API to allow a user to invoke the plug-in application from within the software package.

28. The plug-in application according to claim 27, wherein the software package generates a map data structure which represents the graphical site map, the map data structure including node objects which represent content items of the web site and including link objects which represent links between content objects of the web site, and wherein the plug-in application includes executable code for accessing the node and link objects via the API to obtain information about the web site.

29. The plug-in application according to claim 28, wherein the node and link objects include display attributes which specify how the corresponding content objects and links are displayed by the software package within the graphical site map, and the plug-in application includes executable code for selectively modifying the display attributes via the API to modify graphical representations of the content objects and links within the site map.

30. The plug-in application according to claim 29, wherein the software package graphically represents the content objects as respective icons within the site map, and the plug-in application includes executable code for modifying at least one of the color and the visibility of a content object icon within the map via the API.

31. The plug-in application according to claim 30, wherein the software package graphically represents the links of the web site as respective lines which interconnect pairs of the icons, and the plug-in application includes executable code for modifying at least one of the color and the visibility of the lines via the API.

32. The plug-in application according to claim 31, further comprising executable code for modifying annotation attributes of the link objects via the API to thereby display textual information in association with the links of the web site.

33. The plug-in application according to claim 31, further comprising executable code that displays a color-coding key in association with the map, the color-coding key indicating a color coding scheme used by the plug-in application to superimpose the web-site-related data onto the graphical site map.