Page aggregation for web sites

• US 8,244,795 B2
• Filed: 02/24/2004
• Issued: 08/14/2012
• Est. Priority Date: 07/30/1999
• Status: Expired due to Fees

• Current Assignee: Verizon Corporate Services Group Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Corporate Services Group Incorporated (Verizon Communications Inc.), Verizon Laboratories Incorporated (Verizon Communications Inc.)
• Inventors: Ponte, Jay Michael
• Primary Examiner(s): ZIA, SYED
• Application Number:
  US10/785,729
• Publication Number:
  US 20050108325A1
• Time in Patent Office: 3,094 Days
• Field of Search: None
• US Class Current: 709/203
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

Disclosed is a method and device and computer storage medium for determining whether two pages linked on the World Wide Web are a part of the same World Wide Web site. The method involves examining and comparing the IP addresses of the Web pages, and can also be extended to finding other pages to which a given Web page is linked on the Web, and to determining whether a Web page of interest is part of a Web site with a desired characteristic, such as being part of an electronic commerce site.

Claims

1. A method for determining whether first and second linked World Wide Web pages are part of the same Web site, the method comprising:

(a) determining a multi-byte IP address of a server on which resides the first page and a multi-byte IP address of a server on which resides the second linked page, the multi-byte IP address having at least four bytes;

(b) if a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said first page is different than a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said second page, determining whether said first and second linked pages reside on at least one other combination of servers;

(c) if said first page and said second linked page reside on at least one other combination of servers, repeating (a) and (b) for said at least one other combination of servers, such that if the leading subset of the bytes of a multi-byte IP address, the multi-byte IP address having at least four bytes, of a server from said combination upon which resides said first page is identical to the leading subset of the bytes of a multi-byte IP address, the multi-byte IP address having at least four bytes, of a server from said combination upon which resides said second page, concluding that said first and second linked pages are part of said same Web site, and concluding said process; and

,

(d) if (b) does not yield at least one other combination of servers, concluding that said first and second linked pages are not part of said same Web site.

2. The method of claim 1, wherein said pages are located and said addresses are found by use of a specialized program for the analysis of Web content.

3. The method of claim 1, wherein said pages are located and said addresses are found by use of a Web robot.

22. The method of claim 1, wherein the multi-byte IP address has four bytes, and the leading subset includes three of the bytes of the multi-byte IP address.

4. A device for determining whether first and second linked World Wide Web pages are part of the same Web site, the device comprising:

(a) means for determining a multi-byte IP address of a server on which resides the first page and a multi-byte IP address of a server on which resides the second page, the multi-byte IP address having at least four bytes;

(b) means for comparing said IP addresses

(i) such that an identity between a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said first page and a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said second page indicates that said first and second linked pages are part of said same Web site, and

(ii) such that a difference between said leading subset of the bytes of said multi-byte IP address of said server upon which resides said first page and said leading subset of the bytes of said multi-byte IP address of said server upon which resides said second page requires a determination of whether said first page and said second page reside on at least one other combination of servers; and

,

(c) means for analyzing said at least one other combination of servers on which said first page and said second page reside, such that an absence of at least one other combination of servers on which said first page and said second page reside indicates that said first page and said second page are not part of said same Web site.

5. The device of claim 4, wherein said pages are located and said addresses are found by use of a specialized program for the analysis of the Web content.

6. The device of claim 4, wherein said pages are located and said addresses are found by use of a Web robot.

23. The device of claim 4, wherein the multi-byte IP address has four bytes, and the leading subset includes three of the bytes of the multi-byte IP address.

7. A non-transitory machine-accessible and readable storage medium containing a computer program having means for determining whether first and second linked World Wide Web pages are part of said same Web site, comprising:

(a) means for determining a multi-byte IP address of a server on which resides the first page and a multi-byte IP address of a server on which resides the second linked page, the multi-byte IP address having at least four bytes;

(b) means for comparing said IP addresses

(i) such that an identity between a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said first page and a leading subset of one or more of the bytes of said multi-byte IP address of said server upon which resides said second page indicates that said first and second linked pages are part of said same Web site, and

(ii) such that a difference between said leading subset of the bytes of said multi-byte IP address of said server upon which resides said first page and said leading subset of the bytes of said multi-byte IP address of said server upon which resides said second page requires a determination of whether said first page and second page reside on at least one other combination of servers; and

,

(c) means for analyzing said at least one other combination of servers on which said first page and said second page reside, such that an absence of at least one other combination of servers on which said first page and said second page reside indicates that said first page and said second page are not part of said same Web site.

8. The non-transitory machine-accessible and readable storage medium of claim 7, wherein said pages are located and said addresses are found by use of a specialized program for the analysis of Web content.

9. The non-transitory machine-accessible and readable storage medium of claim 7, wherein said pages are located and said addresses are found by use of a Web robot.

24. The medium of claim 7, wherein the multi-byte IP address has four bytes, and the leading subset includes three of the bytes of the multi-byte IP address.

10. A method of determining whether first and second pages are associated with the same site, the method of comprising:

determining by a computing Internet Protocol (IP) addresses of a pair of servers on which reside the first and second pages,

based on a leading subset of one or more of the bytes of said IP addresses of said pair of servers being different, determining whether said first and second pages reside on one or more different pairs of servers, and

based on said first and second pages residing on one or more different pairs of servers;

determining IP addresses of each of said one or more different pairs of servers,

comparing a leading subset of one or more of the bytes of said IP addresses of each of said one or more different pairs of servers to provide a comparison result for each of said one or more different pairs of servers, and

determining that said first and second pages are associated with said same site based on at least one of said comparison results indicating that said leading subset of the bytes of said IP addresses of said one or more different pairs of servers are identical.

11. The method of claim 10, further comprising:

using a search engine to determine said IP addresses.

12. The method of claim 10, further comprising:

using a search engine to determine whether said first and second pages reside on one or more different pairs of servers.

25. The method of claim 10, wherein the leading subset includes three bytes.

13. A method of identifying pages that are associated with the same site as a starting page, said method comprising:

based on a pre-determined link processing order, processing by a computing device all of said links on said starting page and all of said links on pages associated with said same sites as said starting page, wherein processing includes;

identifying on a page one or more links to one or more different pages,

determining IP addresses of a pair of servers on which reside said starting page and one of said one or more different pages,

comparing a leading subset of one or more of the bytes of said IP addresses to provide a comparison result for said pair of servers, and

determining that said starting page and said one of said one or more different pages are associated with said same site based on said comparison result for said pair of servers indicating that said leading subset of the bytes of said IP addresses of said pair of servers are identical.

14. The method of claim 13, wherein said pre-determined link processing order includes:

processing all of said links on a page before processing a link on a different page.

15. The method of claim 13, wherein said pre-determined link processing order includes:

processing a link on a page to a different page,

based on said different page being a member of said same site as said starting page, processing a link on said different page before processing another link on said page.

16. The method of claim 13, further comprising:

using a search engine to determine said IP addresses.

26. The method of claim 13, wherein the leading subset includes three bytes.

17. A method of determining whether a site includes data related to a search query, said method comprising:

determining by a computing device whether a starting page that is associated with said site includes data related to said search query,

based on said starting page not including data related to said search query, processing one or more of;

one or more links on said starting page and one or more links on pages determined to be associated with said same site as starting page, wherein processing includes;

identifying on a page one or more links to one or more different pages, determining IP addresses of a pair of servers on which reside said starting page and one of said one or more different pages,

comparing a leading subset of one or more of the bytes of said IP addresses to provide a comparison result for said pair of servers,

determining that said starting page and said one of said one or more different pages are associated with said same site based on said comparison result indicating that said leading subset of the bytes of said IP addresses of said pair of servers are identical, and

based on said starting page and said one of said one or more different pages being associated with said same site, determining whether said one of said one or more different pages includes data related to said search query, and

based on one or more pages determined to be associated with said same site as said starting page including data related to said search query, determining that said site includes data related to said search query.

18. The method of claim 17, further comprising:

using a search engine to determine said IP addresses.

19. The method of claim 17, further comprising:

using a search engine to determine whether a page includes data related to said search query.

20. The method of claim 17, wherein determining whether a page includes data related to a search query includes:

based on said content of said page, determining whether said page includes data related to said search query.

21. The method of claim 17, wherein determining whether a page includes data related to a search query includes:

based on identifying said search query in said content of said page, determining that said page includes data related to said search query.

27. The method of claim 17, wherein the leading subset includes three bytes.