Evaluation of web pages

• US 8,364,667 B2
• Filed: 03/01/2010
• Issued: 01/29/2013
• Est. Priority Date: 03/04/2009
• Status: Expired due to Fees

• Current Assignee: Alibaba Group Holding Ltd.
• Original Assignee: Alibaba Group Holding Ltd.
• Inventors: Chen, Hua
• Primary Examiner(s): Wong, Leslie
• Application Number:
  US12/660,606
• Publication Number:
  US 20100228718A1
• Time in Patent Office: 1,065 Days
• Field of Search: 707/999.01, 707/999.107, 707/723, 707/758
• US Class Current: 707/723
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/338 Presentation of query results
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results

Abstract

A web page evaluation technique includes obtaining a plurality of web pages with the same or approximately the same content. Further, a plurality of generation times and a plurality of first evaluation values that correspond to respective ones of the plurality of web pages are determined. A web page among the plurality of web pages that has the earliest generation time is identified. A second evaluation value of the identified web page is determined according to the plurality of first evaluation values. The second evaluation value can be used to indicate a ranking of the identified web page.

Claims

1. A method comprising:

obtaining a plurality of web pages with the same or approximately the same content;

determining, using one or more computer processors, a plurality of generation times, and a plurality of first evaluation values that correspond to a plurality of first ranks of the respective ones of the plurality of web pages;

wherein;

for one of the plurality of web pages, its corresponding generation time includes;

a time at which content of the one of the plurality of web pages was published, a time at which content of the one of the plurality of web pages was released, a time at which the one of the plurality of web pages was crawled, or a time that was mentioned by the content of the one of the plurality of web pages;

identifying an earliest web page among the plurality of web pages that has the earliest generation time; and

determining a second evaluation value of the identified earliest web page based at least in part on the plurality of first evaluation values;

wherein;

the second evaluation value is used to indicate a copy rank of the identified earliest web page among the plurality of web pages.

2. The method of claim 1, further comprising identifying the plurality of web pages with the same or approximately the same content by comparing their respective digital fingerprints.

3. The method of claim 1, wherein determining the generation time of each web page comprises determining the generation time according to a time contained in the Uniform Resource Locator URL of each web page.

4. The method of claim 1, wherein determining the generation time of each web page comprises determining the generation time according to a time in each content-type web page.

5. The method of claim 1, wherein determining the generation time of each web page comprises determining the generation time according to a time each web page is crawled.

6. The method of claim 1, wherein determining the generation time of each web page comprises determining the generation time according to a time each web page is first accepted in an index.

7. The method of claim 1, wherein the second evaluation value is greater than any of the plurality of first evaluation values.

8. The method of claim 1, wherein:

the second evaluation value is a product of the sum of the plurality of first evaluation values and a first weighting coefficient, plus a product of the first evaluation value of the identified web page and a second weighting coefficient;

the first weighting coefficient and the second weighting coefficient are set such that the first weighting coefficient is greater than the second weighting coefficient.

9. The method of claim 1, wherein each of the plurality of first evaluation values is an evaluation value formed according to data including external links.

10. The method of claim 1, further comprising:

obtaining the plurality of web pages after making a query; and

determining a plurality of second evaluation values for respective ones of the plurality of web pages;

ranking the plurality of web pages based at least on the plurality of second evaluation values.

11. The method of claim 1, further comprising:

displaying the number of reproduction times of the identified web page.

12. A method comprising:

obtaining a plurality of web pages with the same or approximately the same content;

determining, using one or more computer processors, a plurality of generation times and a plurality of first evaluation values that correspond to respective ones of the plurality of web pages;

identifying a web page among the plurality of web pages that has the earliest generation time;

determining a second evaluation value of the identified web page according to the plurality of first evaluation values; and

identifying the plurality of web pages with the same or approximately the same content by comparing their respective digital fingerprints;

wherein identifying the plurality of web pages with the same or approximately the same content comprises;

obtaining an intermediate paragraph with longest content in a set of web pages, the intermediate paragraph being neither a first paragraph nor a last paragraph in the respective web page, or obtaining a longest sentence in each of the set of web pages, the longest sentence being neither the first sentence nor the last sentence;

generating a digital fingerprint for each web page based on the obtained intermediate paragraph or the longest sentence for each web page; and

comparing the digital fingerprint of each web page to identify the plurality of web pages among the set of web pages with the same or approximately the same content.

13. A system, comprising:

one or more computer processors configured to;

obtain a plurality of web pages with the same or approximately the same contents;

determine a plurality of generation times, and a plurality of first evaluation values that correspond to a plurality of first ranks of the respective ones of the plurality of web pages;

wherein;

for one of the plurality of web pages, its corresponding generation time includes;

a time at which content of the one of the plurality of web pages was published, a time at which content of the one of the plurality of web pages was released, a time at which the one of the plurality of web pages was crawled, or a time that was mentioned by the content of the one of the plurality of web pages;

identify an earliest web page among the plurality of web pages that has the earliest generation time, and

determine a second evaluation value of the identified earliest web page based at least in part on the plurality of first evaluation values;

wherein

the second evaluation value is used to indicate a copy rank of the identified earliest web page among the plurality of web pages; and

one or more memories coupled to the one or more computer processors, configured to provide the one or more processors with instructions.

14. The system of claim 13, wherein the one or more computer processors are further configured to identify the plurality of web pages with the same or approximately the same content by comparing their respective digital fingerprints.

15. The system of claim 13, wherein to determine the generation time of each web page includes to determine the generation time according to a time contained in the Uniform Resource Locator URL of each web page.

16. The system of claim 13, wherein to determine the generation time of each web page includes to determine the generation time according to a time in each content-type web page.

17. The system of claim 13, wherein to determine the generation time of each web page includes to determine the generation time according to a time each web page is crawled.

18. The system of claim 13, wherein to determine the generation time of each web page includes to determine the generation time according to a time each web page is first accepted in an index.

19. The system of claim 13, wherein the second evaluation value is greater than any of the plurality of first evaluation values.

20. The system of claim 16, wherein:

the second evaluation value is a product of the sum of the plurality of first evaluation values and a first weighting coefficient, plus a product of the first evaluation value of the identified web page and a second weighting coefficient;

the first weighting coefficient and the second weighting coefficient are set such that the first weighting coefficient is greater than the second weighting coefficient.

21. The system of claim 13, wherein each of the plurality of first evaluation values is an evaluation value formed according to data including external links.

22. The system of claim 13, wherein the one or more computer processors are further configured to:

obtain the plurality of web pages after making a query; and

determine a plurality of second evaluation values for respective ones of the plurality of web pages;

rank the plurality of web pages based at least on the plurality of second evaluation values.

23. The system of claim 13, wherein the one or more computer processors are further configured to display the number of reproduction times of the identified web page.