Evaluation of web pages

• US 9,223,880 B2
• Filed: 06/13/2014
• Issued: 12/29/2015
• Est. Priority Date: 03/04/2009
• Status: Active Grant

• Current Assignee: Alibaba Group Holding Ltd.
• Original Assignee: Alibaba Group Holding Ltd.
• Inventors: Chen, Hua
• Primary Examiner(s): Wong, Leslie
• Application Number:
  US14/304,674
• Publication Number:
  US 20150006506A1
• Time in Patent Office: 564 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/338 Presentation of query results
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results

Abstract

A web page evaluation technique includes obtaining a plurality of web pages with the same or approximately the same content. Further, a plurality of generation times and a plurality of first evaluation values that correspond to respective ones of the plurality of web pages are determined. A web page among the plurality of web pages that has the earliest generation time is identified. A second evaluation value of the identified web page is determined according to the plurality of first evaluation values. The second evaluation value can be used to indicate a ranking of the identified web page.

Claims

1. A system comprising:

a crawler to obtain a plurality of web pages with the same or approximately the same content, wherein each two web pages of the plurality of web pages includes the same or approximately the same content; and

an indexer coupled to the crawler, and comprising one or more processors to;

determine a plurality of first evaluation values corresponding to respective ones of the plurality of web pages, wherein the plurality of first evaluation values comprises a plurality of first ranking parameter values;

identify a web page of the plurality of web pages as an original web page;

identify web pages other than the original web page of the plurality of web pages as reproduced web pages;

determine a second evaluation value associated with the original web page based at least in part on a combination comprising;

(1) a first evaluation value corresponding to the original web page from the plurality of first evaluation values; and

(2) an aggregation of first evaluation values corresponding to the reproduced web pages from the plurality of first evaluation values; and

rank the original web page among the plurality of web pages based at least in part on the second evaluation value associated with the original web page.

2. The system of claim 1, wherein to identify the web page of the plurality of web pages as the original web page comprises to:

determine a plurality of generation times corresponding to respective ones of the plurality of web pages; and

identify the original web page from the plurality of web pages based at least in part on the plurality of generation times.

3. The system of claim 1, wherein the plurality of web pages is obtained in response to a search query.

4. The system of claim 1, wherein a first evaluation value of the plurality of first evaluation values corresponding to a first web page of the plurality of web pages is determined based at least in part on at least one of an external link associated with the first web page and an internal link associated with the first web page.

5. The system of claim 1, wherein a first evaluation value of the plurality of first evaluation values corresponding to a first web page of the plurality of web pages indicates a degree of relevance associated with the first web page.

6. The system of claim 1, wherein the original web page is associated with an earliest generation time from a plurality of generation times corresponding to respective ones of the plurality of web pages.

7. The system of claim 1, wherein the plurality of web pages is determined based at least in part on:

comparing a first fingerprint value associated with a first web page of the plurality of web pages to a second fingerprint value associated with a second web page of the plurality of web pages; and

determining that the first fingerprint value matches the second fingerprint value.

8. The system of claim 7, wherein the first fingerprint value is determined based at least in part on a selected portion of content associated with the first web page.

9. The system of claim 1, wherein the one or more processors is further to include the original web page in a white list associated with original web pages.

10. The system of claim 1, wherein the one or more processors is further to display the original web page with a value determined based at least in part on a quantity associated with the reproduced web pages.

11. A method, comprising:

obtaining a plurality of web pages with the same or approximately the same content, wherein each two web pages of the plurality of web pages includes the same or approximately the same content;

determining, using one or more processors, a plurality of first evaluation values corresponding to respective ones of the plurality of web pages, wherein the plurality of first evaluation values comprises a plurality of first ranking parameter values;

identifying a web page of the plurality of web pages as an original web page;

identifying web pages other than the original web page of the plurality of web pages as reproduced web pages;

determining a second evaluation value associated with the original web page based at least in part on a combination comprising;

(1) a first evaluation value corresponding to the original web page from the plurality of first evaluation values; and

(2) an aggregation of first evaluation values corresponding to the reproduced web pages from the plurality of first evaluation values; and

ranking the original web page among the plurality of web pages based at least in part on the second evaluation value associated with the original web page.

12. The method of claim 11, wherein identifying the web page of the plurality of web pages as the original web page comprises:

determining a plurality of generation times corresponding to respective ones of the plurality of web pages; and

identifying the original web page from the plurality of web pages based at least in part on the plurality of generation times.

13. The method of claim 11, wherein a first evaluation value of the plurality of first evaluation values corresponding to a first web page of the plurality of web pages indicates a degree of relevance associated with the first web page.

14. The method of claim 11, wherein the original web page is associated with an earliest generation time from a plurality of generation times corresponding to respective ones of the plurality of web pages.

15. The method of claim 11, wherein the plurality of web pages is determined based at least in part on:

comparing a first fingerprint value associated with a first web page of the plurality of web pages to a second fingerprint value associated with a second web page of the plurality of web pages; and

determining that the first fingerprint value matches the second fingerprint value.

16. The method of claim 15, wherein the first fingerprint value is determined based at least in part on a selected portion of content associated with the first web page.

17. The method of claim 11, further comprising displaying the original web page with a value determined based at least in part on a quantity associated with the reproduced web pages.

18. A computer program product, the computer program product is embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

obtaining a plurality of web pages with the same or approximately the same content, wherein each two web pages of the plurality of web pages includes the same or approximately the same content;

determining a plurality of first evaluation values corresponding to respective ones of the plurality of web pages, wherein the plurality of first evaluation values comprises a plurality of first ranking parameter values;

identifying a web page of the plurality of web pages as an original web page;

identifying web pages other than the original web page of the plurality of web pages as reproduced web pages;

determining a second evaluation value associated with the original web page based at least in part on a combination comprising;

(1) a first evaluation value corresponding to the original web page from the plurality of first evaluation values; and

(2) an aggregation of first evaluation values corresponding to the reproduced web pages from the plurality of first evaluation values; and

ranking the original web page among the plurality of web pages based at least in part on the second evaluation value associated with the original web page.