WEBPAGE TEMPLATE GENERATING METHOD AND SERVER

• US 20160335243A1
• Filed: 05/17/2016
• Published: 11/17/2016
• Est. Priority Date: 11/26/2013
• Status: Active Grant

• Current Assignee: Alibaba Group Holding Ltd.
• Original Assignee: Uc Mobile Co., Ltd. (Alibaba Group Holding Ltd.)
• Inventors: Zhai, Guangya, Zheng, Haihong, Jiang, Weiran, Zhou, Xianggen
• Granted Patent: US 10,747,951 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 16/986 Document structures and storage, e.g. HTML extensions
• CPC Class Codes: G06F 40/186 Templates
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC

Abstract

Disclosed are a method of generating a webpage template and a server. The method of generating a webpage template comprises: collecting webpage data of a webpage, and generating a webpage template of the webpage according to the webpage data. By means of the present invention, the problem in the prior art that a method of generating a webpage template depends relatively strongly on a target website is solved, thereby reducing the dependence of the method of generating a webpage template on the target website.

Claims

1. A method of generating a webpage template, the method comprising:

collecting webpage data of a webpage;

generating a webpage template of the webpage according to the webpage data; and

generating a template index according to the generated webpage template.

2. The method of generating a webpage template according to claim 1, wherein, after the generating a webpage template of the webpage according to the webpage data, the method of generating a webpage template further comprises:

releasing the webpage template and the template index for multiple template servers that provide webpage templates;

storing, by the multiple template servers, the webpage template and the template index respectively; and

retrieving, by a first template server in the multiple template servers, a webpage template matching with the webpage by using the template index, and providing the template matching with the webpage for other template servers in the multiple template servers except the first template server.

3. The method of generating a webpage template according to claim 2, wherein the releasing the webpage template and the template index for multiple template servers that provide webpage templates comprises:

after multiple webpage templates and the template index are generated;

calculating an overall difference rate of a set of the multiple webpage templates and a set of historical templates;

judging whether the overall difference rate is greater than a preset overall difference rate threshold;

if it is judged that the overall difference rate is greater than the preset overall difference rate threshold, releasing the webpage template and the template index; and

if it is judged that the overall difference rate is not greater than the preset overall difference rate threshold, not releasing the webpage template and the template index.

4. The method of generating a webpage template according to claim 1, wherein the generating a template index according to the generated webpage template comprises:

selecting a template of which the quality satisfies a predetermined quality condition;

determining URL paths applicable to templates;

selecting, from the URL paths, a URL path applicable to the template of which the quality satisfies the predetermined quality condition; and

converting the selected path to a template index.

5. The method of generating a webpage template according to claim 1, wherein, after the generating a webpage template of the webpage according to the webpage data, the method of generating a webpage template further comprises:

judging whether the number of the webpage template reaches a preset number;

if it is judged that the number of the webpage template reaches the preset number, calculating a coverage rate of each webpage template;

comparing a webpage template of which the coverage rate is less than a first preset coverage rate threshold with a webpage template of which the coverage rate is greater than the first preset coverage rate threshold; and

if a difference rate between the webpage template of which the coverage rate is less than the first preset coverage rate threshold and the webpage template of which the coverage rate is greater than the first preset coverage rate threshold is less than a preset difference rate threshold, merging the webpage template of which the coverage rate is less than the first preset coverage rate threshold with the webpage template of which the coverage rate is greater than the first preset coverage rate threshold.

6. The method of generating a webpage template according to claim 5, wherein the comparing a webpage template of which the coverage rate is less than a first preset coverage rate threshold with a webpage template of which the coverage rate is greater than the first preset coverage rate threshold comprises:

sorting the multiple webpage templates according to the sizes of the coverage rates in a descending order; and

comparing a webpage template with a webpage template sorted in front of it.

7. The method of generating a webpage template according to claim 1, wherein the generating a template index according to the generated webpage template comprises:

storing multiple webpage templates;

calculating a coverage rate of each of the webpage templates;

judging whether the sum of the coverage rates of the webpage templates under each path reaches a second preset coverage rate threshold; and

deleting webpage templates under a path where the sum of the coverage rates of the webpage templates does not reach the second preset coverage rate threshold.

8. The method of generating a webpage template according to claim 1, wherein, after the generating a webpage template of the webpage according to the webpage data, the method of generating a webpage template comprises:

after webpage data acquired and forwarded by a middleware server in response to a received webpage browsing request from a terminal device is acquired, acquiring, from a webpage template data storage unit of a webpage template server, webpage template data corresponding to the webpage data;

generating differential data between the webpage data and the webpage template data based on the webpage data and the webpage template data; and

forwarding the generated differential data to the terminal device via the middleware server, for the terminal device to display a requested webpage according to the differential data and webpage template data corresponding to the differential data locally stored by the terminal device.

9. The method according to claim 8, wherein the webpage browsing request comprises a first webpage template ID list, and

webpage template data corresponding to the webpage data acquired from a webpage template data storage unit, and the generating differential data between the webpage data and the webpage template data based on the webpage data and the webpage template data comprises:

sequentially acquiring first webpage template IDs in the first webpage template ID list to repeatedly perform the following process, until the differential data is generated;

acquiring webpage template data from the webpage template data storage unit based on the first webpage template IDs currently acquired, and

calculating difference data between the webpage data and the webpage template data acquired from the webpage template data storage unit,

when a compression ratio between the calculated difference data and the webpage data is less than a first predetermined threshold, determining the difference data as the differential data, and

when the compression ratio between the calculated difference data and the webpage data is not less than the first predetermined threshold, acquiring a next first webpage template ID from the first webpage template ID list as a new first webpage template ID currently acquired.

10. The method according to claim 8, wherein the webpage browsing request comprises a webpage address of the requested webpage and a first webpage template ID list, and a second webpage template ID list is stored associatively with the webpage address in a webpage template ID list library of the webpage template server,

webpage template data corresponding to the webpage data acquired from a webpage template data storage unit, and the generating differential data between the webpage data and the webpage template data based on the webpage data and the webpage template data comprises:

acquiring the corresponding second webpage template ID list from the webpage template ID list library according to a webpage address of a webpage requested to be browsed,

merging the first webpage template ID list and the second webpage template ID list into a third webpage template ID list;

sequentially acquiring webpage template IDs in the third webpage template ID list to repeatedly perform the following process, until the differential data is generated;

acquiring webpage template data from the webpage template data storage unit based on the webpage template IDs currently acquired, and

calculating difference data between the webpage data and the webpage template data acquired from the webpage template data storage unit,

when a compression ratio between the calculated difference data and the webpage data is less than a first predetermined threshold, determining the difference data as the differential data, and

when the compression ratio between the calculated difference data and the webpage data is not less than the first predetermined threshold, acquiring a next webpage template ID from the third webpage template ID list as a new webpage template ID currently acquired.

11. The method according to claim 10, wherein the merging the first webpage template ID list and the second webpage template ID list into a third webpage template ID list comprises:

merging webpage template IDs in the first webpage template ID list and the second webpage template ID list according to priorities, to form a third webpage template ID list, wherein an intersection between the first webpage template ID list and the second webpage template ID list has the highest priority, the remaining part in the first webpage template ID list has the next priority, and the remaining part in the second webpage template ID list has the lowest priority.

12. The method according to claim 10, further comprising:

after the differential data is generated, judging, by the webpage template server, whether a webpage template ID currently used belongs to the first webpage template ID list, and

when the webpage template ID currently used belongs to the first webpage template ID list, returning, by the webpage template server, the generated differential data and the webpage template ID currently used to the middleware server which are then forwarded to the terminal device via the middleware server,

when the webpage template ID currently used does not belong to the first webpage template ID list, returning, by the webpage template server, the webpage template ID currently used to the middleware server, and sending, by the middleware server, the webpage template ID and the webpage data received to the terminal device.

13. A webpage template server comprises:

a collection unit configured to collect webpage data of a webpage;

a generation unit configured to generate a webpage template of the webpage according to the webpage data; and

an index unit configured to generate a template index according to the generated webpage template.

14. The webpage template server according to claim 13, wherein the webpage template server further comprises:

a release unit configured to, after the webpage template of the webpage is generated according to the webpage data, release the webpage template and the template index for multiple template servers that provide webpage templates;

a storage unit configured to store the webpage template and the template index respectively in the multiple template servers; and

a template retrieval unit configured to retrieve a webpage template matching with the webpage by using the template index, and providing the template matching with the webpage for other servers.

15. The webpage template server according to claim 14, wherein the release unit comprises:

a calculation module configured to calculate an overall difference rate of a set of the multiple webpage templates and a set of historical templates;

a judgment module configured to judge whether the overall difference rate is greater than a preset overall difference rate threshold; and

a release module configured to, if it is judged that the overall difference rate is greater than the preset overall difference rate threshold, release the webpage template, and if it is judged that the overall difference rate is not greater than the preset overall difference rate threshold, not releasing the webpage template.

16. The webpage template server according to claim 14, wherein the index unit comprises:

a template selection module configured to select a template of which the quality satisfies a predetermined quality condition;

a template path derivation module configured to determine URL paths applicable to templates;

a template path pruning module configured to select, from the URL paths, a URL path applicable to the template of which the quality satisfies the predetermined quality condition; and

a template index generation module configured to convert the selected path to a template index.

17. The webpage template server according to claim 14, wherein the webpage template server further comprises:

a judgment unit configured to, after the webpage template of the webpage is generated according to the webpage data, judge whether the number of the webpage template reaches a preset number;

a calculation unit configured to, if it is judged that the number of the webpage template reaches the preset number, calculate a coverage rate of each webpage template;

a comparison unit configured to compare a webpage template of which the coverage rate is less than a first preset coverage rate threshold with a webpage template of which the coverage rate is greater than the first preset coverage rate threshold; and

a merging unit configured to, if a difference rate between the webpage template of which the coverage rate is less than the first preset coverage rate threshold and the webpage template of which the coverage rate is greater than the first preset coverage rate threshold is less than a preset difference rate threshold, merge the webpage template of which the coverage rate is less than the first preset coverage rate threshold with the webpage template of which the coverage rate is greater than the first preset coverage rate threshold.

18. The webpage template server according to claim 16, wherein the comparison unit comprises:

a sorting module configured to sort the multiple webpage templates according to the sizes of the coverage rates in a descending order; and

a comparison module configured to compare a webpage template sorted in the back with a webpage template sorted in the front.

19. The webpage template server according to claim 14, wherein the index unit comprises:

a storage module configured to, after the webpage template of the webpage is generated according to the webpage data, store multiple webpage templates;

a calculation module configured to calculate a coverage rate of each of the webpage templates;

a third judgment module configured to judge whether the sum of the coverage rates of the webpage templates under each path reaches a second preset coverage rate threshold; and

a deletion module configured to delete webpage templates under a path where the sum of the coverage rates of the webpage templates does not reach the second preset coverage rate threshold.

20. The webpage template server according to claim 13, wherein the server further comprises:

a webpage template data storage unit configured to store the webpage template data;

a webpage template data acquisition unit configured to acquire, from the webpage template data storage unit, webpage template data corresponding to webpage data acquired and forwarded by a middleware server upon receipt of a webpage browsing request from a terminal device;

a differential data generation unit configured to generate differential data between the webpage data and the webpage template data based on the webpage data received from the middleware server and the webpage template data corresponding to the webpage data, and

a sending unit configured to forward the generated differential data to the terminal device via the middleware server, for the terminal device to display a requested webpage according to the differential data and webpage template data corresponding to the differential data locally stored by the terminal device.

21-28. -28. (canceled)