Method and system of retrieving Ajax web page content

• US 8,413,044 B2
• Filed: 03/31/2010
• Issued: 04/02/2013
• Est. Priority Date: 04/02/2009
• Status: Active Grant

• Current Assignee: Advanced New Technologies Company Limited (Ant Group Co., Ltd.)
• Original Assignee: Alibaba Group Holding Ltd.
• Inventors: Mao, Wen
• Primary Examiner(s): Hutton, Jr., Doug
• Assistant Examiner(s): Dasgupta, Soumya
• Application Number:
  US12/863,320
• Publication Number:
  US 20120011431A1
• Time in Patent Office: 1,098 Days
• Field of Search: 715/234, 715/237
• US Class Current: 715/234
• CPC Class Codes: G06F 16/972 Access to data in other repository systems, e.g. legacy data or dynamic Web page generation
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]

Abstract

The present disclosure describes a method and a system of retrieving Ajax web page content. The method of retrieving Ajax web page content includes: obtaining information of web page codes; retrieving JavaScript information in the information of the web page codes; analyzing the JavaScript information to determine function(s) that include(s) Ajax call(s) in the web page codes; and triggering the determined function(s) that include(s) the Ajax call(s) to obtain web page content. Through analyzing JavaScript information in web page codes, the above technical scheme obtains function(s) that include(s) Ajax call(s) in the web page codes and further triggers the function(s) to obtain web page content generated thereby, thus achieving retrieval of dynamic content in an Ajax web page. Using the above technical scheme, a search engine can collect more complete web page contents and hence provide a better search service to users.

Claims

1. A method of retrieving web page content, the method comprising:

obtaining information of web page codes;

retrieving scripting language information based on the information of the web page codes, the scripting language information being included in one or more scripting language files;

determining a type of one scripting file of the one or more scripting language files based on a filename of the one scripting file,

in an event that the one scripting file is a framework file;

obtaining asynchronous scripting language property values, and

determining at least one function that includes a call associated with an asynchronous web application of a web page associated with the web page codes using the asynchronous scripting language property values, and

in an event that the one scripting file is a non-framework file, obtaining the at least one function based on a corresponding asynchronous scripting language property value and codes associated with the function as defined in the non-framework file; and

triggering the at least one function that comprises at least one asynchronous scripting language call to obtain web page content generated.

2. The method as recited in claim 1, wherein the retrieving comprises:

checking for a scripting language tag in the web page codes;

when the scripting language information retrieved from the information of the web page codes and located after the scripting language tag comprises scripting language codes;

retrieving the scripting language codes; and

storing the retrieved scripting language codes in a scripting language file; and

when the scripting language information retrieved from the information of the web page codes and located after the scripting language tag comprises a scripting language file, retrieving a storage path and the filename of the scripting language file.

3. The method as recited in claim 1, wherein the asynchronous scripting language property values comprise at least one of:

property values corresponding to asynchronous scripting language calls using a type of scripting language framework, and property values corresponding to asynchronous scripting language calls without using a type of scripting language framework.

4. The method as recited in claim 1, wherein the at least one function is defined in a non-JavaScript framework document that is referenced in the web page.

5. A system of retrieving asynchronous JavaScript and XML web page content, the system comprising:

a processor;

a web page code acquisition unit that obtains information of web page codes;

a script retrieving unit that retrieves scripting language information from the information of the web page codes;

a script analyzing unit that;

determines a type of a scripting file indicated by the scripting language information based on a filename of one scripting file,

in an event that the scripting file is a framework file;

obtains an asynchronous scripting language property value, and

determines a function that includes a call associated with an asynchronous web application of a web page associated with the web page codes using the asynchronous scripting language property value, and

in an event that the scripting file is a non-framework file, obtains the function based on a corresponding asynchronous scripting language property value and codes associated with the function as defined in the non-framework file; and

a web page content acquisition unit that triggers the function that comprises at least one asynchronous scripting language call to obtain web page content.

6. The system as recited in claim 5, wherein the scripting language information comprises at least one of scripting language files or scripting language codes.

7. The system as recited in claim 6, wherein the script retrieving unit comprises:

a checking sub-unit that checks for a scripting language tag in the web page codes;

a first retrieving sub-unit that retrieves the scripting language codes and stores the retrieved scripting language codes in a scripting language file when the scripting language information retrieved from the information of the web page codes and located after the scripting language tag comprises scripting language codes;

a second retrieving sub-unit that retrieves a storage path and a filename of the scripting language file when the scripting language information retrieved from the information of the web page codes and located after the scripting language tag comprises the scripting language file.

8. The system as recited in claim 7, wherein the script analyzing unit comprises:

a first determining sub-unit that determines the function comprising at least one asynchronous scripting language call and defined in the scripting language file based on asynchronous scripting language property values, the asynchronous scripting language property values indicative of the function containing a code segment for the asynchronous scripting language call; and

a second determining sub-unit that determines an asynchronous scripting language calling function is contained in the web page codes from the function determined by the first determining sub-unit.

9. The system as recited in claim 8, wherein the asynchronous scripting language property values comprise at least one of:

property values corresponding to asynchronous scripting language calls using a type of scripting language framework, or property values corresponding to asynchronous scripting language calls without using a type of scripting language framework.

10. The system as recited in claim 8, wherein the first determining sub-unit further determines at least one function that comprises at least one asynchronous scripting language call and is defined in a non-scripting language framework document that is referenced in a web page.

11. The system as recited in claim 10, wherein the web page content acquisition unit further simulates a user operation to trigger the determined at least one function that comprises the at least one asynchronous scripting language call to obtain the web page content generated by the at least one function that comprises the at least one asynchronous scripting language call.

12. One or more non-transitory storage media comprising computer-executable instructions that, when executed by a computer, configure the computer to perform acts comprising:

retrieving scripting information from a web page, the scripting information indicating one or more scripting files;

determining a type of one scripting file of the one or more scripting files based on a filename of the one scripting file,

in an event that the one scripting file is a framework file;

obtaining one or more asynchronous scripting language property values, and

determining a function that includes a call associated with an asynchronous web application of the web page using the one or more asynchronous scripting language property values, and

in an event that the one scripting file is a non-framework file, obtaining the function based on a corresponding asynchronous scripting language property value and codes associated with the function as defined in the non-framework file; and

calling the function to generate content associated with the web page.

13. The one or more storage media as recited in claim 12, wherein the asynchronous web application is created using an asynchronous scripting language technology.

14. The one or more storage media as recited in claim 13, wherein the one or more scripting files comprise a framework file and a non-framework file that defines functions including asynchronous scripting language calls, and the acts further comprises:

obtaining one or more asynchronous scripting language property values corresponding to the framework based on a filename of the framework file; and

determining the function based on the one or more asynchronous scripting language property values and the non-framework file.

15. The one or more storage media as recited in claim 12, the acts further comprise obtaining the web page that is in a markup language format, wherein the web page includes a location or a filename of the one or more files.

16. The one or more storage media as recited in claim 12, wherein the scripting information comprises scripting language information.