Method and system for automatically generating web page transcoding instructions

• US 8,396,881 B2
• Filed: 05/12/2008
• Issued: 03/12/2013
• Est. Priority Date: 05/17/2007
• Status: Active Grant

• Current Assignee: Blackberry Limited
• Original Assignee: Blackberry Limited
• Inventors: Kim, Sang-Heun, Stinson, Charles Laurence
• Primary Examiner(s): LU, KUEN S
• Application Number:
  US12/119,257
• Publication Number:
  US 20080288475A1
• Time in Patent Office: 1,765 Days
• Field of Search: 707/758, 707/803
• US Class Current: 707/758
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

A system and method are provided for generating transcoding instructions to identify and extract a subset of data from a web page. Input describing the subset of data is received where the input describes one or more data fields and, for each data field, respective field values from at least two sample web pages of a web page family for the web site. For each field, respective web page code defining the respective field values may be compared for commonality to find a matching pattern with which to locate the respective field values. The matching pattern comprises a signature for the data field. Transcoding instructions are defined using the matching pattern to locate and extract field values within web pages of the web page family. The subset of data may be expressed in a target format to transcode the web page for particular client machines (e.g. a wireless mobile device).

Claims

1. A method of automatically generating transcoding instructions to locate and extract a subset of data from a selected web page of a web site, the method comprising:

receiving an input describing the subset of data, said input comprising one or more data fields and, for each data field,

respective field values from at least two sample web pages of a web page family for the web site;

identifying a common pattern among the respective field values for the at least two sample web pages to define a pattern match between the respective data field values,

said matching pattern defining a signature for the data field; and

generating the transcoding instructions in accordance with the identified common pattern, the transcoding instructions comprising location information of field values for extracting the subset of data within a web page of the web page family,

the transcoding instructions for expressing the extracted subset of data in a target format thereby to transcode the web page,

wherein identifying the commonality among the respective field values comprises locating the respective field values in the respective web page code.

2. The method of claim 1 wherein identifying the commonality among the respective field values comprises locating object tags within the web page code.

3. The method of claim 2 further comprising constructing a programmatic data structure representing a hierarchy of object tags within the web page code and reviewing the hierarchy to determine the commonality.

4. The method of claim 1 wherein identifying the commonality among the respective field values comprises performing pattern recognition to define a common pattern within the web page code.

5. The method of claim 1 wherein the web page code comprises markup language in plain text.

6. The method of claim 5 wherein each signature comprises characters selected from the plain text of the web page code.

7. The method of claim 1 further comprising automatically defining the input in accordance with a tagging tool that identifies the respective field values from the sample web pages.

8. The method of claim 1 wherein the web site comprises an e-commerce web site for making a purchase.

9. A system for automatically generating transcoding instructions to locate and extract a subset of data from a selected web page of a web site, the system comprising a processor and memory coupled thereto, said memory storing instructions and data to configure the processor for:

receiving an input describing the subset of data, said input comprising one or more data fields and, for each data field, respective field values from at least two sample web pages of a web page family for the web site;

identifying a common pattern among the respective field values for the at least two sample web pages to define a pattern match between the respective data field values, said matching pattern defining a signature for the data field; and

generating the transcoding instructions in accordance with the identified common pattern, the transcoding instructions comprising location information of field values for extracting the subset of data within a web page of the web page family, the transcoding instructions for expressing the extracted subset of data in a target format thereby to transcode the web page,

wherein identifying the commonality among the respective field values comprises locating the respective field values in the respective web page code.

10. The system of claim 9 wherein identifying the commonality among the respective field values comprises locating object tags within the web page code.

11. The system of claim 10 further comprising constructing a programmatic data structure representing a hierarchy of object tags within the web page code and reviewing the hierarchy to determine the commonality.

12. The system of claim 9 wherein identifying the commonality among the respective field values comprises performing pattern recognition to define a common pattern within the web page code with which to locate the respective field values.

13. The system of claim 9 wherein the web page code comprises markup language in plain text.

14. The system of claim 13 wherein each signature comprises characters selected from the plain text of the web page code.

15. The system of claim 9 further comprising automatically defining the input in accordance with a tagging tool that identifies the respective field values from the sample web pages.

16. The system of claim 9 wherein the web site comprises an e-commerce web site for making a purchase.

17. A computer program product for automatically generating transcoding instructions to locate and extract a subset of data from a selected web page of a web site,

the computer program product storing computer readable instructions which when executed by a computer processor configure the processor to:

receive an input describing the subset of data, said input comprising one or more data fields and, for each data field, respective field values from at least two sample web pages of a web page family for the web site;

identify a common pattern among the respective field values for the at least two sample web pages to define a pattern match between the respective data field values, said matching pattern defining a signature for the data field; and

generate the transcoding instructions in accordance with the identified common pattern, the transcoding instructions comprising location information of field values for extracting the subset of data within a web page of the web page family, the transcoding instructions for expressing the extracted subset of data in a target format thereby to transcode the web page,

wherein identifying the commonality among the respective field values comprises locating the respective field values in the respective web page code.