Analyzing web site for translation

• US 9,626,360 B2
• Filed: 07/02/2013
• Issued: 04/18/2017
• Est. Priority Date: 02/21/2003
• Status: Active Grant

• Current Assignee: MotionPoint Corporation
• Original Assignee: MotionPoint Corporation
• Inventors: Travieso, Enrique, Rubenstein, Adam, Fleming, William
• Primary Examiner(s): Hong, Stephen
• Assistant Examiner(s): Vaughn, Gregory J
• Application Number:
  US13/933,815
• Publication Number:
  US 20140058719A1
• Time in Patent Office: 1,386 Days
• Field of Search: 715200, 715205, 715234, 715264, 715269
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06F 40/44 Statistical methods, e.g. probability models
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A system, method and computer readable medium for synchronizing web content is disclosed. The method includes retrieving a first web content in a first language from a web site, the first web content corresponding to a second web content wherein the second web content is a translation in a second language of the first web content. The method further includes dividing the first web content into a plurality of translatable components and generating a unique identifier for each of the plurality of translatable components. The method further includes matching each of the plurality of translatable components to a plurality of translated components of the second web content using the unique identifier of each of the plurality of translatable components. If a translatable component is not matched to a translated component, the method further includes designating the translatable component for translation into the second language.

Claims

1. A machine implemented method for providing statistics characterizing translation work in synchronizing content in different languages, comprising the steps of:

activating a spider agent to crawl a website for content in a first language via a publicly accessible network path for synchronizing a translated version of the content in the first language previously generated in a second language;

parsing the crawled content in the first language into a plurality of translatable components;

accessing a database that stores translated components previously generated in the second language;

identifying at least some of the plurality of translatable components in the first language that do not have a corresponding translated component in the second language in the database;

generating statistics based on the identified translatable components to estimate the work load involved in language translation of the identified translatable components from the first language to the second language; and

providing information including the generated statistics to characterize a service related to synchronizing the content in the first and second languages.

2. The method according to claim 1, wherein the language translation includes human translating the identified translatable components.

3. The method according to claim 1, further comprising the step of adding the identified translatable components to a translation list for translation into a second language.

4. The method according to claim 1, further comprising the step of generating an identifier for each of the plurality of translatable components such that each of the plurality of translatable components is accessible via a corresponding identifier.

5. The method according to claim 4, wherein the identifier for a text segment is generated using at least one of a hash code, a checksum, and a mathematical algorithm based on one or more text segments.

6. The method according to claim 1, wherein the statistics includes at least one of a file count, a page count, a text segment count, a unique text segment count, a word count, and a unique word count.

7. The method of claim 1, wherein the step of generating comprises:

computing the statistics based on information associated with any of the identified translatable components that does not have a corresponding translated component in the second language.

8. A machine readable non-transitory medium having information stored thereon for providing statistics characterizing translation work in synchronizing content in different languages, wherein the information, when read, causes the machine to perform the following:

activating a spider agent to crawl a website for content in a first language via a publicly accessible network path for synchronizing a translated version of the content in the first language previously generated in a second language;

parsing the crawled content in the first language into a plurality of translatable components;

accessing a database that stores translated components previously generated in the second language;

identifying at least some of the plurality of translatable components in the first language that do not have a corresponding translated component in the second language in the database;

generating statistics based on the identified translatable components to estimate the work load involved in language translation of the identified translatable components from the first language to the second language; and

providing information including the statistics to characterize a service related to synchronizing the content in the first and second languages.

9. The medium according to claim 8, wherein the language translation includes human translating the identified translatable components.

10. The medium according to claim 8, wherein the information, when read, further causes the machine to perform the following:

adding the identified translatable components to a translation list for translation into a second language.

11. The medium according to claim 8, wherein the information, when read, further causes the machine to perform the following:

generating an identifier for each of the plurality of translatable components such that each of the plurality of translatable components is accessible via a corresponding identifier.

12. The medium according to claim 11, wherein the identifier for a text segment is generated using at least one of a hash code, a checksum, and a mathematical algorithm based on one or more text segments.

13. The medium according to claim 8, wherein the statistics includes at least one of a file count, a page count, a text segment count, a unique text segment count, a word count, and a unique word count.

14. The medium according to claim 8, wherein the step of generating comprises:

computing the statistics based on information associated with any of the identified translatable components that does not have a corresponding translated component in the second language.