Synchronization of web site content between languages

• US 8,065,294 B2
• Filed: 07/23/2009
• Issued: 11/22/2011
• Est. Priority Date: 02/21/2003
• Status: Active Grant

• Current Assignee: MotionPoint Corporation
• Original Assignee: MotionPoint Corporation
• Inventors: Travieso, Enrique, Rubenstein, Adam
• Primary Examiner(s): AL HASHEMI, SANA A
• Application Number:
  US12/508,198
• Publication Number:
  US 20100030550A1
• Time in Patent Office: 852 Days
• Field of Search: 707/610, 707/612, 707/767, 707/802, 707/805, 707/716
• US Class Current: 707/716
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06F 40/44 Statistical methods, e.g. probability models
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A system, method and computer readable medium for synchronizing web content is disclosed. The method includes retrieving a first web content in a first language from a web site, the first web content corresponding to a second web content wherein the second web content is a translation in a second language of the first web content. The method further includes dividing the first web content into a plurality of translatable components and generating a unique identifier for each of the plurality of translatable components. The method further includes matching each of the plurality of translatable components to a plurality of translated components of the second web content using the unique identifier of each of the plurality of translatable components. If a translatable component is not matched to a translated component, the method further includes designating the translatable component for translation into the second language.

Claims

1. A machine implemented method for synchronizing content in different languages, comprising the steps of:

accessing from a web server, via a publicly available network path, current content in a first language, including content retrieved by crawling a web site hosted on the web server via following links to additional pages;

dividing the content in the first language into one or more portions;

determining whether the one or more portions have corresponding translated portions in a second language generated previously by translating previously accessed content in the first language;

determining whether any of the one or more portions of the current content in the first language does not have a corresponding translated portion in the second language;

translating at least a part of the one or more portions of the current content in the first language, that does not have a corresponding translated portion in the second language, from the first language to the second language to generate additional translated portion; and

generating updated translated content in the second language corresponding to the current content in the first language based on the translated portions in the second language generated previously and the additional translated portion, wherein the updated translated content in the second language is synchronized with the current content in the first language.

5. The method according to claim 1, wherein the step of translating comprises:

dividing the at least a part of the portion of the current content in the first language into at least one translatable component; and

generating an identifier for each translatable component.

6. The method according to claim 1, wherein the translation from the first language to the second language is by at least one of human translation and machine translation.

7. The method according to claim 1, wherein the step of determining is performed with respect to previously translated components in the second language that are stored in association with their corresponding identifiers.

8. The method according to claim 1, wherein:

the first language includes one of English, French, Spanish, German, Portuguese, Italian, Chinese, Korean, and Arabic;

the second language includes one of English, French, Spanish, German, Portuguese, Italian, Japanese, Chinese, Korean, and Arabic; and

the second language is different from the first language.

9. The method according to claim 1, wherein the step of translating comprises a step of adding a Universal Resource Locator (URL) associated with the at least a part of the portion of the current content to a translation list for translation.

10. The method according to claim 1, wherein the step of translating comprises a step of adding the at least a part of the portion of the current content to a translation list for translation.

11. The method according to claim 1, wherein the accessing current content comprises a step of replicating a session via tracking information.

12. The method of claim 1, wherein the steps of determining, translating, and generating are performed independent of the web server.

26. The method according to claim 5, further comprising adding the at least one translatable component and associated identifier to a translation list for translation into the second language.

27. The method according to claim 5, wherein each translatable component is at least one of:

a text segment;

an image file;

an audio clip;

a video clip; and

a file.

28. The method according to claim 5, wherein the dividing is based upon markup tags contained in the content in the first language.

29. The method according to claim 11, wherein the session includes a session state.

30. The method according to claim 11, wherein the tracking information is at least one of a cookie and updated session parameters.

38. The method according to claim 27, wherein an identifier for a text segment is generated using at least one of a hash code, a checksum, and a mathematical algorithm based on one or more text segments.

39. The method according to claim 27, further comprising:

computing at least one of a hash code and a checksum for a file that is one of the current content containing markup tags and a file linked from the current content containing markup tags; and

determining that the at least one of the hash code and the checksum does not equal a previously computed at least one hash code and checksum that was computed for a previously processed file;

wherein the steps of dividing, determining whether any portion of the current content does not have a corresponding translated component, and translating are performed in response to the determining that the at least one of the hash code and the checksum does not equal a previously computed at least one hash code and checksum that was computed for a previously processed file.

2. A machine readable medium having data stored thereon, the data, when read, causing the following:

accessing from a web server, via a publicly available network path, current content in a first language, including content retrieved by crawling a web site hosted on the web server via following links to additional pages;

dividing the content in the first language into one or more portions;

determining whether the one or more portions have corresponding translated portions in a second language generated previously by translating previously accessed content in the first language;

determining whether any of the one or more portions of the current content in the first language does not have a corresponding translated portion in the second language;

translating at least a part of the one or more portions of the current content in the first language, that does not have a corresponding translated portion in the second language, from the first language to the second language to generate additional translated portion; and

generating updated translated content in the second language corresponding to the current content in the first language based on the translated portions generated previously and the additional translated portion, wherein the updated translated content in the second language is synchronized with the current content in the first language.

13. The medium according to claim 2, the data, when read, further causing:

dividing the at least a part of the portion of the current content in the first language into at least one translatable component; and

generating an identifier for each translatable component.

14. The medium according to claim 2, wherein the step of translating from the first language to the second language is by at least one of human translation and machine translation.

15. The medium according to claim 2, wherein the step of determining whether the current content in the first language has corresponding translated content in a second language is performed with respect to previously translated components in the second language that are stored in association with their corresponding identifiers.

16. The medium according to claim 2, wherein:

the first language includes one of English French, Spanish, German, Portuguese, Italian, Chinese, Korean, and Arabic;

the second language includes one of English, French, Spanish, German, Portuguese, Italian, Japanese, Chinese, Korean, and Arabic; and

the second language is different from the first language.

17. The medium according to claim 2, wherein the step of translating comprises a step of adding a Universal Resource Locator (URL) associated with the at least a part of the portion of the current content to a translation list for translation.

18. The medium according to claim 2, wherein the step of translating comprises a step of adding the at least a part of the portion of the current content to a translation list for translation.

19. The medium according to claim 2, wherein the step of accessing current content comprises a step of replicating a session via tracking information.

20. The medium according to claim 2, wherein the step of accessing current content comprises a step of replicating a session state via at least one cookie and updated session parameters.

21. The medium of claim 2, wherein the steps of determining, translating, and generating are performed independent of the web server.

31. The medium according to claim 13, wherein each of the translatable components is at least one of:

a text segment;

an image file;

an audio clip;

a video clip; and

a file.

32. The medium according to claim 13, the data, when read, further causing generating an identifier for each translatable component.

33. The medium according to claim 13, wherein the dividing is based upon markup tags contained in the current content in the first language.

34. The medium according to claim 19, wherein the session includes a session state.

35. The medium according to claim 19, wherein the tracking information is at least one of a cookie and updated session parameters.

40. The medium according to claim 31, further comprising:

computing at least one of a hash code and a checksum for a file that is one of the current content containing markup tags and a file linked from the current content containing markup tags; and

determining that the at least one of the hash code and the checksum does not equal a previously computed at least one hash code and checksum that was computed for a previously processed file;

wherein the dividing, determining whether any portion of the current content in the first language does not have corresponding translated content in the second language, and translating are performed in response to the determining that the at least one of the hash code and the checksum does not equal a previously computed at least one hash code and checksum that was computed for a previously processed file.

41. The medium according to claim 32. wherein an identifier for a text segment is generated using at least one of a hash code, a checksum, and a mathematical algorithm based on one or more text segments.

42. The medium according to claim 32, the data, when read, further causing adding the at least one translatable component and associated identifier to a translation list for translation into the second language.

3. A system for synchronizing content, comprising:

a connection configured to enable access from a web server, via a publicly available network path, current content in a first language, including content retrieved by crawling a web site hosted on the web server via following links to additional pages;

an information processing portion configured for;

(a) dividing the content in the first language into one or more portions;

(b) determining whether the one or more portions have corresponding translated portions in a second language generated previously by translating previously accessed content in the first language;

(c) determining whether any of the one or more portions of the current content in the first language does not have corresponding translated portion in the second language;

(d) translating at least a part of the one or more portions of the current content in the first language, that does not have a corresponding translated portion in the second language, from the first language to the second language to generate additional translated portion; and

(e) generating updated translated content in the second language corresponding to the current content in the first language based on the translated portions generated previously and the additional translated portion, wherein the updated translated content in the second language is synchronized with the current content in the first language.

22. The system according to claim 3, wherein the information processing portion is further configured for:

dividing the at least a part of the portion of the current content in the first language into at least one translatable component; and

generating an identifier for each translatable component.

23. The system according to claim 3, wherein the translation from the first language to the second language is by at least one of human translation and machine translation.

24. The system of claim 3, wherein the information processing portion is independent of the web server.

36. The system according to claim 22, wherein each of the translatable components is at least one of:

a text segment;

an image file;

an audio clip;

a video clip; and

a file.

37. The system according to claim 22, wherein the information processing portion is further configured for generating an identifier for each of the translatable components, wherein the determining step is performed based on an identifier for each translatable component.

43. The system according to claim 37, wherein the information processing portion is further configured for adding the at least one translatable component and associated identifier to a translation list for translation into the second language.

4. A system for synchronizing content in different languages, comprising:

a content retrieval mechanism configured for obtaining current content in a first language from an Internet source via a publicly accessible network path;

a content analysis mechanism configured for

dividing the content in the first language into one or more portions,

determining whether the one or more portions have corresponding translated portions in a second language generated previously by translating previously accessed content in the first language, and

determining whether any of the one or more portions of the current content in the first language does not have corresponding translated portion in the second language;

a computer aided translation mechanism configured for facilitating translation of at least a part of the one or more portions of the current content in the first language that does not have corresponding translated portion in the second language, from the first language to the second language to generate additional translated portion; and

a content generation mechanism configured for producing updated translated content in the second language corresponding to the current content in the first language based on the translated portions generated previously and the additional translated portion, wherein the updated translated content in the second language is synchronized with the current content in the first language.

25. The system of claim 4, wherein the content retrieval mechanism, the content analysis mechanism, the computer aided translation mechanism, and the content generation mechanism are independent of the web server.