System and method for translating languages using portable display device

• US 20040210444A1
• Filed: 04/17/2003
• Published: 10/21/2004
• Est. Priority Date: 04/17/2003
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hook, Gary Roland, Barillaud, Franck, Arenburg, Robert Thomas, Cobb, Bradford Lee
• Application Number:
  US10/418,547
• Publication Number:
  US 20040210444A1
• Time in Patent Office: Days
• US Class Current: 704/277
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 40/263 Language identification
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 15/005 Language recognition
• CPC Class Codes: G10L 15/18 using natural language modelling

Abstract

A method and system for translating written text from a first (foreign) language to a second (native) language is provided. An image containing the text is first captured at the request of the user. Text zones are identified in the image and the zones are converted to text characters using optical character recognition. The text characters, which are in the first language, are translated to the second language. The translated text is then output to the user. The text may be converted to an image that can be displayed on a display or, alternatively, the text may be synthesized into speech that may be played over a speaker accessible to the user such as an earpiece. Data can be provided to the user as text, audio or text and audio combined.

Claims

1. A computer-implemented method for translating text using a portable translation device, the method comprising:

capturing an image at the portable translation device, wherein the image contains text in a first language;

converting the text in the image to text characters;

translating the text characters to a second language; and

providing the translation to a user through an output device accessible from the portable translation device.

2. The method of claim 1, wherein the converting the text comprises:

identifying one or more zones in the image containing text; and

performing optical character recognition (OCR) on the identified zones to obtain the text characters.

3. The method of claim 2, wherein the identifying one or more zones comprises receiving user input indicating the text zones.

4. The method of claim 2, wherein the identifying one or more zones comprises performing pattern recognition to identify textual areas in the image.

5. The method of claim 1, wherein the translating comprises:

selecting one word from the text characters;

locating a translation of the word in a first language-to-second language foreign language dictionary; and

storing the translation of the word in a memory location.

6. The method of claim 1, further comprising determining one or more zones in the image containing text in the first language.

7. The method of claim 1 further comprising:

identifying the first language before the converting;

comparing the text characters to known language profiles;

matching the text characters to one language profiles; and

identifying the first language as the language whose profile matched.

8. The method of claim 1 wherein the output device is selected from the group consisting of a display screen and a speaker, the method further comprising:

if the output device is the display screen;

converting the text characters to an output image; and

displaying the output image on the display screen; and

if the output device is the speaker;

synthesizing the text characters into speech; and

playing the synthesized speech to a user through the speaker.

9. An information handling system comprising:

one or more processors;

a memory accessible by the processors;

one or more nonvolatile storage devices accessible by the processors;

a video camera that captures an image, wherein the image contains text in a first language;

a converter that converts the text in the image to text characters;

a translator that translates the text characters to a second language; and

an output device that provides the translation to the user.

10. The information handling system of claim 9, wherein the converter further comprises:

one or more zones in the image containing text; and

optical character recognition logic that operates on the identified zones to obtain the text characters.

11. The information handling system of claim 9, wherein the translator further comprises:

a selector that selects one word from the text characters;

a translation lookup table that includes a plurality of foreign language words; and

an output processor that stores the translation of the word in the memory.

12. The information handling system of claim 9 further comprising:

a selection that identifies the first language before the converter converts the text;

a comparator that compares the text characters to known language profiles, wherein the first language is the language whose language profile matched the text characters.

13. The information handling system of claim 9 wherein the output device is selected from the group consisting of a display screen and a speaker, the information handling system further comprising:

if the output device is a display screen;

an image converter that converts the text characters to an output image that is displayed on the display screen; and

if the output device is a speaker;

a synthesizer that synthesizes the text characters into speech that is played through the speaker.

14. A computer program product stored on a computer operable media for translating text, said computer program product comprising:

means for capturing an image at a portable translation device, wherein the image contains text in a first language;

means for converting the text in the image to text characters;

means for translating the text characters to a second language; and

means for providing the translation to a user through an output device accessible from the portable translation device.

15. The computer program product of claim 14, wherein the means for converting the text further comprises:

means for identifying one or more zones in the image containing text; and

means for performing optical character recognition (OCR) on the identified zones to obtain the text characters.

16. The computer program product of claim 15, wherein the means for identifying one or more zones comprises a means for performing pattern recognition to identify textual areas in the image.

17. The computer program product of claim 14, wherein the means for translating further comprises:

means for selecting one word from the text characters;

means for locating a translation of the word in a first language-to-second language foreign language dictionary; and

means for storing the translation of the word in a memory location.

18. The computer program product of claim 14, further comprising:

means for determining one or more zones in the image containing text in the first language.

19. The computer program product of claim 14 further comprising:

means for identifying the first language before the converting;

means for comparing the text characters to known language profiles;

means for matching the text characters to one language profiles; and

means for identifying the first language as the language whose profile matched.

20. The computer program product of claim 14 wherein the output device is selected from the group consisting of a display screen and a speaker, the computer program product further comprising:

if the output device is a display screen;

means for converting the text characters to an output image; and

means for displaying the output image to the display screen; and

if the output device is a speaker;

means for synthesizing the text characters into speech; and

means for playing the synthesized speech to a user through the speaker.