TRANSLATING LANGUAGE CHARACTERS IN MEDIA CONTENT

• US 20160147743A1
• Filed: 01/29/2016
• Published: 05/26/2016
• Est. Priority Date: 10/19/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Du, Jun, Sun, Lei, Sun, Jian, Huo, Qiang
• Granted Patent: US 10,216,730 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation

Abstract

Some implementations disclosed herein provide techniques and arrangements to enable translating language characters in media content. For example, some implementations receive a user selection of a first portion of media content. Some implementations disclosed herein may, based on the first portion, identify a second portion of the media content. The second portion of the media content may include one or more first characters of a first language. Some implementations disclosed herein may create an image that includes the second portion of the media content and may send the image to a server. Some implementations disclosed herein may receive one or more second characters of a second language corresponding to a translation of the one or more first characters of the first language from the server.

Claims

1. (canceled)

2. A method comprising:

displaying, on a display device, an image that includes one or more words in a first language, wherein at least one word of the one or more words is displayed at a non-horizontal angle relative to an edge of the display device;

receiving, by an input device, a gesture selecting a first portion of the image that includes at least part of the at least one word that is displayed at the non-horizontal angle relative to the edge of the display device;

identifying, using text detection, a second portion of the image based at least in part on the first portion of the image, the second portion of the image including the at least one word;

sending the second portion of the image to a server;

receiving, from the server, one or more translated words in a second language, the one or more translated words corresponding to a translation of the at least one word of the one or more words in the first language; and

displaying, on the display device, the one or more translated words.

3. The method of claim 2, further comprising converting the one or more translated words to an audio output signal via a text to speech synthesizer.

4. The method of claim 2, further comprising displaying search results associated with performing a search based on the one or more translated words in the second language, the search results received from the server.

5. The method of claim 2, further comprising displaying search results associated with performing a search based on the at least one word of the one or more words in the first language, the search results received from the server.

6. The method of claim 2, wherein the second portion of the image comprises a second image that is created based at least in part on down-sampling the second portion of the image.

7. The method of claim 2, further comprising:

displaying a callout window that includes the first portion of the image; and

receiving one or more corrective gestures to adjust at least one of a height or a width of the callout window.

8. The method of claim 2, wherein the gesture comprises one of a tap gesture or a circular gesture.

9. The method of claim 2, wherein the one or more translated words in the second language comprise a word-for-word translation corresponding to the at least one word of the one or more words in the first language.

10. The method of claim 2, wherein the one or more translated words in the second language comprise a phrase-based translation corresponding to the at least one word of the one or more words in the first language.

11. The method of claim 2, wherein the image comprises a frame of a video.

12. A device comprising:

a touchscreen display;

one or more processors; and

computer-readable storage media including instructions executable by the one or more processors to perform operations comprising;

displaying, by the touchscreen display, an image that includes one or more words in a first language, wherein at least one word of the one or more words is displayed at a non-horizontal angle relative to an edge of the touchscreen display;

receiving, by the touchscreen display, a gesture selecting a first portion of the image that includes at least part of the at least one word;

identifying, using text detection, a second portion of the image based at least in part on the first portion of the image, the second portion of the image including the at least one word;

sending the second portion of the image that includes the at least one word to a server;

receiving, from the server, a translation comprising one or more translated words in a second language, the translation corresponding to the at least one word of the one or more words in the first language; and

displaying the translation by the touchscreen display.

13. The device of claim 12, wherein the gesture comprises one of a tap gesture or a circular gesture.

14. The device of claim 12, the operations further comprising:

receiving, from the server, search results associated with performing a search based on at least one of;

the at least one word of the one or more words in the first language;

or

the one or more translated words in the second language; and

displaying the search results.

15. The device of claim 12, wherein the image comprises a frame of a video.

16. The device of claim 12, the operations further comprising:

down-sampling the second portion of the image before sending the second portion of the image to the server.

17. The device of claim 12, the operations further comprising:

displaying a callout window that includes the first portion of the image;

receiving a corrective gesture; and

adjusting at least one of a height or a width of the callout window based at least in part on the corrective gesture.

18. One or more computer-readable storage devices including instructions executable by one or more processors to perform operations comprising:

displaying, on a display device, an image that includes one or more words in a first language, wherein at least one word of the one or more words is displayed at a non-horizontal angle relative to an edge of the display device;

receiving, from an input device, a gesture selecting a first portion of the image that includes at least part of the at least one word of the one or more words;

identifying, using text detection, a second portion of the image that includes the at least one word of the one or more words;

sending the second portion of the image to a server;

receiving, from the server, one or more translated words in a second language corresponding to the at least one word of the one or more words in the first language; and

displaying, on the display device, the one or more translated words in the second language.

19. The one or more computer-readable storage devices of claim 18, the operations further comprising:

receiving, from the server, search results associated with performing a search based on at least one of;

the at least one word of the one or more words in the first language;

or

the one or more translated words in the second language; and

displaying the search results.

20. The one or more computer-readable storage devices of claim 18, the operations further comprising:

displaying, on the display device, a callout window that includes the first portion of the image;

receiving one or more corrective gestures; and

adjusting at least one of a height or a width of the callout window based at least in part on the one or more corrective gestures.

21. The one or more computer-readable storage devices of claim 18, wherein the gesture comprises one of a tap gesture or a circular gesture.