Translating language characters in media content

• US 10,216,730 B2
• Filed: 01/29/2016
• Issued: 02/26/2019
• Est. Priority Date: 10/19/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Du, Jun, Sun, Lei, Sun, Jian, Huo, Qiang
• Primary Examiner(s): He, Jialong
• Application Number:
  US15/010,238
• Publication Number:
  US 20160147743A1
• Time in Patent Office: 1,124 Days
• CPC Class Codes: G06F 16/5846 using extracted text
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation

Abstract

Some implementations disclosed herein provide techniques and arrangements to enable translating language characters in media content. For example, some implementations receive a user selection of a first portion of media content. Some implementations disclosed herein may, based on the first portion, identify a second portion of the media content. The second portion of the media content may include one or more first characters of a first language. Some implementations disclosed herein may create an image that includes the second portion of the media content and may send the image to a server. Some implementations disclosed herein may receive one or more second characters of a second language corresponding to a translation of the one or more first characters of the first language from the server.

Claims

1. A method comprising:

displaying, on a display device, an image that includes one or more words in a first language, wherein at least one word of the one or more words is displayed at a non-horizontal angle with respect to an edge of the display device;

receiving, by an input device, a gesture selecting a first portion of the image that includes a part of at least one word of the one or more words, the gesture comprising a swipe gesture performed at approximately the non-horizontal angle;

determining one or more boundaries of a second portion of the image based at least in part on the first portion of the image, the second portion of the image including the first portion;

sending the second portion of the image to a server;

receiving, from the server, one or more translated words in a second language, the one or more translated words corresponding to a translation of the one or more words in the first language; and

displaying, on the display device, the one or more translated words.

2. The method of claim 1, further comprising converting the one or more translated words to an audio output signal via a text to speech synthesizer.

3. The method of claim 1, further comprising displaying search results associated with performing a search based on the one or more translated words in the second language, the search results received from the server.

4. The method of claim 1, further comprising displaying search results associated with performing a search based on the at least one word of the one or more words in the first language, the search results received from the server.

5. The method of claim 1, wherein the second portion of the image comprises a second image that is created based at least in part on down-sampling the second portion of the image.

6. The method of claim 1, further comprising receiving one or more corrective gestures to adjust at least one of a height or a width of the callout window.

7. The method of claim 1, wherein determining the one or more boundaries of the second portion of the image is based at least in part on a ratio of a minimum gap between words or characters of the first language to height of characters of the first language.

8. The method of claim 1, wherein the one or more translated words in the second language comprise a word-for-word translation corresponding to the at least one word of the one or more words.

9. The method of claim 1, wherein the one or more translated words in the second language comprise a phrase-based translation corresponding to the at least one word of the one or more words.

10. The method of claim 1, wherein the image comprises a frame of a video.

11. A device comprising:

a touchscreen display;

one or more processors; and

computer-readable storage media including instructions executable by the one or more processors to perform operations comprising;

displaying, by the touchscreen display, an image that includes one or more words in a first language, wherein at least one word of the one or more words is displayed at a non-horizontal angle with respect to an edge of the display device;

receiving, by the touchscreen display, a gesture selecting a first portion of the image that includes a part of at least one word of the one or more words, the gesture comprising a swipe gesture performed at approximately the non-horizontal angle;

determining boundaries of a second portion of the image based at least in part on the first portion of the image and at least one characteristic of characters of the first language, the second portion of the image including the first portion;

sending the second portion of the image to a server;

receiving, from the server, a translation comprising one or more translated words in a second language, the translation corresponding to the one or more words in the first language; and

displaying the translation by the touchscreen display.

12. The device of claim 11, wherein the first portion of the image is further determined based at least partly on a single circular gesture.

13. The device of claim 11, the operations further comprising:

receiving, from the server, search results associated with performing a search based on at least one of;

the at least one word of the one or more words in the first language;

or

the one or more translated words in the second language; and

displaying the search results.

14. The device of claim 11, wherein the image comprises a frame of a video.

15. The device of claim 11, the operations further comprising down-sampling the second portion of the image before sending the second portion of the image to the server.

16. The device of claim 11, the operations further comprising:

in response the selection of the first portion of the image, displaying a callout window that displays the first portion substantially parallel with the edge of the display device;

receiving a corrective gesture; and

adjusting at least one of a height or a width of the callout window based at least in part on the corrective gesture.

20. The device of claim 11, wherein the at least one characteristic of characters of the first language includes a height or a spacing of the characters of the first language.

17. One or more computer-readable storage devices including instructions executable by one or more processors to perform operations comprising:

displaying, on a display device, an image that includes a phrase comprising two or more words in a first language, wherein the phrase is displayed at a non-horizontal angle with respect to an edge of the display device;

receiving, from an input device, a swipe gesture selecting a first portion of the image that includes a part of the phrase, wherein the swipe gesture is performed at approximately the non-horizontal angle;

identifying, using text detection, a second portion of the image that includes the entire phrase and at least one of a starting point or an ending point of the entire phrase;

sending the second portion of the image to a server;

receiving, from the server, one or more translated words in a second language corresponding to the phrase in the first language; and

displaying, on the display device, the one or more translated words in the second language.

18. The one or more computer-readable storage devices of claim 17, the operations further comprising:

receiving, from the server, search results associated with performing a search based on at least one of;

at least one word of the phrase in the first language;

or

the one or more translated words in the second language; and

displaying the search results.

19. The one or more computer-readable storage devices of claim 17, the operations further comprising:

displaying, on the display device, a callout window that includes the first portion of the image;

receiving one or more corrective gestures; and

adjusting at least one of a height or a width of the callout window based at least in part on the one or more corrective gestures.