Techniques for translating text via wearable computing device

• US 9,870,357 B2
• Filed: 10/28/2013
• Issued: 01/16/2018
• Est. Priority Date: 10/28/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Cohen, Tomer
• Primary Examiner(s): Shah, Paras D
• Assistant Examiner(s): Kim, Jonathan
• Application Number:
  US14/065,324
• Publication Number:
  US 20150120279A1
• Time in Patent Office: 1,541 Days
• Field of Search: 704 1, 704 2, 704 8- 10, 704270-2701, 704275-277, 704E13011
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation

Abstract

A method of presenting translated content items is disclosed. It is detected that a content item has been captured by a device of a user. It is identified that the content item is a candidate content item for translation. The candidate content item is translated; and the translated candidate content item is presented via a user interface of a wearable display of the device.

Claims

1. A method comprising:

detecting that a content item has been captured by a device of a user;

identifying that the content item is a candidate content item for translation based on an analysis of a profile of the user maintained by the user with respect to a social-networking system, wherein analysis of the profile of the user includes a determination that the user is not proficient in a language of the content item based on information discovered about other users to which the user is connected;

translating the candidate content item; and

presenting the translated candidate content item via a user interface of a wearable display of the device, the presenting of the translated content item including presenting a visual cue on the user interface that allows the user to identify a direction of a content source from which the content item was derived relative to an orientation of the device, the presenting of the visual cue based on a determination that the content item is at least partially outside the focus of the device, the presenting of the translated content item being performed by a processor.

2. The method of claim 1, wherein the identifying that the content item is the candidate content item is based on a determination that the user has specified in a profile of the user that content items in a language of the content item are to be translated to a default language.

3. The method of claim 1, further comprising selecting the content item based on an orientation of the device relative to the content source.

4. The method of claim 1, wherein the content item is received from an audio source and wherein the presenting of the translated candidate content item includes presenting a textual translation of the content item via the user interface.

5. The method of claim 1, wherein the candidate content item is a technical term, the analysis of the profile of the user includes a determination that the user does not have technical expertise with respect to the technical term, and the translating of the candidate content item includes defining the technical term.

6. The method of claim 5, wherein the determination that the user does not have technical expertise with respect to the technical term is based on an employment history of the user.

7. The method of claim 1, the presenting of the translated content item further including presenting an additional visual cue on the user interface that allows the user to identify a type of the content source from which the content item was received.

8. The method of claim 1, wherein the presenting of the visual cue is based on a determination that the content source is not in a field of vision of the device.

9. The method of claim 1, wherein the presenting of the visual cue is further based on a type of the source of the content item being a non-visual type.

10. A system comprising:

one or more processors and a computer-readable medium having instructions stored thereon, which, when executed by the one or more processors, cause the system to, at least;

detect that a content item has been captured by a device of a user based on an analysis of a profile of the user maintained by the user with respect to a social-networking system, wherein the analysis of the profile of the user that the user includes a determination that the user is not proficient in a language of the content item based on information discovered about other users to which the user is connected;

identify that the content item is a candidate content item for translation;

translate the candidate content item; and

present the translated candidate content item via a user interface of a wearable display of the device, the presenting of the translated content item including presenting a visual cue on the user interface that allows the user to identify a direction of a content source from which the content item was derived relative to an orientation of the device, the presenting of the visual cue based on a determination that the content item is at least partially outside the focus of the device.

11. The system of claim 10, wherein the identifying that the content item is the candidate content item is based on a determination that the user has specified in a profile of the user that content items in a language of the content item are to be translated to a default language.

12. The system of claim 10, wherein the at least one module is further configured to select the content item based on an orientation of the device relative to the content source.

13. The system of claim 10, wherein the content item is received from an audio source and wherein the presenting of the translated candidate content item includes presenting a textual translation of the content item via the user interface.

14. A non-transitory machine readable medium embodying a set of instructions that, when executed by a processor, cause the processor to perform operations, the operations comprising:

detecting that a content item has been captured by a device of a user;

identifying that the content item is a candidate content item for translation based on an analysis of a profile of the user maintained by the user with respect to a social-networking system, wherein the analysis of the profile of the user that the user includes a determination that the user is not proficient in a language of the content item based on information discovered about other users to which the user is connected;

translating the candidate content item; and

presenting the translated candidate content item via a user interface of a wearable display of the device, the presenting of the translated content item including presenting a visual cue on the user interface that allows the user to identify a direction of a content source from which the content item was derived relative to an orientation of the device, the presenting of the visual cue based on a determination that the content item is at least partially outside the focus of the device.

15. The non-transitory machine readable medium of claim 14, wherein the identifying that the content item is the candidate content item is based on a determination that the user has specified in a profile of the user that content items in a language of the content item are to be translated to a default language.

16. The non-transitory machine readable medium of claim 14, the operations further comprising selecting the content item based on an orientation of the device relative to the content source.

17. The non-transitory machine readable medium of claim 14, wherein the content item is derived from a content stream being played by the content source and the translating and presenting is performed substantially in real-time in conjunction with the playing of the content source.