Device orientation based translation system

• US 9,292,498 B2
• Filed: 03/21/2012
• Issued: 03/22/2016
• Est. Priority Date: 03/21/2012
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: Escobedo, Miguel Angel
• Primary Examiner(s): BAKER, MATTHEW H
• Application Number:
  US13/426,394
• Publication Number:
  US 20130253900A1
• Time in Patent Office: 1,462 Days
• Field of Search: 704 1- 10
• US Class Current: 1/1
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

A method for translating content includes providing a plurality of content on a user device. The plurality of content is associated with a first region display mode. The plurality of content is displayed on the user device in the first region display mode. A predefined orientation is then detected in the user device. The plurality of content is then translated according to a second region display mode to produce a plurality of translated content. The plurality of translated content is then displayed on the user device. In different embodiments, the plurality of content may have been previously provided on the user device, may be retrieved over a network by the user device, or my be received through a user interface on the user device. A specific embodiment allows a user to rotate the user device 180 degrees to quickly and easily translate text displayed on the user device.

Claims

1. A method for translating content, comprising:

receiving, from a camera on a user device, an image that includes a plurality of text and at least one graphic;

providing for display, on a display of the user device when the user device is in a first orientation that provides the display in a first aspect ratio, the image as a first content screen that is provided in the first aspect ratio and that includes the plurality of text and the at least one graphic;

determining, by the user device using character recognition techniques, that the plurality of text included in the image is associated with a first region display mode;

detecting, using an orientation detection device in the user device, reorientation of the user device from the first orientation to a predefined orientation of the user device that is rotated relative to the first orientation and that provides the display in a second aspect ratio that is different than the first aspect ratio and, in response, translating the plurality of text according to a second region display mode to produce a plurality of translated text; and

providing for display, on the display of the user device, the plurality of translated text and the at least one graphic in a second content screen that is provided in the second aspect ratio, wherein a structure of the first content screen that was provided in the first aspect ratio is maintained in the second content screen that is provided in the second aspect ratio such that the plurality of translated text and the at least one graphic on the second content screen that is provided in the second aspect ratio have substantially the same sizes and relative locations as the plurality of text and the at least one graphic on the first content screen that was provided in the first aspect ratio.

2. The method of claim 1, wherein the first region display mode displays at least some of the plurality of text in a first language, and wherein the second region display mode displays at least some of the plurality of text in a second language to display the plurality of translated text.

3. The method of claim 1, wherein the first region display mode displays at least some of the plurality of text in a first currency, and wherein the second region display mode displays at least some of the plurality of text in a second currency to display the plurality of translated text.

4. The method of claim 1, further comprising:

determining, using a location determination device in the user device, a current location of the user device and, in response, using the current location to select the second region display mode for translating the plurality of text.

5. The method of claim 1, wherein the image is captured from a physical advertisement.

6. The method of claim 1, wherein the plurality of translated text on the second content screen that is provided in the second aspect ratio replaces the plurality of text on the first content screen that was provided in the first aspect ratio.

7. The method of claim 1, further comprising:

determining, by the user device using character recognition techniques, that the image includes the at least one graphic.

8. A non-transitory machine readable medium comprising a plurality of machine-readable instruction which, when executed by one or more processors, are configured to cause the one or more processors to perform a method comprising:

receiving an image that includes a plurality of text and at least one graphic;

providing the image as a first content screen that includes the plurality of text and the at least one graphic for display on a display of a user device when the user device is in a first orientation that provides a first aspect ratio;

determining that the plurality of a text included in the image is associated with a first region display mode using character recognition techniques;

detecting reorientation of the user device from the first orientation to a predefined orientation of the user device that is rotated relative to the first orientation and that provides a second aspect ratio that is different than the first aspect ratio and, in response, translating the plurality of text according to a second region display mode to produce a plurality of translated text; and

providing the plurality of translated text and the at least one graphic in a second content screen for display on the display of the user device, wherein a structure of the first content screen in the first aspect ratio is maintained in the second content screen in the second aspect ratio that the plurality of translated text and the at least one graphic on the second content screen in the second aspect ratio have substantially the same sizes and relative locations as the plurality of text and the at least one graphic on the first content screen in the first aspect ratio.

9. The non-transitory machine-readable medium of claim 8, wherein the first region display mode displays at least some of the plurality of text in a first language, and wherein the second region display mode displays at least some of the plurality of text in a second language to display the plurality of translated text.

10. The non-transitory machine-readable medium of claim 8, wherein the first region display mode displays at least some of the plurality of text in a first currency, and wherein the second region display mode displays at least some of the plurality of text in a second currency to display the plurality of translated text.

11. The non-transitory machine-readable medium of claim 8, wherein the non-transitory machine readable medium further comprises a plurality of machine-readable instruction which, when executed by the one or more processors, are configured to cause the one or more processors to perform the method further comprising:

determining a current location of the user device and, in response, using the current location to select the second region display mode for translating the plurality of text.

12. The non-transitory machine-readable medium of claim 8, wherein the image is captured from a physical advertisement.

13. The non-transitory machine-readable medium of claim 8, wherein the plurality of translated text on the second content screen in the second aspect ratio replaces the plurality of text on the first content screen in the first aspect ratio.

14. The non-transitory machine-readable medium of claim 8, wherein the non-transitory machine readable medium further comprises a plurality of machine-readable instruction which, when executed by the one or more processors, are configured to cause the one or more processors to perform the method further comprising:

determining that the image includes the at least one graphic.

15. A translation system, comprising:

a non-transitory memory storing a predefined orientation; and

at least one processor that is coupled to the non-transitory memory and configured to read instructions from the non-transitory memory to cause a system to;

receive an image that includes a plurality of text and at least one graphic;

provide the image as a first content screen in a first aspect ratio that includes the plurality of text and at least one graphic for display on a display device, wherein the plurality of text included in the image is associated with a first region display mode;

detect movement from an initial orientation that provides the first aspect ratio to a predefined orientation that provides a second aspect ratio that is different than the first aspect ratio and, in response, translate the plurality of text according to a second region display mode to produce a plurality of translated text; and

provide the plurality of translated text and the at least one graphic as a second content screen in the second aspect ratio for display on the display device, wherein a structure of the first content screen in the first aspect ratio is maintained in the second content screen in the second aspect ratio such that the plurality of translated text and the at least one graphic on the second content screen in the second aspect ratio have substantially the same sizes and relative locations as the plurality of text and the at least one graphic on the first content screen in the first aspect ratio.

16. The system of claim 15, wherein the first region display mode displays at least some of the plurality of text in a first language, and wherein the second region display mode displays at least some of the plurality of text in a second language to display the plurality of translated text.

17. The system of claim 15, wherein the first region display mode displays at least some of the plurality of text in a first currency, and wherein the second region display mode displays at least some of the plurality of text in a second currency to display the plurality of translated text.

18. The system of claim 15, wherein the at least one processor is configured to read instructions from the non-transitory memory to cause the system to:

determine a current location and, in response, use the current location to select the second region display mode for translating the plurality of text.

19. The system of claim 15, wherein the image is captured from a physical advertisement.

20. The system of claim 19, wherein the plurality of translated text on the second content screen in the second aspect ratio replaces the plurality of the text on the first content screen in the first aspect ratio.