MOBILE DEVICE HAVING HUMAN LANGUAGE TRANSLATION CAPABILITY WITH POSITIONAL FEEDBACK

• US 20170060853A1
• Filed: 11/14/2016
• Published: 03/02/2017
• Est. Priority Date: 07/31/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: GREGG, Justin, LEE, Michael M., SEGUIN, Chad G.
• Granted Patent: US 10,108,612 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation

Abstract

A mobile electronic device has a touch sensitive screen and an accelerometer. A translator is to translate a word or phrase that is in a first human language and that is entered via a first virtual keyboard displayed on the touch sensitive screen, into a second human language. A translator is to cause the touch sensitive screen to display the translated word or phrase and a second virtual keyboard having characters in the second human language, in response to the accelerometer detecting a change in the physical orientation of the device or movement of the device. Other embodiments are also described and claimed.

Claims

1-18. -18. (canceled)

19. An electronic device comprising:

a touch sensitive screen;

a detection component configured to detect a change in physical orientation of the electronic device; and

a translator application configured to;

in response to the detection component detecting a change in the physical orientation of the electronic device from a first orientation to a second orientation;

cause translation of a first text of a first language, entered via a first virtual keyboard on the touch sensitive screen, to a first translated text of a second language, the first virtual keyboard comprising characters of the first language; and

cause display, on the touch sensitive screen, of the first translated text and a second virtual keyboard, the second virtual keyboard comprising characters of the second language; and

in response to the detection component detecting a change in the physical orientation of the electronic device from the second orientation back to the first orientation;

cause translation of a second text of the second language, entered via the second virtual keyboard on the touch sensitive screen, to a second translated text of the first language, and

cause display, on the touch sensitive screen, of the second translated text and the first virtual keyboard.

20. The device of claim 19, wherein the second virtual keyboard replaces the first virtual keyboard.

21. The device of claim 19, wherein the touch sensitive screen is rectangular.

22. The device of claim 19, wherein:

detecting a change in the physical orientation of the electronic device from the first orientation to the second orientation comprises detecting a rotation of the electronic device from the first orientation to the second orientation, wherein

the first translated text and the second virtual keyboard are displayed right side up in a landscape view while the electronic device is in the second orientation, and

detecting a change in the physical orientation of the electronic from the second orientation back to the first orientation comprises detecting a rotation of the electronic device from the second orientation to the first orientation, wherein

the second translated text and the first virtual keyboard are displayed right side up in portrait view while the electronic device is in the first orientation, and

the first orientation is a vertical orientation and the second orientation is a horizontal orientation.

23. The device of claim 22, wherein the rotation of the electronic device from the first orientation to the second orientation comprises a rotation by about ninety degrees in the plane of the touch sensitive screen to obtain the second orientation.

24. The device of claim 22, wherein the rotation of the electronic device from the first orientation to the second orientation comprises a rotation by about one hundred and eighty degrees in the plane of the touch sensitive screen to obtain the second orientation.

25. The device of claim 19, further comprising a location detector configured to determine a geographic location of the electronic device,

wherein in response to the location detector determining the geographic location, the translator application is configured to cause display of a graphic that prompts a user of the electronic device to select any one of a plurality of languages to which the first text can be translated, wherein the plurality of languages are based on the determined geographic location of the electronic device.

26. The device of claim 25, wherein the translator application is configured to cause display of the graphic in response to detecting the change in the physical orientation of the electronic device from the first orientation to the second orientation.

27. The device of claim 19, wherein the electronic device is configured to prevent access to other applications until user authentication is received.

28. The device of claim 19, wherein the first orientation of the device is associated with the first language and the second orientation of the device is associated with the second language.

29. A method for translating text on an electronic device, comprising:

at the electronic device having a touch sensitive screen;

receiving a first text of a first language entered via a first virtual keyboard on the touch sensitive screen, the first virtual keyboard comprising characters of the first language;

in response to detecting a change in physical orientation of the electronic device from a first orientation to a second orientation;

causing translation of the first text to a first translated text of a second language, and

displaying, on the touch sensitive screen, the first translated text and a second virtual keyboard comprising characters of the second language;

receiving a second text of the second language entered via the second virtual keyboard on the touch sensitive screen; and

in response to detecting a change in the physical orientation of the electronic device from the second orientation back to the first orientation;

causing translation of the second text to a second translated text of the first language, and

displaying, on the touch sensitive screen, the second translated text and the first virtual keyboard.

30. The method of claim 29, wherein displaying the first translated text replaces the first text, and displaying the second virtual keyboard replaces the first virtual keyboard.

31. The method of claim 29, wherein:

detecting the change in the physical orientation of the electronic device from the first orientation to the second orientation comprises detecting a rotation of the electronic device from the first orientation to the second orientation, wherein

the first translated text and the second virtual keyboard are displayed right side up in a landscape view while the electronic device is in the second orientation, and

detecting the change in the physical orientation of the electronic device from the second orientation back to the first orientation comprises detecting a rotation of the electronic device from the second orientation to the first orientation, wherein

the second translated text and the second virtual keyboard are displayed right side up in portrait view while the electronic device is in the first orientation, and

the first orientation is a vertical orientation and the second orientation is a horizontal orientation.

32. The method of claim 31, wherein the rotation of the electronic device from the first orientation to the second orientation comprises a rotation by about ninety degrees in the plane of the touch sensitive screen to obtain the second orientation.

33. The method of claim 31, wherein the rotation of the electronic device from the first orientation to the second orientation comprises a rotation by about one hundred and eighty degrees in the plane of the touch sensitive screen to obtain the second orientation.

34. The method of claim 29, further comprising displaying a prompt for a user of the electronic device to enter the first text in the first language.

35. The method of claim 29, further comprising displaying a conversation dialog box in which the second text being entered by a user is simultaneously displayed with the first text.

36. The method of claim 29, further comprising:

determining a geographic location associated with the electronic device; and

prompting a user to select any one of a plurality of languages to which the first text is to be translated, wherein the plurality of languages are based on the determined geographic location.

37. The method of claim 29, further comprising:

launching a translation application on the electronic device to cause the translation of the first text and the display of the first translated text; and

preventing access to other applications on the electronic device until a user is authenticated.

38. The method of claim 29, further comprising:

in response to detecting the change in the physical orientation of the electronic device from the first orientation to the second orientation, displaying a prompt for a user to select any one of a plurality of languages to which the first text is to be translated.

39. The method of claim 29, wherein the first text is entered by a first user and the second text is entered by a second user.

40. An electronic device comprising:

a touch sensitive screen;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

receiving a first text of a first language entered via a first virtual keyboard on the touch sensitive screen, the first virtual keyboard comprising characters of the first language;

in response to detecting a change in physical orientation of the electronic device from a first orientation to a second orientation;

causing translation of the first text to a first translated text of a second language, and

displaying, on the touch sensitive screen, the first translated text and a second virtual keyboard comprising characters of the second language;

receiving a second text of the second language entered via the second virtual keyboard on the touch sensitive screen; and

in response to detecting a change in the physical orientation of the electronic device from the second orientation back to the first orientation;

causing translation of the second text to a second translated text of the first language, and

displaying, on the touch sensitive screen, the second translated text and the first virtual keyboard.

41. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:

receive a first text of a first language entered via a first virtual keyboard on a touch sensitive screen, the first virtual keyboard comprising characters of the first language;

in response to detecting a change in physical orientation of the electronic device from a first orientation to a second orientation;

cause translation of the first text to a first translated text of a second language, and

display, on the touch sensitive screen, the first translated text and a second virtual keyboard comprising characters of the second language;

receive a second text of the second language entered via the second virtual keyboard on a touch sensitive screen; and

in response to detecting a change in the physical orientation of the electronic device from the second orientation back to the first orientation;

cause translation of the second text to a second translated text of the first language, and

display, on the touch sensitive screen, the second translated text and the first virtual keyboard.

42. The non-transitory computer-readable storage medium of claim 41, wherein displaying the first translated text replaces the first text, and displaying the second virtual keyboard replaces the first virtual keyboard.

43. The non-transitory computer-readable storage medium of claim 41, wherein:

detecting the change in the physical orientation of the electronic device from the first orientation to the second orientation comprises detecting a rotation of the electronic device from the first orientation to the second orientation, wherein

the first translated text and the second virtual keyboard are displayed right side up in a landscape view while the electronic device is in the second orientation, and

detecting the change in the physical orientation of the electronic device from the second orientation back to the first orientation comprises detecting a rotation of the electronic device from the second orientation to the first orientation, wherein

the second translated text and the second virtual keyboard are displayed right side up in portrait view while the electronic device is in the first orientation, and

the first orientation is a vertical orientation and the second orientation is a horizontal orientation.

44. The non-transitory computer-readable storage medium of claim 43, wherein the change in physical orientation of the electronic device from the first orientation to the second orientation is a rotation by about ninety degrees in the plane of the touch sensitive screen to obtain the second orientation.

45. The non-transitory computer-readable storage medium of claim 43, wherein the change in physical orientation of the electronic device from the first orientation to the second orientation is a rotation by about one hundred and eighty degrees in the plane of the touch sensitive screen to obtain the second orientation.

46. The non-transitory computer-readable storage medium of claim 41 further comprising instructions to:

cause a determination of a geographic location of the electronic device; and

in response to the determination of the geographic location, prompt a user to select any one of a plurality of languages to which the first text is to be translated, wherein the plurality of languages are based on the determined geographic location.

47. The non-transitory computer-readable storage medium of claim 41, further comprising instructions to, in response to detecting the change in the physical orientation of the electronic device from the first orientation to the second orientation, prompt a user to select any one of a plurality of languages to which the first text is to be translated.

48. The non-transitory computer-readable storage medium of claim 41, further comprising instructions to prompt a user of the electronic device to enter the first text in the first language.

49. The non-transitory computer-readable storage medium of claim 41, further comprising instructions to cause display of a conversation dialog box in which the second text being entered by a user is simultaneously displayed with the first text.

50. The non-transitory computer-readable storage medium of claim 41, wherein the first text is entered by a first user and the second text is entered by a second user.

51. The non-transitory computer-readable storage medium of claim 41, further comprising instructions to prevent access to other applications until a user is authenticated.