Displays for electronic devices that detect and respond to the size and/or angular orientation of user input objects

• US 8,169,418 B2
• Filed: 05/12/2009
• Issued: 05/01/2012
• Est. Priority Date: 05/12/2009
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Birkler, Jörgen
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US12/464,403
• Publication Number:
  US 20100289752A1
• Time in Patent Office: 1,085 Days
• Field of Search: 345168-169, 345173-179, 178 1801- 1807, 178 1901- 1906, 178 2001- 2004
• US Class Current: 345/174
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

An electronic device includes a touch-sensitive display screen including an array of electromagnetic radiation detectors. The array of electromagnetic radiation detectors is configured to generate an image signal that represents an image of a user input object that is closely spaced to the display, and to generate a touch signal in response to the display screen being touched by the user input object. The electronic device further includes a controller circuit that is configured to display a plurality of keys forming a keyboard and to display characters on the keys. The controller identifies from the image signal a size and/or an angular orientation of the user input object relative to the display screen. The controller identifies a user'"'"'s selection among characters indicated on the keyboard keys in response to the identified size and/or the angular orientation of the user input object and in response to the touch signal, and outputs character data corresponding to the identified user selected character.

Claims

1. An electronic device, comprising:

a touch-sensitive display screen including an array of electromagnetic radiation detectors, wherein the array of electromagnetic radiation detectors is configured to generate an image signal that represents an image of a user input object that is closely spaced to the display, and to generate a touch signal in response to the display screen being touched by the user input object; and

a controller circuit configured to display on the display screen a plurality of keys forming a keyboard and to display characters on the keys, to identify from the image signal a size and/or an angular orientation of the user input object relative to the display screen, to identify a user'"'"'s selection among characters indicated on the keyboard keys in response to the identified size and/or an angular orientation of the user input object and in response to the touch signal, and to output character data corresponding to the identified user selected character, wherein the controller circuit displays a first plurality of alphabetic characters each on a different one of a first plurality of keys arranged in a QWERTY keyboard configuration in response to identifying a first threshold size of the user input object, and displays groupings of the first plurality of alphabetic characters on a second plurality of displayed keys in response to identifying a second threshold size of the user input object, wherein the second threshold size is larger than the first threshold size and the second plurality of keys is less than the first plurality of keys, and the controller circuit is further configured to distinguish between selection of one of the keyboard keys by a left hand finger from selection by a right hand finger in response to the identified angular orientation of the user object and to identify a first one of the multiple characters on the selected key that occurs in a direction indicated by the identified angular orientation of the user input object as being the user selected character.

2. A electronic device, comprising:

a touch-sensitive display screen including an array of electromagnetic radiation detectors, wherein the array of electromagnetic radiation detectors is configured to generate an image signal that represents an image of a user input object that is closely spaced to the display, and to generate a touch signal in response to the display screen being touched by the user input object; and

a controller circuit configured to display on the display screen a plurality of keys forming a keyboard and to display characters on the keys, to identify from the image signal a size and/or an angular orientation of the user input object relative to the display screen, to identify a user'"'"'s selection among characters indicated on the keyboard keys in response to the identified size and/or the angular orientation of the user input object and in response to the touch signal, and to output character data corresponding to the identified user selected character.

3. The electronic device of claim 2, wherein the controller circuit is further configured to identify a user'"'"'s selection among the characters in response to the touch signal indicating a touch by the user input object at a touch point between adjacent ones of the characters and in response to the identified angular orientation of the user input object.

4. The electronic device of claim 2, wherein the controller circuit is further configured to:

display at least two different characters on each of a plurality of the keyboard keys, and to identify a user'"'"'s selection among the characters displayed on a selected one of the multi-character keys in response to the identified angular orientation of the user input object that is selecting the key; and

identify a first one of the multiple characters on the selected key that occurs in a direction indicated by the identified angular orientation of the user input object as being the user selected character.

5. The electronic device of claim 2, wherein the controller circuit is further configured to:

display at least two different characters on each of a plurality of the keyboard keys, and to identify a user'"'"'s selection among the characters displayed on a selected one of the multi-character keys in response to the identified angular orientation of the user input object that is selecting the key; and

generate a selection signal that distinguishes between selection of one of the keyboard keys by a left hand finger from selection by a right hand finger in response to the identified angular orientation of the user object, to respond to the selection signal identifying that the selection is being made by a left hand finger by determining that the user has selected a leftmost one of the multiple characters displayed on the selected key, and to respond to the selection signal identifying that the selection is being made by a right hand finger by determining that the user has selected a rightmost one of the multiple characters displayed on the selected key.

6. The electronic device of claim 2, wherein the controller circuit is further configured to generate a selection signal that distinguishes between selection among the keyboard keys by a finger on the user'"'"'s left hand from selection by another finger on the user'"'"'s right hand in response to the identified angular orientation of the user input object, and is configured to respond to the selection signal indicating that a user is typing using one hand by activating a predictive text entry operation that selects a candidate word among a database of defined words using a sequence of user selected keyboard characters.

7. The electronic device of claim 2, wherein the controller circuit is further configured to display at least two different characters on each of a plurality of the keyboard keys, and to identify a user'"'"'s selection among the multiple characters displayed on a selected one of the keys in response to the identified size of the user input object selecting the key.

8. The electronic device of claim 2, wherein the controller circuit is further configured to generate a selection signal that distinguishes between selection among the keyboard keys using the user'"'"'s thumb from the selection using another non-thumb finger in response to the identified size of the user input object.

9. The electronic device of claim 8, wherein the controller circuit is further configured to respond to the selection signal identifying a selection by the user'"'"'s thumb by restricting the user'"'"'s possible character selection to the displayed non-numeric characters, and to respond to the selection signal identifying a selection by one of the user'"'"'s non-thumb fingers by restricting the user'"'"'s possible character selection to the displayed non-alphabetic characters.

10. The electronic device of claim 8, wherein the controller circuit is further configured to respond to the selection signal identifying the selection of a sequence of the displayed alphabetic characters by one or both of the user'"'"'s thumbs by activating a predictive text entry operation that selects a candidate word among a database of defined words using the sequence of selected alphabetic characters, and to discontinue the predictive text operation in response to the selection signal identifying the selection of at least one key by one of the user'"'"'s non-thumb fingers.

11. The electronic device of claim 2, wherein the controller circuit is further configured to modify the displayed size of at least some of the keyboard keys in response to the identified size of the user input object.

12. The electronic device of claim 11, wherein the controller circuit is further configured to display a first plurality of keys of a QWERTY keyboard on the display screen in response to identifying a first threshold size of the user input object and to replace the displayed first plurality of keys with a second plurality of keys of the QWERTY keyboard on the display screen in response to identifying a second threshold size of the user input object, wherein the second threshold size is larger than the first threshold size and the second plurality of keys is less than the first plurality of keys.

13. The electronic device of claim 11, wherein the controller circuit is further configured to generate a selection signal that distinguishes between selection of keys by the user'"'"'s thumb from selection by one of the user'"'"'s non-thumb fingers in response to the identified size, and is configured to enlarge the displayed size of at least one of the keyboard keys in response to identifying selection by the user'"'"'s thumb and to then decrease the displayed size of the previously enlarged at least one key in response to identifying selection by one of the user'"'"'s non-thumb fingers.

14. The electronic device of claim 11, wherein the controller circuit is further configured to generate a selection signal that distinguishes between selection of keys by the user'"'"'s thumb from selection by one of the user'"'"'s non-thumb fingers in response to the identified size of the user object, is configured to display a first plurality of alphabetic characters each on a different one of a first plurality of keys arranged in a QWERTY keyboard configuration in response to identifying selection by one of the user'"'"'s non-thumb fingers, and is configured to display groupings of the first plurality of alphabetic characters on a second plurality of displayed keys, which is less than the first plurality of displayed keys, in response to identifying selection by the user'"'"'s thumb.

15. The electronic device of claim 14, wherein the controller circuit is further configured to display the second plurality of displayed keys as larger key symbols than the first plurality of displayed keys.

16. The electronic device of claim 14, wherein the controller circuit is further configured to generate the selection signal to indicate whether selection of one of the keyboard keys is by a left hand finger or is by a right hand finger in response to the identified angular orientation of the user object, and to replace the display of the first plurality of keys with the display of the second plurality of keys in response to the selection signal identifying that the user is using fingers from both the right and left hands to select among the first plurality of keys.

17. The electronic device of claim 16, wherein the controller circuit is further configured to replace the display of the first or second plurality of keys with the display of a third plurality of keys in response to the selection signal identifying that the user is selecting among the displayed keys using one or the other thumbs, but not both, for at least a plural threshold number of key selections.

18. The electronic device of claim 16, wherein the controller circuit is further configured to replace the display of the second plurality of keys with the display of the first plurality of keys in response to the selection signal identifying that the user is selecting among the second plurality of keys using at least one of the user'"'"'s non-thumb fingers.

19. The electronic device of claim 16, wherein the controller circuit is further configured to replace the display of the first plurality of keys with the display of the second plurality of keys in response to the selection signal identifying that the user is selecting among the first plurality of keys using both right and left hand thumbs within a threshold time, and to replace the display of the second plurality of keys with the display of the first plurality of keys in response to the selection signal identifying that the user is selecting among the second plurality of keys using at least one of the user'"'"'s non-thumb fingers.

20. The electronic device of claim 16, wherein the controller circuit is further configured to respond to the selection signal identifying a key selection by the left hand finger by identifying the user'"'"'s selection of a leftmost one of the characters displayed on the selected one of the second plurality of keys, and to respond to the selection signal identifying a selection by the right hand finger by identifying the user'"'"'s selection of a rightmost one of the characters displayed on the selected one of the second plurality of keys.