Displays for electronic devices that detect and respond to the contour and/or height profile of user input objects

• US 8,514,190 B2
• Filed: 10/06/2010
• Issued: 08/20/2013
• Est. Priority Date: 10/06/2010
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications AB (Sony Group Corp.)
• Inventors: Birkler, Paul Joergen
• Primary Examiner(s): SHERMAN, STEPHEN G
• Application Number:
  US12/899,037
• Publication Number:
  US 20120086647A1
• Time in Patent Office: 1,049 Days
• Field of Search: 345173-178, 345/104, 178 1801- 1809, 178/18.11
• US Class Current: 345/173
• CPC Class Codes: G06F 1/3203 Power management, i.e. event-based initiation of a power-saving mode
• CPC Class Codes: G06F 1/3215 Monitoring of peripheral devices
• CPC Class Codes: G06F 1/3262 Power saving in digitizer or tablet
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

An electronic device includes a touch-sensitive display screen including an array of electromagnetic radiation detectors. The array of electromagnetic radiation detectors is configured to generate an image signal that represents an image of a user input object that is closely spaced to the display, and to generate a touch signal in response to the display screen being touched by the user input object. The electronic device further includes a controller circuit that is configured to display a plurality of keys forming a keyboard and to display characters on the keys. The controller identifies from the image signal a size and/or an angular orientation of the user input object relative to the display screen. The controller identifies a user'"'"'s selection among characters indicated on the keyboard keys in response to the identified size and/or the angular orientation of the user input object and in response to the touch signal, and outputs character data corresponding to the identified user selected character.

Claims

1. A electronic device, comprising:

a touch-sensitive display screen including an array of electromagnetic radiation emitters and electromagnetic radiation detectors, wherein the array of electromagnetic radiation detectors is configured to generate an image signal that represents an image of a user input object that is closely spaced to the display responsive to detected electromagnetic radiation that is reflected by the user input object; and

a controller circuit configured to control activation of the array of electromagnetic radiation emitters so that at least a portion of the array of electromagnetic radiation emitters are inactive in an absence of detecting electromagnetic radiation reflected by the user input object, and to selectively activate ones of the array of electromagnetic radiation emitters responsive to the array of electromagnetic radiation detectors detecting electromagnetic radiation that is reflected by the user input object,

wherein the controller circuit is configured to activate a first set of one or more of the electromagnetic radiation emitters and to generate a first electromagnetic radiation profile responsive to electromagnetic radiation from the first set of one or more electromagnetic radiation emitters that is reflected by the user input object and detected by the array of electromagnetic radiation detectors, the controller circuit is configured to activate a second set of one or more of the electromagnetic radiation emitters that is different from the first set of one or more of the electromagnetic radiation emitters and to generate a second electromagnetic radiation profile responsive to electromagnetic radiation from the second set of one or more electromagnetic radiation emitters that is reflected by the user input object and detected by the array of electromagnetic radiation detectors, and the controller circuit is configured to identify a contour profile of the user input object based on the first and second electromagnetic radiation profiles.

2. The electronic device of claim 1, wherein the selectively activated ones of the plurality of the array of electromagnetic radiation emitters are proximate the detected electromagnetic radiation reflected by the user input object.

3. The electronic device of claim 1, wherein the electively activated ones of the plurality of the array of electromagnetic radiation emitters are proximate a perimeter of the electromagnetic radiation reflected by the user input object.

4. The electronic device of claim 1, wherein the controller circuit is configured to generate a contour profile of the user input object that approximates a contour curve of a surface of the user input object and is responsive to an amount of electromagnetic radiation detected by respective ones of the electromagnetic radiation detectors.

5. The electronic device of claim 1, wherein the controller circuit is configured to generate a height profile of the user input object that approximates a distance between a surface of the user input object and the display and is responsive to an amount of electromagnetic radiation detected by respective ones of the electromagnetic radiation detectors.

6. The electronic device of claim 1, wherein the controller circuit is configured to display on the display screen a plurality of keys forming a keyboard and to display characters on the keys, to identify from the first and second electromagnetic radiation profiles a contour profile comprising a contour of the user input object relative to the display screen, to identify a user'"'"'s selection among characters indicated on the keyboard keys in response to the identified contour profile of the user input object, and to output character data corresponding to the identified user selected character.

7. The electronic device of claim 6, wherein the display is configured to generate a touch signal in response to the display screen being touched by the user input object, and the controller circuit is configured to further identify the user'"'"'s selection among characters indicated on the keyboard keys in response to a touch signal together with the identified contour profile of the user input object.

8. The electronic device of claim 7, wherein the controller circuit is further configured to display at least two different characters on each of a plurality of the keyboard keys, and to identify a user'"'"'s selection among the characters displayed on a selected one of the multi-character keys in response to the identified contour profile of the user input object that is selecting the key.

9. The electronic device of claim 8, wherein the controller circuit is further configured to identify a portion of the user input object that is nearest to the display responsive to the contour profile and to identify a first one of the multiple characters on the selected key that occurs adjacent the portion of the user input object that is nearest to the display as being the user selected character.

10. The electronic device of claim 1, wherein the controller circuit is further configured to modify the displayed size of at least some of the keyboard plurality of keys in response to an identified size of the user input object based on the image signal.

11. The electronic device of claim 10, wherein the controller circuit is further configured to display a first plurality of keys of a QWERTY keyboard on the display screen in response to identifying a first threshold size of the user input object and to replace the displayed first plurality of keys with a second plurality of keys of the QWERTY keyboard on the display screen in response to identifying a second threshold size of the user input object, wherein the second threshold size is larger than the first threshold size and the second plurality of keys is less than the first plurality of keys.

12. A method of operating a touch-sensitive display including an array of electromagnetic radiation emitters and electromagnetic radiation detectors, comprising:

activating a reduced number of electromagnetic radiation emitters in an absence of electromagnetic radiation detected by the electromagnetic radiation detectors;

selectively activating electromagnetic radiation emitters responsive to a detection of electromagnetic radiation reflected by a user input object;

generating an image signal representing an acquired image of the user input object;

identifying a user selection of a character and/or icon responsive to the acquired image of the user input object;

activating a first set of one or more of the electromagnetic radiation emitters;

generating a first electromagnetic radiation profile responsive to electromagnetic radiation from the first set of one or more electromagnetic radiation emitters that is reflected by the user input object and detected by the array of electromagnetic radiation detectors;

activating a second set of one or more of the electromagnetic radiation emitters that is different from the first set of one or more of the electromagnetic radiation emitters;

generating a second electromagnetic radiation profile responsive to electromagnetic radiation from the second set of one or more electromagnetic radiation emitters that is reflected by the user input object and detected by the array of electromagnetic radiation detectors; and

identifying a contour profile of the user input object based on the first and second electromagnetic radiation profiles.

13. The method of claim 12, wherein the selectively activated ones of the plurality of the array of electromagnetic radiation emitters are proximate the detected electromagnetic radiation reflected by the user input object.

14. The method of claim 12, wherein the electively activated ones of the plurality of the array of electromagnetic radiation emitters are proximate a perimeter of the electromagnetic radiation reflected by the user input object.

15. The method of claim 12, further comprising generating a contour profile of the user input object that approximates a contour curve of a surface of the user input object and is responsive to an amount of electromagnetic radiation detected by respective ones of the electromagnetic radiation detectors.

16. The method of claim 12, further comprising generating a height profile of the user input object that approximates a distance between a surface of the user input object and the display and is responsive to an amount of electromagnetic radiation detected by respective ones of the electromagnetic radiation detectors.

17. The method of claim 13, further comprising:

displaying on the display screen a plurality of keys forming a keyboard and characters on the keys;

identifying a user'"'"'s selection among characters indicated on the keyboard keys in response to the identified contour profile of the user input object; and

outputting character data corresponding to the identified user selected character.

18. The method of claim 17, further comprising:

generating a touch signal in response to the display screen being touched by the user input object;

identifying the user'"'"'s selection among characters indicated on the keyboard keys in response to a touch signal together with the identified contour profile of the user input object.