Method and apparatus for virtual keyboard interactions from secondary surfaces

• US 20110187647A1
• Filed: 02/04/2010
• Published: 08/04/2011
• Est. Priority Date: 02/04/2010
• Status: Abandoned Application

• Current Assignee: Charles Howard Woloszynski, Samantha Duong Woloszynski, Taylor Duong Woloszynski
• Original Assignee: Charles Howard Woloszynski, Samantha Duong Woloszynski, Taylor Duong Woloszynski
• Inventors: Woloszynski, Samantha Duong, Woloszynski, Charles Howard, Woloszynski, Taylor Duong
• Application Number:
  US12/658,160
• Publication Number:
  US 20110187647A1
• Time in Patent Office: Days
• US Class Current: 345/168
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A method and apparatus for user input on a handheld device with a virtual keyboard using secondary surfaces. On the primary surface of the device (e.g., front), the user interacts via touch sensors and a display element. Secondary surfaces (e.g., back) include additional touch sensors through which the user can also provide input. The display element is used to present information appropriate to the device'"'"'s function (e.g., email messages) and control elements, including a virtual keyboard. The user interacts with the touch sensors on the first surface to bring up the virtual keyboard. Once displayed, the user can interact with this keyboard using either the primary surface or secondary surfaces. When used on appropriately sized device, the user can hold the device with the palms and thumbs of both hands and use their fingers on the touch sensors on the secondary surfaces to type. The selection of a key on the virtual keyboard is accomplished the combination of contacts made on the touch sensors on the secondary surfaces. The selected key, or region of the keyboard, is visually indicated on the front surface. Input of the keystroke is recorded when the user removes their touch from certain touch sensors on the secondary surfaces.

Claims

1. A method for operating a handheld device, comprising:

displaying a virtual keyboard on a display element on a primary surface of a handheld device when the device is in a specific state;

adjusting the presentation of the virtual keyboard on the primary surface based on touches being applied to secondary surfaces, where combinations of touches select different areas within the virtual keyboard.

2. The method of claim 1, wherein six distinct touch areas (L1, L2, L3, R1, R2, and R3) are used to classify touches on secondary surfaces and the combination of touches to these areas, referred to as chords, select different regions of the keyboard.

3. The method of claim 2, whereas the virtual keyboard is logically divided into 3 zones;

the touch areas L1 and R1 are used to select which zone is targeted on the virtual keyboard.

4. The method of claim 3, whereas the virtual keyboard provides visual feedback to the user on which zone is being selected based on the state of touch from L1 and R1.

5. The method of claim 3, whereas each zone of a virtual keyboard is logically divided into rows and columns and the touch areas L2 and R2 are used to select which column is targeted within a zone of the virtual keyboard and the touch areas L3 and R3 are used to select which row is targeted within a zone of the virtual keyboard.

6. The method of claim 5, whereas the virtual keyboard provides visual feedback to the user on which row and column are being targeted by the touches to L2, R2, L3, and R3.

7. The method of claim 5, whereas when L1 and R1 are not touches then no zone is selected, the left zone is selected when L1 is touched and R1 is not, the right zone is selected when R1 is touched and L1 is not, and the center zone, if present, is selected when both L1 and R1 are touched.

8. The method of claim 7, whereas when a zone is selected, a column within the zone is selected when L2 and R2 are touched, with various patterns of touch corresponding to specific columns.

9. The method of claim 8, whereas when a zone is selected, a row within the zone is selected when L3 and R3 are touched, with various patterns of touch corresponding to specific rows.

10. The method of claim 9, whereas the virtual keyboard responds to the selection of a zone and also a row and column within a zone as if the user pressed on that area of the key on the primary surface, and when the user releases certain touches on the secondary surfaces, the virtual keyboard responds as if the user had released pressing on the corresponding area on the first surface.

11. The method of claim 8, whereas when a zone is selected and the zone has rows with four items, the column selected when L2 and R2 are not touched is the second column, the column selected when L2 is touched and R2 is not touched is the first, or left, column, the column selected when R2 is touched and L2 is not touched is the fourth, or right, column, touching both L2 and R2 moves the selection to the third column.

12. The method of claim 9, whereas when a zone is selected and the zone has columns with four items, the row selected when L3 and R3 are not touched is the second row, the row selected when L3 is touched and R3 is not touched moves to the top row, the row selected when R3 is touched and L3 is not touched moves to the bottom row, touching both L3 and R3 has both effects, resulting in moving the selection to the third row.

13. The method of claim 8, whereas when a zone is selected and the zone has rows with a maximum of three items, the column selected when L2 and R2 are not touched is the middle column, the column selected when L2 is touched and R2 is not touched moves to the left column, the column selected when R2 is touched and L2 is not touched moves to the right column.

14. The method of claim 9, whereas when a zone is selected and the zone has columns with a maximum of three items, the row selected when L3 and R3 are not touched is the middle row, the row selected when L3 is touched and R3 is not touched moves to the top row, the row selected when R3 is touched and L3 is not touched moves to the bottom row.

15. The method of claim 8, whereas when a zone is selected and the zone has rows with a maximum of two items, no column is selected when L2 and R2 are not touched, the column selected when L2 is touched and R2 is not touched is the left column, the column selected when R2 is touched and L2 is not touched is the right column.

16. The method of claim 9, whereas when a zone is selected and the zone has columns with a maximum of two items, no row is selected when L3 and R3 are not touched, the row selected when L3 is touched and R3 is not touched is the top row, the row selected when R3 is touched and L3 is not touched is the bottom row.

17. The method of claim 2, whereas the touch sensors are not distinct but can sense multiple touches in a region, to allow for grasping the device in more than one position along the edge, and the mapping of touch locations to touch areas adjusts to the position of the grasp.

18. The method of claim 17, whereas the mapping of the touch locations to touch areas is calibrated by sensing 6 simultaneous touches.

19. The method of claim 17, whereas the mapping of touch locations to touch areas is calibrated by sensing the extent two additional areas of touch, the edge areas on the device contacted by the palms of the hands.

20. The method of claim 17, whereas the mapping of the touch locations to touch areas is calibrated by sensing 6 simultaneous touches and is also calibrated by sensing the extent two additional areas of touch, the edge areas on the device contacted by the palms of the hands.

21. The method of claim 17, whereas the mapping of touch locations is adjusted by tracking the drift in the location of sequences of touches to a touch area, allowing the user'"'"'s grip to drift and the system compensates for this drift without user intervention.

22. The method of claim 2, whereas the mapping of the location of touches to the named touch areas (L1, L2, L3, R1, R2, R3) is user-controlled.

23. An apparatus of an accessory to a handheld electronic device with a display element, comprising:

a set of one or more touch surfaces capable of detecting simultaneous touch in at least six locations;

a mechanism to physically attach to the handheld electronic device such that the touch sensors are reachable with the fingers while holding the accessory;

an electronic interface to the handheld electronic device to communicate the state of the touch sensors to support the processor on the electronic device, a processor of the handheld electronic device with instructions to perform the method in accordance with claim 1.

24. An apparatus of a handheld electronic device comprising:

a primary surface having a display element coupled thereto;

a set of one or more secondary surfaces having touch sensors coupled thereto, the secondary surfaces not coplanar to the primary surface;

the secondary touch surfaces capable of detecting simultaneous touch in at least six locations;

a processor of the handheld electronic device with instructions to perform the method in accordance with claim 1.

25. An apparatus of claim 23, wherein the touch sensors are distinct buttons

26. An apparatus of claim 24, wherein the touch sensors are distinct buttons

27. An apparatus of claim 23, wherein the touch sensors are an array of electrical impedance sensors capable of detecting multiple simultaneous touches

28. An apparatus of claim 24, wherein the touch sensors are an array of electrical impedance sensors capable of detecting multiple simultaneous touches

29. An apparatus of claim 23, wherein the device has additional touch sensor locations to support its use in two orientations

30. An apparatus of claim 24, wherein the device has additional touch sensor locations to support its use in two orientations

31. An apparatus of claim 23, wherein the device has additional touch sensor locations to support its use in three orientations

32. An apparatus of claim 24, wherein the device has additional touch sensor locations to support its use in three orientations

33. An apparatus of claim 23, wherein the device has additional touch sensor locations to support its use in four orientations

34. An apparatus of claim 24, wherein the device has additional touch sensor locations to support its use in four orientations

35. An apparatus of claim 27, wherein the accessory or the device has a sensor to detect the orientation of the device that is used to assist in disambiguating touches when touch locations overlap.

36. An apparatus of claim 28, wherein the device has a sensor to detect the orientation of the device that is used to assist in disambiguating touches when touch locations overlap.