Method and apparatus for data entry input

• US 20060190836A1
• Filed: 02/23/2006
• Published: 08/24/2006
• Est. Priority Date: 02/23/2005
• Status: Active Grant

• Current Assignee: AiTech, LLC
• Original Assignee: Zienon LLC
• Inventors: Ling Su, Wei, Zlotnicki, Joseph, Li, Dong Ge
• Granted Patent: US 9,274,551 B2
• Time in Patent Office: Days
• US Class Current: 715/773
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1624 with sliding enclosures, e.g. sliding keyboard or display
• CPC Class Codes: G06F 1/1662 Details related to the integrated keyboard
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 3/0233 Character input methods
• CPC Class Codes: G06F 3/0235 using chord techniques G06F3/0234 takes precedence
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

An apparatus and method of inputting data for an electronic data entry device are provided. In one embodiment, main keys on a keyboard of a device are used in which the main keys have multiple symbols or functions associated therewith, and one or more assisting keys of the device are used to select between the symbols or functions on the main keys. In a further embodiment, identification of an input object such as the particular fingers of a user that are used to actuate a key region is performed. The symbol associated with the actuated key region and the finger (or other input object) used is determined. Various types of sensors and recognition technology are implemented in order to identify fingers (or other input objects) in various embodiments.

Claims

1. A method of determining a user inputted symbol or function at a data entry device comprising:

associating symbols or functions with corresponding key regions associated with the data entry device;

assigning the symbols or functions associated with the individual key regions to corresponding input objects;

determining which key region of the plurality of key regions has been actuated by an input object;

identifying the input object associated with the actuation of the key region; and

outputting an associated symbol or performing an associated function in response to the identification of the input object that actuated the key region.

2. The method of claim 1 further comprising:

assigning the symbols or functions to corresponding identifiable differentiating parts of the input objects;

identifying the part of the input object that was used in actuating the key region; and

outputting the associated symbol or performing the associated function in response to the identification of the input object part.

3. The method of claim 1 further comprising:

assigning the symbols or functions to corresponding user-configured alterable features exhibited by the input objects;

identifying at least one of the user-configured alterable features exhibited by the input object while being used in actuating the key region; and

outputting the associated symbol or performing the associated function in response to the identification of the feature exhibited by the input object.

4. The method of claim 1 in which the input object further comprises at least one of:

(a) a finger, (b) a portion of a finger, (c) an actuating device, and (d) a part of an actuating device.

5. The method of claim 1 in which the key regions further comprise at least one of:

(a) keys of a keyboard, (b) touch-sensitive regions, (c) virtual key regions comprising pre-assigned regions in two-dimensional space, and (d) virtual key regions comprising pre-assigned regions in three-dimensional space.

6. The method of claim 5 further comprising determining which virtual key region has been actuated, in which at least one contactless sensor is utilized to identify a pre-assigned region in which the input object is situated.

7. The method of claim 1 further comprising dividing the key regions by adjustable boundary locations defined by user-configurable program instructions stored in a memory associated with the data entry device.

8. The method of claim 7 further comprising adjusting the boundary locations of the key regions based on at least one of:

(a) user behavior, (b) spelling correction determinations, and (c) usage frequency of symbols or functions.

9. The method of claim 1 in which identifying the input object further comprises:

performing a sample capture, in which the sample contains at least one feature for the identification of the input object;

performing a pre-processing operation on at least a portion of the captured sample;

extracting at least one feature of the input object from the captured sample;

identifying the input object actuating the key region via identification of the extracted feature; and

selecting the associated symbol or associated function corresponding to the input object identified as actuating the key region.

10. The method of claim 9 in which the input object further comprises at least one finger or non-finger object, and in which the feature of the input object comprises derived features of at least one of the following types:

(a) size, (b) shape in two- or three-dimensional space, (c) edge, (d) color, (e) surface texture, (f) size of contact area with actuated key region, (g) pressure or impact of contact with actuated key region, (h) sound of contact with actuated key region (i) impedance, (0) conductance, (k) capacitance, (1) inductance, (m) infrared properties, (n) ultrasound properties, (o) thermal properties, (p) finger vein patter, (q) fingerprint, and (r) a derivative of one or more of (a)-(q).

11. The method of claim 1 further comprising:

assigning at least one identifiable differentiating objects to each of corresponding input objects;

placing the different identifiable differentiating objects on the corresponding input objects;

assigning the symbols or functions associated with the individual key regions to corresponding identifiable differentiating objects;

identifying the input object that actuated the key region via identification of the at least one identifiable differentiating object placed on the input object; and

outputting the corresponding associated symbol or performing the corresponding associated function in response to the identification of the input object used to actuate the key region.

12. The method of claim 11 in which the input object that actuated the key region further comprises at least one finger, and in which the at least one identifiable differentiating object assigned to the at least one finger comprises at least one of:

(a) sensors, (b) gloves, (c) rings, (d) switches, (e) tags, and (f) a derivation of one or more of (a)-(e).

13. The method of claim 1 further comprising utilizing at least one sensor to identify the input object that actuated the key region, in which said sensor comprises at least one of:

(a) contact sensors, (b) contactless sensors, (c) active sensors, and (d) hybrid sensors of two or more of (a)-(c).

14. The method of claim 13 further comprising utilizing at least one camera as a contactless sensor in the identification of the input object that actuated the key region.

15. The method of claim 1 further comprising utilizing at least one active sensor to detect the input object that actuated the key region, in which the at least one active sensor detects the input object by projecting reference signals onto the input object and detecting feedback from the projected reference signals.

16. The method of claim 15 in which the reference signals comprise at least one of:

(a) electromagnetic wave signals, and (b) ultrasound signals.

17. The method of claim 1 further comprising:

associating one or more assisting keys with corresponding user inputted symbols or functions associated with the corresponding key regions;

determining which of the plurality of assisting keys in combination with which of the plurality of key regions have been actuated; and

outputting the associated symbol or performing the associated function corresponding to the actuation of the key region and assisting key combination and identification of the input object that actuated the key region.

18. The method of claim 1 further comprising providing the key regions at a keyboard having at least one of the following layouts:

(a) an alphabetic layout with letter symbols arranged in alphabetical order from left to right within rows of the keys in said layout, and (b) a telephone-style layout.

19. The method of claim 1 further comprising providing the key regions at a keyboard having at least one of the following layouts:

(a) a folded QWERTY layout, in which the plurality of symbols or functions associated with said layout comprise a pair of symbols or functions from opposite halves of a standard QWERTY keyboard divided by, and symmetrical about, the following pairs of symbols;

‘

5’ and

‘

6’

, ‘

T’ and

‘

Y’

, ‘

G’ and

‘

H’

, and ‘

B’ and

‘

N’

, (b) a compressed QWERTY layout, in which the plurality symbols or functions associated with said layout comprise a pair of symbols or functions adjacent to each other on a standard QWERTY layout, and (c) a standard QWERTY layout.

20. An apparatus for determining a user inputted symbol or function comprising:

a data entry device having an associated memory adapted to store information associating symbols or functions with corresponding key regions associated with the data entry device, in which the associated symbols or functions are assigned to corresponding input objects; and

a processor of the data entry device adapted to;

(i) determine which key region of the plurality of key regions has been actuated, (ii) identify the input object associated with the actuation of the key region, and (iii) output an associated symbol or perform an associated function in response to the identification of the input object that actuated the key region.

21. The apparatus of claim 20 in which the memory associated with the data entry device is adapted to store information assigning the symbols or functions to corresponding identifiable differentiating parts of the input objects and in which the data entry device is adapted to identify the part of the input object that was used in actuating the key region and output the associated symbol or perform the associated function in response to the identification of the input object part.

22. The apparatus of claim 20 in which the memory associated with the data entry device is adapted to store information assigning the symbols or functions to corresponding user-configured alterable features exhibited by the input objects and in which the data entry device is adapted to identify at least one of the user-configured alterable features exhibited by the input object while being used in actuating the key region and output the associated symbol or perform the associated function in response to the identification of the feature exhibited by the input object.

23. The apparatus of claim 20 in which the input object further comprises at least one of:

(a) a finger, (b) a portion of a finger, (c) an actuating device, and (d) a part of an actuating device.

24. The apparatus of claim 20 in which the key regions further comprise at least one of:

(a) keys of a keyboard, (b) touch-sensitive regions, (c) virtual key regions comprising pre-assigned regions in two-dimensional space, and (d) virtual key regions comprising pre-assigned regions in three-dimensional space.

25. The apparatus of claim 24 in which the data entry device is adapted to determine which virtual key region has been actuated and further comprising at least one contactless sensor to identify a pre-assigned region in which the input object is situated.

26. The apparatus of claim 20 further comprising adjustable boundary locations that divide the plurality of key regions into individual key regions, the boundary locations defined by user-configurable program instructions stored in the memory associated with the data entry device.

27. The apparatus of claim 26 in which the processor is adapted to adjust the boundary locations of the key regions based on at least one of:

(a) user behavior, (b) spelling correction determinations, and (c) usage frequency of symbols or functions.

28. The apparatus of claim 20 in which the memory associated with the data entry device is adapted to store information assigning the symbols or functions associated with the individual key regions to corresponding identifiable differentiating objects that are placeable on corresponding input objects and in which the data entry device is adapted to identify the input object that actuated the key region via identification of at least one identifiable differentiating object placed on the input object and output the corresponding associated symbol or perform the corresponding associated function in response to the identification of the input object used to actuate the key region.

29. The apparatus of claim 28 in which the input object further comprises at least one finger, and in which the at least one identifiable differentiating object comprises at least one of:

(a) sensors, (b) gloves, (c) rings, (d) switches, (e) tags, and (f) a derivation of one or more of (a)-(e).

30. The apparatus of claim 20 further comprising at least one sensor coupled with the processor to identify the input object that actuated the key region, in which said sensor comprises at least one of:

(a) contact sensors, (b) contactless sensors, (c) active sensors, and (d) hybrid sensors of two or more of (a)-(c).

31. The apparatus of claim 30 further comprising at least one camera as a contactless sensor utilized in the identification of the input object that actuated the key region.

32. The apparatus of claim 20 further comprising at least one active sensor coupled with the processor to identify the input object that actuated the key region, in which the at least one active sensor detects the input object by projecting reference signals onto the input object and detecting feedback from the projected reference signals.

33. The apparatus of claim 32 wherein the reference signals comprise at least one of:

(a) electromagnetic wave signals, and (b) ultrasound signals.

34. The apparatus of claim 20 further comprising at least one assisting key associated with the data entry device in which a combined actuation of the key region and assisting key, in conjunction with the input object associated with the key region actuation, identifies the associated symbol or function to be outputted or performed.

35. The apparatus of claim 20 in which the key regions are provided at a keyboard having at least one of the following layouts:

(a) an alphabetic layout having letter symbols arranged in alphabetical order from left to right within rows of keys in said layout, and (b) a telephone-style layout.

36. The apparatus of claim 20 in which the key regions are provided at a keyboard having at least one of the following layouts:

(a) a folded QWERTY layout, in which the plurality of symbols or functions associated with said layout comprise a pair of symbols or functions from opposite halves of a standard QWERTY keyboard divided by, and symmetrical about, the following pairs of symbols;

‘

5’ and

‘

6’

, ‘

T’ and

‘

Y’

, ‘

G’ and

‘

H’

, and ‘

B’ and

‘

N’

, (b) a compressed QWERTY layout, in which the plurality symbols or functions associated with said layout comprise a pair of symbols or functions adjacent to each other on a standard QWERTY layout, and (c) a standard QWERTY layout.

37. A keyboard structure comprising:

a plurality of key regions representing an existing keyboard arrangement, at least some of the said plurality of key regions being multifunctional keys having more than one symbol or function associated with each of said multifunctional keys;

means for associating a plurality of at least one spatially neighboring symbol or function in said existing keyboard arrangement with each key region of said plurality of key regions; and

means for assigning a plurality of at least one input object or at least one assisting key or some combination of input objects and assisting keys to each symbol or function associated with each of said key regions.

38. The keyboard structure of claim 37 in which said existing keyboard arrangement is one of the following:

(a) a standard QWERTY keyboard, (b) a folded QWERTY keyboard, in which said plurality of spatially neighboring symbols or functions comprise a pair of symbols or functions from opposite halves of a standard QWERTY keyboard divided by, and symmetrical about, the following pairs of symbols;

‘

5’ and

‘

6’

, ‘

T’ and

‘

Y’

, ‘

G’ and

‘

H’

, and ‘

B’ and

‘

N’

, and (c) a compressed QWERTY keyboard, in which said plurality of spatially neighboring symbols or functions comprise a pair of symbols or functions adjacent to each other on a standard QWERTY keyboard.

39. The keyboard structure of claim 37 in which said existing keyboard arrangement is one of the following:

(a) an alphabetic keyboard in which said plurality of spatially neighboring symbols or functions comprises letter symbols arranged in alphabetical order from left to right within the row of keys, and (b) a phone-style keyboard.

40. The keyboard structure of claim 37 further comprising means for identifying which of the plurality of input objects is used to actuate one of said multifunctional key regions, and in which the combination of the input object used and said multifunctional key region actuated determines which associated symbol or function is selected for output.