Method and apparatus for data entry input

• US 9,760,214 B2
• Filed: 05/26/2010
• Issued: 09/12/2017
• Est. Priority Date: 02/23/2005
• Status: Active Grant

• Current Assignee: AiTech, LLC
• Original Assignee: Zienon LLC
• Inventors: Li, Dong Ge
• Primary Examiner(s): Boddie, William
• Assistant Examiner(s): Shapiro, Leonid
• Application Number:
  US12/787,763
• Publication Number:
  US 20100231522A1
• Time in Patent Office: 2,666 Days
• Field of Search: 345169, 345168, 345173
• CPC Class Codes: G06F 3/0423 using sweeping light beams, e.g. using rotating or vibrating mirror
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A method and apparatus for inputting data for an electronic data entry device are provided. In one embodiment, identification of an input object such as the particular fingers of a user that are used to actuate a key region is performed. The symbol associated with the actuated key region and the finger (or other input object) used is determined. In other embodiments, virtual input devices with interfaces such as QWERTY style keyboards, phone keypads, and multi-touch capable touchpads or tablets are provided in input regions. One or more video capturing devices remotely acquire actuation information from the input regions during data entry. User inputted symbols or functions are determined based on the actuations, their locations and identified input object sets that caused the actuations.

Claims

1. A method of determining virtual input at a data entry device having an input region, an input module and a processor, the method comprising:

associating at least two input symbols or functions with the input region;

defining a set of unique input objects with each unique input object having a defining feature that differentiates it from the other unique input objects in the set;

assigning each of the input symbols or each of the functions to a one of the unique input objects;

performing with the input module remote data acquisition of the input region of the data entry device to obtain data;

processing the data with the processor to;

a. determine which input region has been actuated;

b. determine which one of the unique input objects actuated the input region; and

c. determine the input symbol or the function associated with the unique input object; and

outputting the symbol or performing the function on an output device.

2. A method as recited in claim 1 further comprising providing a plurality of input regions including a first input region and a second input region and, wherein the step of performing remote data acquisition comprises performing remote data acquisition on-two o the first input region and the second input region to respectively acquire a first set of data and a second set of data.

3. A method as recited in claim 2, wherein the location of each input region is set dynamically and in a fixed relation to a reference object.

4. A method as recited in claim 3, wherein the reference object comprises one of:

(a) a user'"'"'s face;

(b) knuckle(s) of a finger;

(c) a user'"'"'s shoulders; and

(d) a user'"'"'s chest.

5. A method as recited in claim 2, wherein a set of multiple input regions of the data entry device lies in separate parallel planes at different distances from a reference object.

6. A method as recited in claim 2, wherein a set of multiple input regions of the data entry device is configured to receive input from two or more users, each user assigned to at least one input region.

7. A method as recited in claim 2 wherein the step of performing remote data acquisition on two or more input regions comprises:

providing a first data entry device and a second data entry device;

assigning the first data entry device to the first input region; and

assigning the second data entry device to the second input region;

transmitting with the output device any input symbol or function of the first input region to the first data entry device; and

transmitting with the output device any input symbol or function of the second input region to the second data entry device.

8. A method as recited in claim 1, wherein the set of unique input objects comprise the fingers of a user'"'"'s hand and each finger is a unique input object.

9. A method as recited in claim 1, wherein the step of performing remote data acquisition utilizes a single video capturing device.

10. A method as recited in claim 1, wherein the step of performing remote data acquisition utilizes two video capturing devices, comprising:

utilizing one of the video capturing devices to gather data to determine whether the input region has been actuated, said video capturing device disposed proximate the input region; and

utilizing the other video capturing device or both video capturing devices for identification of the unique input object that actuated the input region.

11. A method as recited in claim 1, wherein the step of performing remote data acquisition utilizes contactless sensors configured to acquire depth information.

12. A method as recited in claim 8, wherein the step of identifying the finger utilizes one or more of the following features:

(a) size;

(b) shape;

(c) edge;

(d) vein pattern;

(e) nail color;

(f) skin texture; and

(g) skin tone.

13. A method as recited in claim 8, wherein the step of determining whether the input region has been actuated comprises determining the relative location of the actuation in relation to a reference object.

14. A method as recited in claim 13, wherein the reference object comprises one of:

(a) a user'"'"'s face;

(b) knuckle(s) of a finger;

(c) a user'"'"'s shoulders; and

(d) a user'"'"'s chest.

15. A method as recited in claim 13, wherein the reference object comprises one of:

(a) a user'"'"'s hand; and

(b) a palm.

16. A method as recited in claim 8, wherein the step of determining which input region has been actuated comprises determining the location of the actuation.

17. A method as recited in claim 8, wherein the unique set of input objects comprises at least two fingers, and wherein the step of data acquisition comprises determining the relative distance between the fingers.

18. A method as recited in claim 8, wherein the remote data acquisition step comprises determining the posture of the input object.

19. A method as recited in claim 8, wherein the remote data acquisition step comprises determining the location of the actuation and the posture of the unique input object set.

20. A method as recited in claim 1, wherein the input region comprises a virtual interface functioning as a keyboard or keypad, the interface divided into individual key regions configured for actuation by members of the set of unique input objects.

21. A method as recited in claim 1, wherein the input region provides a virtual interface functioning as a touchpad or mouse pad.

22. A method as recited in claim 21, wherein two or more reference objects are used to set the location of the key regions, each key region location is set dynamically and in a fixed relation to a corresponding reference object.

23. A method as recited in claim 8, wherein the wherein the step of assigning input symbols or functions to individual fingers is done according to touch typing conventions.

24. A method as recited in claim 8 wherein the input region has more than one mode of input including alphabetic symbols, numeric symbols, special symbols, function keys, cursor control, mouse control, and further comprising the step of identifying with the input module actuation of the input region by an input object to select a mode of input.

25. A method as recited in claim 23, wherein the step of determining the input object comprises determining the posture of the input object.

26. A method as recited in claim 23, wherein the step of determining the location of the actuated key region comprises determining the relative location of the actuation in relation to a reference object.

27. A method as recited in claim 23, wherein an actuation of the input region comprises the step of determining the hands of a user are in a resting posture.

28. A method as recited in claim 1, wherein the input region provides a virtual interface functioning as a touchpad or tablet with enhanced multi-touch support, and further wherein the step of determining an input symbol or function comprises determining a touchpad or tablet input.

29. A method as recited in claim 28, wherein the step of performing remote data acquisition utilizes a single video capturing device.

30. A method as recited in claim 1, further comprising initializing the input region of the data entry device.

31. A method as recited in claim 30, wherein the input region provides a virtual interface, and wherein the location of the virtual interface is established during said initializing of the input region.

32. A method as recited in claim 1, wherein the step of determining an actuation of an input region comprises determining whether one of the unique input objects crossed a threshold, said threshold is visualized as a plane in three dimensional space.

33. A method as recited in claim 32, wherein the step of performing remote data acquisition utilizes a single video capturing device.

34. A data entry device for determining virtual data input, comprising:

an input region having a plurality of key regions accessible by a user of the device for inputting symbols or initiating functions by the data entry device;

a memory unit for storing information associating individual input symbols or functions with key regions, and associations of symbols or functions with unique input objects from a group of unique input objects where each unique input object has a defining feature that differentiates it from other unique input objects of the set;

an input module adapted to remotely acquire data from the input region;

a processor adapted to;

determine from the acquired data an actuation of one of the key regions caused by one of the unique an input objects;

determine from the acquired data at least one parameter of the actuation within the key region;

identify from the acquired data the identity of the unique input object responsible for the actuation; and

determine for the actuated key region an input symbol or function in response to the identification of the unique input object responsible for the actuation.

35. A data entry device as recited in claim 34 further comprising at least two input regions and wherein the input module is adapted to remotely acquire data from two or more regions of the data entry device.

36. A data entry device as recited in claim 35, wherein the location of each input region is set dynamically and in a fixed relation to a reference object.

37. A data entry device as recited in claim 36, wherein the reference object comprises one of:

(a) a user'"'"'s face;

(b) knuckle(s) of a finger;

(c) a user'"'"'s shoulders; and

(d) a user'"'"'s chest.

38. A data entry device as recited in claim 34 further comprising a set of a plurality of input regions each lying in separate parallel planes at different distances from a reference object.

39. A data entry device as recited in claim 34, further comprising a set of a plurality of input regions where the set of input regions are configured to receive input from two or more users, each user assigned to at least one input region.

40. A data entry device as recited in claim 35, wherein each input region is assigned to a corresponding data entry device from a set of two or more data entry devices, and further comprising an output module of each of the first and second data entry devices is adapted to transmit the input symbol or function determined for an actuated input region respectively to its first and second data entry device.

41. A data entry device as recited in claim 34, wherein the set of unique input objects comprises one or more finger(s).

42. A data entry device recited in claim 41, wherein the input module is adapted to remotely acquire data using a single video capturing device.

43. A data entry device as recited in claim 41, wherein the input module is adapted to remotely acquire data using two video capturing devices, comprising:

one of the video capturing devices configured to perform data acquisition for determining that an actuation of the input region has occurred, said video capturing device disposed proximate the input region; and

the other video capturing device or both video capturing devices configured to perform data acquisition for determining at least one actuation parameter within the input region and for identification of the input object set.

44. A data entry device as recited in claim 41, wherein the input module is adapted to remotely acquire depth information using contactless sensors.

45. A data entry device as recited in claim 41, wherein the processor is adapted to identify the defining feature selected from the group consisting of:

(a) size;

(b) shape;

(c) edge;

(d) vein pattern;

(e) nail color;

(f) skin texture;

(g) skin tone, and combinations of the same.

46. A data entry device as recited in claim 41, wherein the processor is adapted to determine the relative location of the actuation in relation to a reference object.

47. A data entry device as recited in claim 46, wherein the reference object comprises one of:

(a) a user'"'"'s face;

(b) knuckle(s) of a finger;

(c) a user'"'"'s shoulders; and

(d) a user'"'"'s chest.

48. A data entry device as recited in claim 46, wherein the reference object comprises one of:

(a) a user'"'"'s hand; and

(b) a palm.

49. A data entry device as recited in claim 41, wherein the processor is adapted to:

determine a location of the actuation; and

determine an input symbol or function for the actuated input region, an input symbol or function associated with the location of actuation and corresponding to the identification of the unique input object responsible for the actuation.

50. A data entry device as recited in claim 41, wherein the set of unique input objects comprises at least two fingers, and wherein the processor is adapted to determine a distance between the two fingers.

51. A data entry device as recited in claim 41, wherein the processor is adapted to:

determine a posture of the unique input object; and

determine an input symbol or function for the actuated input region, an input symbol or function associated with the posture of the input object and corresponding to the identification of the unique input object responsible for the actuation.

52. A data entry device as recited in claim 41, wherein the processor is adapted to:

determine a location of the actuation and a posture of the unique input object responsible for actuation; and

determine an input symbol or function for the actuated input region by determining an input symbol or function associated with the location of actuation as well as the posture and corresponding to the identification the unique input object responsible for the actuation.

53. A data entry device as recited in claim 34, wherein an input region provides a virtual interface configured to function as a touchpad or keyboard.

54. A data entry device as recited in claim 53, wherein a location of the key regions is set based on two or more reference objects, and further wherein the location of each key region is set dynamically and in a fixed relation to a corresponding reference object.

55. A data entry device as recited in claim 53, wherein the associated input symbols and functions are individually assigned to the key regions according to touch typing conventions.

56. A data entry device as recited in claim 55, wherein the associated input symbols and functions comprise special input symbols and functions, and further wherein the processor is adapted to determine an input symbol or function for changing the virtual interface'"'"'s mode of operation to receive said special input symbols and functions.

57. A data entry device as recited in claim 55, wherein the processor is adapted to:

determine a location of the actuated key region by determining a posture of the unique input object responsible for the actuation; and

determine an input symbol or function by determining for the actuated key region an input symbol or function associated with the posture of the unique input object and corresponding to the identification of the unique input object responsible for the actuation.

58. A data entry device as recited in claim 55, wherein the processor is adapted to:

determine the location of the actuated key region by determining a relative location of the actuation in relation to a reference object; and

determine an input symbol or function by determining for the actuated key region an input symbol or function associated with the relative location of the actuation and corresponding to the identification of the unique input object responsible for the actuation.

59. A data entry device as recited in claim 34, wherein an actuation of the input region comprises a resting posture of an the unique set of input objects set, and wherein the processor is adapted to determine an input symbol or function by determining a resting function.

60. A data entry device as recited in claim 34, wherein an input region provides a virtual interface configured to function as a touchpad or tablet with enhanced multi-touch support, and wherein the processor is adapted to determine an input symbol or function by determining a touchpad or tablet input.

61. A data entry device as recited in claim 60, wherein the input module is adapted to remotely acquire data using a single video capturing device.

62. A data entry as recited in claim 34, wherein the processor is further adapted to determine initialization of the input region of the device.

63. A data entry device as recited in claim 62, wherein the input region provides a virtual interface, and wherein the location of the virtual interface is established during a step of initialization.

64. A data entry device as recited in claim 34, wherein the processor is adapted to determine an actuation of the input region by checking whether one of the unique input objects crossed a threshold, said threshold is visualized as a plane in three dimensional space.

65. A data entry device as recited in claim 64, wherein the input module is adapted to remotely acquire data using a single video capturing device.