METHOD AND APPARATUS FOR DATA ENTRY INPUT

• US 20100231522A1
• Filed: 05/26/2010
• Published: 09/16/2010
• Est. Priority Date: 02/23/2005
• Status: Active Grant

• Current Assignee: Zienon LLC
• Original Assignee: Zienon LLC
• Inventors: Li, Dong Ge
• Granted Patent: US 9,760,214 B2
• Time in Patent Office: Days
• US Class Current: 345/169
• CPC Class Codes: G06F 3/0423 using sweeping light beams, e.g. using rotating or vibrating mirror
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A method and apparatus for inputting data for an electronic data entry device are provided. In one embodiment, identification of an input object such as the particular fingers of a user that are used to actuate a key region is performed. The symbol associated with the actuated key region and the finger (or other input object) used is determined. In other embodiments, virtual input devices with interfaces such as QWERTY style keyboards, phone keypads, and multi-touch capable touchpads or tablets are provided in input regions. One or more video capturing devices remotely acquire actuation information from the input regions during data entry. User inputted symbols or functions are determined based on the actuations, their locations and identified input object sets that caused the actuations.

Claims

1. A method of determining virtual input at a data entry device, comprising:

associating an input symbol or function with a corresponding actuation parameter of an input region of the data entry device;

assigning the input symbol or function to a corresponding input object set from a group of input objects;

providing an input module and performing with the input module remote data acquisition of at least one input region of the data entry device;

providing a processor of the device and, with the processor;

determining from the data acquisition an actuation of an input region caused by an input object set;

determining from the data acquisition at least one parameter of the actuation within the input region;

identifying from the data acquisition the input object set from the group of input objects; and

determining for the actuated input region an input symbol or function associated with the parameter of actuation and corresponding to the identification of the input object set.

2. A method as recited in claim 1, wherein the step of performing remote data acquisition comprises performing remote data acquisition on two or more input regions of the data entry device.

3. A method as recited in claim 2, wherein the location of each input region is set dynamically and in a fixed relation to a reference object.

4. A method as recited in claim 3, wherein the reference object comprises one of:

(a) a user'"'"'s face;

(b) knuckle(s) of a finger;

(c) a user'"'"'s shoulders; and

(d) a user'"'"'s chest.

5. A method as recited in claim 2, wherein a set of multiple input regions of the data entry device lies in separate parallel planes at different distances from a reference object.

6. A method as recited in claim 2, wherein a set of multiple input regions of the data entry device is configured to receive input from two or more users, each user assigned to at least one input region.

7. A method as recited in claim 1, further comprising:

assigning each input region to a corresponding receiving device from a set of two or more receiving devices; and

providing an output module of the data entry device and, with the output module, transmitting the input symbol or function determined for an actuated input region to its assigned receiving device.

8. A method as recited in claim 1, wherein the input object set comprises one or more finger(s).

9. A method as recited in claim 8, wherein the step of performing remote data acquisition utilizes a single video capturing device.

10. A method as recited in claim 8, wherein the step of performing remote data acquisition utilizes two video capturing devices, comprising:

utilizing one of the video capturing devices to perform data acquisition for determining that an actuation of the input region has occurred, said video capturing device disposed proximate the input region; and

utilizing the other video capturing device or both video capturing devices to perform data acquisition for determining at least one actuation parameter within the input region and for identification of the input object set.

11. A method as recited in claim 8, wherein the step of performing remote data acquisition utilizes contactless sensors configured to acquire depth information.

12. A method as recited in claim 8, wherein the step of identifying the input object set utilizes one or more of the following features:

(a) size;

(b) shape;

(c) edge;

(d) vein pattern;

(e) nail color;

(f) skin texture; and

(g) skin tone.

13. A method as recited in claim 8, wherein the step of determining at least one parameter of the actuation comprises determining the relative location of the actuation in relation to a reference object.

14. A method as recited in claim 13, wherein the reference object comprises one of:

(a) a user'"'"'s face;

(b) knuckle(s) of a finger;

(c) a user'"'"'s shoulders; and

(d) a user'"'"'s chest.

15. A method as recited in claim 13, wherein the reference object comprises one of:

(a) a user'"'"'s hand; and

(b) a palm.

16. A method as recited in claim 8, wherein the step of determining at least one parameter of the actuation within the input region comprises determining the location of the actuation, and wherein the step of determining an input symbol or function comprises determining for the actuated input region an input symbol or function associated with the location of actuation and corresponding to the identification of the input object set.

17. A method as recited in claim 8, wherein the input object set comprises at least two fingers, and wherein the step of determining at least one parameter of the actuation includes determining the relative location between the fingers.

18. A method as recited in claim 8, wherein the step of determining at least one parameter of the actuation within the input region comprises determining the posture of the input object set, and wherein the step of determining an input symbol or function comprises determining for the actuated input region an input symbol or function associated with the posture of the input object set and corresponding to the identification of the input object set.

19. A method as recited in claim 8, wherein the step of determining at least one parameter of the actuation within the input region comprises determining the location of the actuation and the posture of the input object set, and wherein the step of determining an input symbol or function comprises determining for the actuated input region an input symbol or function associated with the location of actuation as well as the posture of the input object set and corresponding to the identification of the input object set.

20. A method as recited in claim 8, wherein an input region provides a virtual interface functioning as a keyboard or keypad, the interface divided into individual key regions configured for actuation by input object sets, and wherein the actuation parameters of said input region comprises the individual locations of key region actuation, further wherein:

the step of associating an input symbol or function with a corresponding actuation parameter of an input region comprises associating the input symbol or function with a corresponding location of key region actuation;

the step of determining parameters of the actuation within the input region comprises deter mining the location of a key region actuated by an input object set, and

the step of determining an input symbol or function comprises determining for the actuated key region an input symbol or function associated with the actuated key region and corresponding to the identification of the input object set.

21. A method as recited in claim 1, wherein an input region provides a virtual interface functioning as a touchpad or keyboard, and wherein particular parameters of actuation and/or input object sets are assigned to touchpad or keyboard input symbols and functions, and further wherein the in the step of determining an input symbol or function comprises determining a corresponding touchpad or keyboard input.

22. A method as recited in claim 1, wherein two or more reference objects are used to set the location of key regions, each key region location is set dynamically and in a fixed relation to a corresponding reference object.

23. A method as recited in claim 1, wherein the associated input symbols and functions are individually assigned to a corresponding input object set according to conventional touch typing methods.

24. A method as recited in claim 23, wherein the associated input symbols and functions comprise special input symbols and functions, and further wherein the step of determining an input symbol or function comprises determining an input function for changing the virtual interface'"'"'s mode of operation to receive said special input symbols and functions.

25. A method as recited in claim 23, wherein the determination of the location of the actuated key region comprises determining the posture of the input object set, and wherein the step of determining an input symbol or function comprises determining for the actuated key region an input symbol or function associated with the posture of the input object set and corresponding to the identification of the input object set.

26. A method as recited in claim 23, wherein the determination of the location of the actuated key region comprises determining the relative location of the actuation in relation to a reference object, and wherein the step of determining an input symbol or function comprises determining for the actuated key region an input symbol or function associated with the relative location of the actuation and corresponding to the identification of the input object set.

27. A method as recited in claim 20, wherein an actuation of the input region comprises a resting posture of an input object set, and wherein the step of determining an input symbol or function comprises determining a resting function.

28. A method as recited in claim 1, wherein an input region provides a virtual interface functioning as a touchpad or tablet with enhanced multi-touch support, and further wherein the step of determining an input symbol or function comprises determining a touchpad or tablet input.

29. A method as recited in claim 28, wherein the step of performing remote data acquisition utilizes a single video capturing device.

30. A method as recited in claim 1, further comprising initializing an input region of the data entry device.

31. A method as recited in claim 30, wherein the input region provides a virtual interface, and wherein the location of the virtual interface is established during said initializing of the input region.

32. A method as recited in claim 1, wherein an input region provides a virtual interface, and wherein the step of determining an input symbol or function comprises determining an input function for changing the virtual interface'"'"'s input mode of operation.

33. A method as recited in claim 1, wherein the step of determining an actuation of an input region comprises checking whether an input object set crossed a threshold, said threshold is visualized as a plane in three dimensional space.

34. A method as recited in claim 33, wherein the step of performing remote data acquisition utilizes a single video capturing device.

35. A data entry device for determining virtual input, comprising:

a memory unit adapted to store information associating individual input symbols or functions with corresponding actuation parameters of an input region of the device, wherein the input symbols or functions are assigned to corresponding input object sets from a group of input objects;

an input module adapted to remotely acquire data from at least one input region of the data entry device;

a processor adapted to;

determine from the acquired data an actuation of an input region caused by an input object set;

determine from the acquired data at least one parameter of the actuation within the region;

identify from the acquired data the input object set from the group of input objects; and

determine for the actuated input region an input symbol or function associated with the parameter of actuation and corresponding to the identification of the input object set.

36. A data entry device as recited in claim 35, wherein the input module is adapted to remotely acquire data from two or more input regions of the data entry device.

37. A data entry device as recited in claim 36, wherein the location of each input region is set dynamically and in a fixed relation to a reference object.

38. A data entry device as recited in claim 37, wherein the reference object comprises one of:

(a) a user'"'"'s face;

(b) knuckle(s) of a finger;

(c) a user'"'"'s shoulders; and

(d) a user'"'"'s chest.

39. A data entry device as recited in claim 35, wherein a set of multiple input regions of the data entry device lies in separate parallel planes at different distances from a reference object.

40. A data entry device as recited in claim 35, wherein a set of multiple input regions of the data entry device is configured to receive input from two or more users, each user assigned to at least one region.

41. A data entry device as recited in claim 36, wherein each input region is assigned to a corresponding receiving device from a set of two or more receiving devices, and wherein an output module of the data entry device is adapted to transmit the input symbol or function determined for an actuated input region to its assigned receiving device.

42. A data entry device as recited in claim 35, wherein the input object set comprises one or more finger(s).

43. A data entry device recited in claim 42, wherein the input module is adapted to remotely acquire data using a single video capturing device.

44. A data entry device as recited in claim 42, wherein the input module is adapted to remotely acquire data using two video capturing devices, comprising:

one of the video capturing devices configured to perform data acquisition for determining that an actuation of the input region has occurred, said video capturing device disposed proximate the input region; and

the other video capturing device or both video capturing devices configured to perform data acquisition for determining at least one actuation parameter within the input region and for identification of the input object set.

45. A data entry device as recited in claim 42, wherein the input module is adapted to remotely acquire depth information using contactless sensors.

46. A data entry device as recited in claim 42, wherein the processor is adapted to identify the input object set using one or more of the following features:

(a) size;

(b) shape;

(c) edge;

(d) vein pattern;

(e) nail color;

(f) skin texture; and

(g) skin tone.

47. A data entry device as recited in claim 42, wherein the processor is adapted to determine at least one parameter of the actuation by determining the relative location of the actuation in relation to a reference object.

48. A data entry device as recited in claim 47, wherein the reference object comprises one of:

(a) a user'"'"'s face;

(b) knuckle(s) of a finger;

(c) a user'"'"'s shoulders; and

(d) a user'"'"'s chest.

49. A data entry device as recited in claim 47, wherein the reference object comprises one of:

(a) a user'"'"'s hand; and

(b) a palm.

50. A data entry device as recited in claim 42, wherein the processor is adapted to:

determine at least one parameter of the actuation by determining the location of the actuation; and

determine an input symbol or function for the actuated input region an input symbol or function associated with the location of actuation and corresponding to the identification of the input object set.

51. A data entry device as recited in claim 42, wherein the input object set comprises at least two fingers, and wherein the processor is adapted to determine at least one parameter of the actuation, said parameter includes the relative location between the fingers.

52. A data entry device as recited in claim 42, wherein the processor is adapted to:

determine at least one parameter of the actuation by determining the posture of the input object set; and

determine an input symbol or function for the actuated input region an input symbol or function associated with the posture of the input object set and corresponding to the identification of the input object set.

53. A data entry device as recited in claim 42, wherein the processor is adapted to:

determine at least one parameter of the actuation by determining the location of the actuation and the posture of the input object set; and

determine an input symbol or function for the actuated input region by determining an input symbol or function associated with the location of actuation as well as the posture of the input object set and corresponding to the identification the input object set.

54. A data entry device as recited in claim 42, wherein an input region provides a virtual interface configured to function as a keyboard or keypad, the interface divided into individual key regions configured for actuation by input object sets, and wherein the actuation parameters of said input region comprises the individual locations of key region actuation within said input region, and further wherein:

the memory unit is adapted to store information associating the input symbols or functions with corresponding locations of key region actuation, wherein the input symbols or functions are assigned to corresponding input object sets from a group of input objects;

the processor is adapted to;

determine the parameters of the actuation by determining the location of a key region actuated by the input object set; and

determine for the actuated key region an input symbol or function by determining an input symbol or function associated with the actuated key region and corresponding to the identification of the input object set

55. A data entry device as recited in claim 35, wherein an input region provides a virtual interface configured to function as a touchpad or keyboard, and wherein parameters of actuation and/or input object sets are assigned to touchpad or keyboard input symbols and functions, and further wherein the processor is adapted to determine an input symbol or function by determining a corresponding touchpad or keyboard input.

56. A data entry device as recited in claim 54, wherein the location of key regions is set based on two or more reference objects, and further wherein the location of each key region is set dynamically and in a fixed relation to a corresponding reference object.

57. A data entry device as recited in claim 54, wherein the associated input symbols and functions are individually assigned to a corresponding input object set according to conventional touch typing methods.

58. An apparatus as recited in claim 57, wherein the associated input symbols and functions comprise special input symbols and functions, and further wherein the processor is adapted to determine an input symbol or function for changing the virtual interface'"'"'s mode of operation to receive said special input symbols and functions.

59. A data entry device as recited in claim 57, wherein the processor is adapted to:

determine the location of the actuated key region by determining the posture of the input object set; and

determine an input symbol or function by determining for the actuated key region an input symbol or function associated with the posture of the input object set and corresponding to the identification of the input object set.

60. A data entry device as recited in claim 57, wherein the processor is adapted to:

determine the location of the actuated key region by determining the relative location of the actuation in relation to a reference object; and

determine an input symbol or function by determining for the actuated key region an input symbol or function associated with the relative location of the actuation and corresponding to the identification of the input object set.

61. A data entry device as recited in claim 35, wherein an actuation of the input region comprises a resting posture of an input object set, and wherein the processor is adapted to determine an input symbol or function by determining a resting function.

62. A data entry device as recited in claim 35, wherein an input region provides a virtual interface configured to function as a touchpad or tablet with enhanced multi-touch support, and wherein the processor is adapted to determine an input symbol or function by determining a touchpad or tablet input.

63. A data entry device as recited in claim 62, wherein the input module is adapted to remotely acquire data using a single video capturing device.

64. A data entry as recited in claim 35, wherein the processor is further adapted to determine initialization of an input region of the device.

65. A data entry device as recited in claim 64, wherein the input region provides a virtual interface, and wherein the location of the virtual interface is established during said initialization.

66. A data entry device as recited in claim 35, wherein an input region provides a virtual interface, and wherein the processor is adapted to determine an input symbol or function by determining an input function for changing the virtual interface'"'"'s input mode of operation.

67. A data entry device as recited in claim 35, wherein the processor is adapted to determine an actuation of an input region by checking whether an input object set crossed a threshold, said threshold is visualized as a plane in three dimensional space.

68. A data entry device as recited in claim 67, wherein the input module is adapted to remotely acquire data using a single video capturing device.