Enabling data entry based on differentiated input objects

• US 9,122,316 B2
• Filed: 09/19/2013
• Issued: 09/01/2015
• Est. Priority Date: 02/23/2005
• Status: Active Grant

• Current Assignee: AiTech, LLC
• Original Assignee: Zienon LLC
• Inventors: Li, Dong Ge
• Primary Examiner(s): CERULLO, LILIANA P
• Application Number:
  US14/031,412
• Publication Number:
  US 20140015757A1
• Time in Patent Office: 712 Days
• Field of Search: 345168-178, 715/773, 715/863
• US Class Current: 1/1
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

Methods and apparatus for facilitating virtual input in devices that differentiates input objects are provided. Various methods for automatically configuring component settings and features of such devices are described. Changes in the component settings of the device and the corresponding operational characteristics of the device that triggered said changes may be grouped into profiles and selected by users. The component settings may include useful assisting features such as additional lighting provide by a LED and illuminated visual guides of the virtual input interface projected by a laser or LED. The characteristics of such assisting features may be modified dynamically in response to changes in the state of a reference object.

Claims

1. A method of configuring component settings of a virtual input device having a virtual input region having a plurality key regions on a surface having no mechanical or touch-sensitive key structures for inputting associated symbols and functions, comprising:

providing an input module in a position remote from the virtual input region and performing with the input module data acquisition of the virtual input region to determine the position of a unique input object from a group of unique input objects controlled by a user of the device;

assigning to at least two key regions of the plurality of key regions two or more symbols or functions;

assigning a unique input object to each of the two or more symbols or functions assigned to each of the at least two key regions;

providing a processor and, with the processor;

determining from the data acquisition an actuation of one of the at least two key regions to determine a struck key by one of the unique input objects, and

identifying the unique input object from the group of unique input objects to determine a single symbol or function from the two or more symbols or functions associated with the struck key to determine a desired symbol or function for output;

providing an input assist module and providing with the input assist module input assisting features;

providing a configuration module and, with the configuration module;

determining a change in an operational characteristic of the device; and

changing one or more of the device'"'"'s component settings in response to the step of determining of a change; and

providing an output module and outputting with the output module the desired symbol or function.

2. A method as recited in claim 1, wherein said unique input objects comprise said user'"'"'s fingers.

3. A method as recited in claim 1, wherein said operational characteristic includes environmental operating conditions of the device.

4. A method as recited in claim 1, wherein the change in an operational characteristic of the device comprises a user-initiated configuration of at least one component setting of the device, said user-initiated configuration includes one or more of:

(a) launching an input software application, (b) making a particular gesture within the input region using at least one input object, and (c) selecting a profile comprising a combination of particular operational characteristics and particular component settings of said device.

5. A method as recited in claim 1, wherein the change in an operational characteristic of the device comprises a user-initiated configuration of a swivel video capturing device coupled to the virtual input device as the input module, said user-initiated configuration includes one or more of:

(a) rotating said video capturing device, (b) adjusting the focus of said video capturing device, (c) adjusting the view angle of said video capturing device, and (d) adjusting the pointing of said video capturing device.

6. A method as recited in claim 1, wherein said component settings of the device include one or more of:

(a) focus of a video capturing device coupled to the device as the input module, (b) view angle of a video capturing device coupled to the device as the input module, (c) pointing of a video capturing device coupled to the device as the input module, and (d) activation of the input module coupled to the device.

7. A method as recited in claim 1, wherein changing said component settings of the device include the activation or de-activation of at least one input assisting feature of the input assist module.

8. A method as recited in claim 7, wherein the step of determining a change in an operational characteristic of the device comprises determining from the data acquisition a gesture made with at least one input object to activate or de-activate said input assisting feature.

9. A method as recited in claim 7, wherein said input assisting feature includes illumination of the input region provided by a light source of the device.

10. A method as recited in claim 9, wherein the step of determining a change in an operational characteristic of the device comprises determining a change in the device'"'"'s environmental lighting conditions during operation, and wherein the step of changing one or more of the component settings comprises activating or de-activating said light source of the device.

11. A method as recited in claim 1, wherein said input module further provides a keyboard interface in the virtual input region for user input, and wherein said keyboard interface is divided into sections, and further wherein the step of changing one or more component settings comprises dynamically modifying the characteristics of the individual sections of the keyboard interface in response to a change in the state of at least one reference object as determined from the data acquisition.

12. A method as recited in claim 11, wherein the step of dynamically modifying the characteristics of said individual sections of the keyboard interface comprises dynamically modifying the location of a keyboard section in response to a change in the location of the user'"'"'s reference palm or knuckles.

13. A method as recited in claim 11, wherein the step of dynamically modifying the characteristics of said individual sections of the keyboard interface comprises dynamically modifying the orientation of a keyboard section in response to a change in the orientation of the user'"'"'s reference palm or knuckles.

14. A method as recited in claim 11, wherein the step of dynamically modifying the characteristics of said individual sections of the keyboard interface comprises dynamically modifying one or more of:

spacing between key regions in a keyboard section; and

size of a keyboard section;

in response to a change in one or more of;

spread of the user'"'"'s reference finger;

size of the user'"'"'s reference hand; and

size of the user'"'"'s reference finger.

15. A method as recited in claim 1, wherein said input assisting feature includes projecting from the input assist module an illuminated visual guide in the virtual input region.

16. A method as recited in claim 15, wherein said visual guide includes one or more of:

(a) an illuminated point in the virtual input region to indicate the center of a virtual input interface, (b) an illuminated line in the virtual input region to indicate the center row of a virtual keyboard interface, and (c) an illuminated outline in the virtual input region to indicate the boundaries of a virtual input interface.

17. A method as recited in claim 15, wherein said visual guide comprise an illuminated virtual keyboard interface, and further wherein the step of changing one or more component settings comprises modifying dynamically the location of said keyboard interface in response to a change in the location of the user'"'"'s reference palm or knuckles.

18. A method as recited in claim 15, wherein said visual guide comprise an illuminated virtual keyboard interface, and further wherein the step of changing one or more component settings comprises modifying dynamically the orientation of said keyboard interface in response to a change in the orientation of the user'"'"'s reference palm or knuckles.

19. A method as recited in claim 15, wherein said visual guide comprise an illuminated virtual keyboard interface, and further wherein the step of changing one or more component settings comprises modifying dynamically one or more of:

spacing between key regions in the keyboard interface; and

size of the keyboard interface;

in response to a change in one or more of;

spread of the user'"'"'s reference finger;

size of the user'"'"'s reference hand; and

size of the user'"'"'s reference finger.

20. A method as recited in claim 1, wherein the step of changing one or more component settings comprises one or more of:

(a) automatically disabling at least one assisting feature after a period of time;

(b) enabling or disabling at least one assisting feature upon detecting within the input region a particular gesture made with an input object;

(c) enabling at least one assisting feature when an input object is detected within the input region; and

(d) briefly enabling at least one assisting feature when input objects are no longer detected within the input region.

21. A method as recited in claim 20, wherein said assisting features comprise at least one of:

(a) illumination of the input region provided by a light source of the device, and (b) illuminated visual guide for a virtual input interface projected in the input region.

22. An apparatus for configuring component settings of a virtual input device having a virtual input region having a plurality of key regions on a surface having no mechanical or touch-sensitive key structures, comprising:

a memory module adapted to store information associating at least two different input symbols or functions with each of two key regions of the plurality of key regions, wherein each of the at least two different symbols or functions associated with each of the two key regions are individually assigned to a unique input object from a group of unique input objects controlled by a user of the device;

an input module adapted to perform remote data acquisition of the virtual input region to determine the position of input objects in the virtual input region;

a processor adapted to determine from the data acquisition an actuation of one of the at least two key regions to determine a struck key;

determine a single symbol or function from the two or more symbols or functions associated with the struck key to determine a desired symbol or function for output;

an input assist module adapted to provide input assisting features;

a configuration module adapted to determine a change in an operational characteristic of the device and to change one or more of the device'"'"'s component settings in response to the change determined; and

an output module adapted to output the desired symbol or function.

23. An apparatus as recited in claim 22, wherein said input objects comprise said user'"'"'s fingers.

24. An apparatus as recited in claim 22, wherein said operational characteristic includes environmental operating conditions of the device.

25. An apparatus as recited in claim 22, wherein the change in an operational characteristic of the device comprises a user-initiated configuration of at least one component setting of the device, said user-initiated configuration includes one or more of:

(a) launching an input software application, (b) making a particular gesture within the input region using at least one input object, and (c) selecting a profile comprising a combination of particular operational characteristics and particular component settings of said device.

26. An apparatus as recited in claim 22, wherein the change in an operational characteristic of the device comprises a user-initiated configuration of a swivel video capturing device coupled to the virtual input device as the input module, said user-initiated configuration includes one or more of:

(a) rotating said video capturing device, (b) adjusting the focus of said video capturing device, (c) adjusting the view angle of said video capturing device, and (d) adjusting the pointing of said video capturing device.

27. An apparatus as recited in claim 22, wherein said component settings of the device include one or more of:

(a) focus of a video capturing device coupled to the device as the input module, (b) view angle of a video capturing device coupled to the device as the input module, (c) pointing of a video capturing device coupled to the device as the input module, and (d) activation of the input module coupled to the device.

28. An apparatus as recited in claim 22, wherein said configuration module is adapted to change one or more of the component settings by activating or de-activating at least one input assisting feature of the input assist module.

29. An apparatus as recited in claim 28, wherein the configuration module is adapted to determine a change in an operational characteristic by determining from the data acquisition a gesture made with at least one input object to activate or de-activate said input assisting feature.

30. An apparatus as recited in claim 28, wherein said input assisting feature includes illumination of the input region provided by a light source of the device.

31. An apparatus as recited in claim 30, wherein the configuration module is adapted to determine a change in an operational characteristic and to change one or more of the component settings by determining a change in the device'"'"'s environmental lighting conditions during operation and activating or de-activating said light source of the device in response.

32. An apparatus as recited in claim 22, wherein said input module is further adapted to provide a keyboard interface in the virtual input region for user input, and wherein said keyboard interface is divided into sections, and further wherein the configuration module is adapted to change one or more of the component settings by dynamically modifying the characteristics of the individual sections of the keyboard interface in response to a change in the state of at least one reference object as determined from the data acquisition.

33. An apparatus as recited in claim 32, wherein the configuration module modifies the characteristics of said individual sections of the keyboard interface by dynamically modifying the location of a keyboard section in response to a change in the location of the user'"'"'s reference palm or knuckles.

34. An apparatus as recited in claim 32, wherein the configuration module modifies the characteristics of said individual sections of the keyboard interface by dynamically modifying the orientation of a keyboard section in response to a change in the orientation of the user'"'"'s reference palm or knuckles.

35. An apparatus as recited in claim 32, wherein the configuration module dynamically modifies the characteristics of said individual sections of the keyboard interface by dynamically modifying one or more of:

spacing between key regions in a keyboard section; and

size of a keyboard section;

in response to a change in one or more of;

spread of the user'"'"'s reference finger;

size of the user'"'"'s reference hand; and

size of the user'"'"'s reference finger.

36. An apparatus as recited in claim 32, wherein said input assisting feature includes projecting from the input assist module an illuminated visual guide in the virtual input region.

37. An apparatus as recited in claim 36, wherein said visual guide includes one of:

(a) an illuminated point in the input region to indicate the center of a virtual input interface, (b) an illuminated line in the input region to indicate the center row of a virtual keyboard interface, and (c) an illuminated outline in the input region to indicate the boundaries of a virtual input interface.

38. An apparatus as recited in claim 36, wherein said visual guide comprise an illuminated virtual keyboard interface, and further wherein the configuration module is adapted to modify one or more component settings by modifying dynamically the location of said keyboard interface in response to a change in the location of a user'"'"'s reference palm or knuckles.

39. An apparatus as recited in claim 36, wherein said visual guide comprise an illuminated virtual keyboard interface, and further wherein the configuration module is adapted to modify one or more component settings by modifying dynamically the orientation of said keyboard interface in response to a change in the orientation of a user'"'"'s reference palm or knuckles.

40. An apparatus as recited in claim 36, wherein said visual guide comprise an illuminated virtual keyboard interface, and further wherein the configuration module is adapted to modify one or more component settings by modifying dynamically one or more of:

spacing between key regions in the keyboard interface; and

size of the keyboard interface;

in response to a change in one or more of;

spread of the user'"'"'s reference finger;

size of the user'"'"'s reference hand; and

size of the user'"'"'s reference finger.

41. An apparatus as recited in claim 22, wherein the configuration module is adapted to change one or more component settings by:

(a) automatically disabling at least one assisting feature after a period of time;

(b) enabling or disabling at least one assisting feature upon detecting within the input region a particular gesture made with an input object;

(c) enabling at least one assisting feature when an input object is detected within the input region; and

(d) briefly enabling at least one assisting feature when input objects are no longer detected within the input region.

42. An apparatus as recited in claim 41, wherein said assisting features comprise at least one of:

(a) illumination of the input region provided by a light source of the device, and (b) illuminated visual guide for a virtual input interface projected in the input region.