Method and apparatus for efficient data input

• US 9,152,241 B2
• Filed: 04/26/2007
• Issued: 10/06/2015
• Est. Priority Date: 04/28/2006
• Status: Active Grant

• Current Assignee: AiTech, LLC
• Original Assignee: Zienon LLC
• Inventors: Zlotnicki, Joseph
• Primary Examiner(s): HARRIS, DOROTHY H
• Application Number:
  US11/789,853
• Publication Number:
  US 20070252818A1
• Time in Patent Office: 3,085 Days
• Field of Search: 345/156, 345/168, 345/169, 345/172, 345/173, 341/20, 341/22, 341/28, 382/181, 382/182, 382/185, 715/764, 715/771, 715/772, 715/773, 715/810, 715/811
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting

Abstract

Visual and/or audible cues are used to assist users with data input on keyboards having keys associated with multiple input symbols or functions. Each input symbol or function has a correspondence to an input object, such as a finger. During key actuation, one or more input objects are detected. Candidate input symbols or functions are determined based on identification of the key being actuated. The candidate input symbols or functions are presented to the user in the form of cues having visual and/or audible features. The detected input objects may be optionally identified and presented to the user in the form of cues having visual and/or audible features as well.

Claims

1. A data entry device having at least one output unit and a virtual input unit having a plurality of virtual key regions on a surface having no mechanical or touch-sensitive key structures, the device configured to:

associate a group of symbols or a group of functions with each of a single virtual key region from the plurality of virtual key regions;

define a group of unique input objects with each unique input object having a defining feature that differentiates it from the other unique input objects in the group;

assign to each of the single symbols from the group of symbols or each of the single functions from the group of functions associated with each of the virtual key regions a unique input object from the group of unique input objects;

an optical sensor to identify a virtual key region about to be actuated by an input object to define a candidate key region;

identify and detect with the optical sensor the most probable input object from the group of unique input objects about to actuate the candidate key region;

determine the most probable symbol or function based on the identity of the most probable input object and the candidate key region;

display via the output unit the group of symbols, or a representation of the group of functions, associated with the candidate key region;

apply a visually-perceptible emphasis to the most probable symbol or function to differentiate it from the other symbols or functions in their respective groups;

display via the output unit a visually-perceptible representation of the group of input objects; and

apply a visually-perceptible emphasis to the visually-perceptible representation of the most likely input object to differentiate it from the visually-perceptible representations of other input objects in the group of input objects.

2. The device of claim 1 wherein the step of identifying the most probable input object comprises:

detecting candidate input objects positioned proximate the candidate key region; and

determining the candidate input object most proximate the candidate key region.

3. The device of claim 2 further comprising displaying a representation of the candidate input objects proximate a representation of the key regions to provide real-time information on the position of the candidate input objects relative to that of the key regions.

4. The device of claim 1 wherein the optical sensor comprises at least two cameras.

5. The device of claim 1 wherein the visually perceptible emphasis is selected from the group consisting of:

bold font, italics font, flashing text, shaded text, displaying the most probable input symbol or function in a font different from the remaining input symbols or functions in the group, and displaying the most probable input symbol or function while the remaining input symbols or functions from the group are not displayed.

6. The device of claim 1 wherein the visually perceptible emphasis is selected from the group consisting of:

displaying a certain color, displaying an object of a certain size, displaying a certain shape, flashing an LED of certain brightness, representing the most probable input object as a line of certain color, representing the most probable input object as a line of certain type, representing the most probable input object as a line of certain width, and representing the most probable input object as a flashing line.

7. The method of claim 1, further comprising applying an audibly-perceptible emphasis to the most probably symbol or function.

8. The method of claim 7 wherein the audibly-perceptible feature is selected from the group consisting of:

emitting audio tones of certain loudness, emitting audio tones of certain pitch, emitting audio tones of certain duration, emitting certain musical notes, and rendering certain audio clips or patterns.

9. The device of claim 1 wherein the input objects are fingers.

10. The device of claim 1 wherein the visually-perceptible emphasis is configurable by the user.

11. The device of claim 1 wherein the data entry device is a computing device.

12. The method of claim 7 wherein the electronic device is a musical device.

13. The device of claim 1 further configured to:

provide in the output unit a visual representation of the input object-to-symbol or input object-to-function assignments.

14. A data entry device having at least one output unit and a virtual input unit having a plurality of virtual key regions configured to:

associate a group of symbols with each of a single virtual key region from the plurality of virtual key regions;

assign to each finger of a user having a group of fingers a single symbol from the group of symbols;

an optical sensor positioned remote from the virtual key region to identify a virtual key region about to be actuated by the user to define a candidate key region;

identify and detect with the optical sensor a most probable finger that is about to actuate the candidate key region;

determine the most probable symbol based on the identity of the most probable finger and the candidate key region;

display via the output unit the group of symbols associated with the candidate key region;

apply a visually-perceptible emphasis to the most probable symbol to differentiate it from the display of the other symbols in the group of symbols;

display via the output unit a visually-perceptible representation of the group of fingers; and

apply a visually-perceptible emphasis to the most probable finger to differentiate it from other fingers in the group of fingers.

15. The device of claim 14 wherein the optical sensor is a camera.

16. The device of claim 15 wherein the optical sensor is at least two cameras.

17. The device of claim 14 wherein the visually-perceptible emphasis is selected from the group consisting of:

bold font, italics font, flashing text, shaded text, displaying the most probable symbol in a font different from the other symbols in the group, and displaying the most probable symbol while the other symbols of the group are not displayed.

18. The device of claim 14 wherein the group of fingers includes fingers of a left hand, fingers or a right hand, fingers of both a left hand and a right hand.