Apparatus and method for providing feedback regarding finger placement relative to an input device

• US 20040113956A1
• Filed: 12/12/2002
• Published: 06/17/2004
• Est. Priority Date: 12/12/2002
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Rutkowski, Matthew Francis, Bustelo, Leugim A., Bellwood, Thomas Alexander
• Application Number:
  US10/317,997
• Publication Number:
  US 20040113956A1
• Time in Patent Office: Days
• US Class Current: 345/863
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting
• CPC Class Codes: G09G 2310/04 Partial updating of the display screen
• CPC Class Codes: G09G 5/08 Cursor circuits

Abstract

An apparatus and method for providing visual feedback regarding the positioning of a user'"'"'s fingers relative to an input device are provided. With the apparatus and method, sensors are provided in the input device to sense the proximity of a user'"'"'s fingers to various portions of the input device. In a preferred embodiment, the sensors are positioned in accordance with the portions of the input device that are manipulated by the user, e.g., keys, buttons, trackball, joystick, and/or the like. When the user places his/her fingers in proximity to the input device, various ones of the sensors will detect the presence of the user'"'"'s fingers and provide an output signal that is transmitted to the computing device. The output signals are received by the computing device via an input/output interface. The signals are interpreted by a position determination module which provides information to a display generation module. The display generation module generates a visual representation of the input device with indications of where the user'"'"'s fingers are in relation to the input device, as determined from the interpreted sensor signals. The display may take many forms including a ghost image superimposed over other displayed images, a window in which the input device and finger placement display are depicted.

Claims

1. A method, in a computing device, for providing visual feedback of the position of a portion of a user relative to an input device, comprising:

receiving a signal from a sensor in the input device, the signal being generated based on a presence of a portion of a user within a proximity of the sensor;

determining a key of the input device corresponding to the sensor from which the signal is received;

generating a visual representation of the input device based on the determination of the key of the input device; and

outputting the visual representation of the input device to a display device, wherein the sensor detects the presence of the portion of the user prior to the user operating the key of the input device.

2. The method of claim 1, wherein the sensor include is one of a fiber optic sensor, an electromechanical sensor, a pressure sensor, and a heat sensor.

3. The method of claim 1, wherein the visual representation includes at least one of a windowed graphical display of a key of the input device, a graphical representation of a key of the input device at a predetermined position on a graphical display output on the display device, and a superimposed image of a key of the input device on the display device.

4. The method of claim 1, wherein determining the key of the input device corresponding to the sensor includes using a key/button map to identify a key/button associated with the sensor.

5. The method of claim 4, wherein the key/button map is specific for a currently active application.

6. The method of claim 1, wherein the input device is one of a keyboard, computer mouse, trackball device, gamepad, touchpad, and a game controller.

7. The method of claim 1, wherein the visual representation includes indications of the position of a user'"'"'s fingers in relation to the input device.

8. The method of claim 1, wherein determining a key of the input device corresponding to the sensor from which the signal is received, generating a visual representation of the input device, and outputting the visual representation of the input device are performed by a device driver.

9. The method of claim 1, wherein determining a key of the input device corresponding to the sensor from which the signal is received includes:

determining if a signal level of the signal is above a required threshold signal level.

10. The method of claim 1, further comprising:

determining if there is a period of no signal being received from any sensor in the input device, wherein the visual representation of the input device is output only when there is a period of no signal being received prior to receiving the signal from the sensor.

11. A computer program product for providing visual feedback of the position of a portion of a user relative to an input device, comprising:

first instructions for receiving a signal from a sensor in the input device, the signal being generated based on a presence of a portion of a user within a proximity of the sensor;

second instructions for determining a key of the input device corresponding to the sensor from which the signal is received;

third instructions for generating a visual representation of the input device based on the determination of the key of the input device; and

fourth instructions for outputting the visual representation of the input device to a display device, wherein the sensor detects the presence of the portion of the user prior to the user operating the key of the input device.

12. The computer program product of claim 11, wherein the visual representation includes at least one of a windowed graphical display of a key of the input device, a graphical representation of a key of the input device at a predetermined position on a graphical display output on the display device, and a superimposed image of a key of the input device on the display device.

13. The computer program product of claim 11, wherein the second instructions for determining the key of the input device corresponding to the sensor include instructions for using a key/button map to identify a key/button associated with the sensor.

14. The computer program product of claim 13, wherein the key/button map is specific for a currently active application.

15. The computer program product of claim 11, wherein the visual representation includes indications of the position of a user'"'"'s fingers in relation to the input device.

16. The computer program product of claim 11, further comprising:

fifth instructions for receiving at least one operational parameter; and

sixth instructions for controlling at least one of determining the key of the input device corresponding to the sensor and generating the visual representation of the input device based on the at least one operational parameter.

17. The computer program product of claim 11, wherein the second instructions for determining a key of the input device corresponding to the sensor from which the signal is received include:

instructions for determining if a signal level of the signal is above a required threshold signal level.

18. The computer program product of claim 16, wherein the at least one operational parameter includes an operational parameter identifying at least one of a type of visual representation and a position of the visual representation on a display device.

19. The computer program product of claim 11, further comprising:

fifth instructions for determining if there is a period of no signal being received from any sensor in the input device, wherein the visual representation of the input device is output only when there is a period of no signal being received prior to receiving the signal from the sensor.

20. An apparatus for providing visual feedback of the position of a portion of a user relative to an input device, comprising:

means for receiving a signal from a sensor in the input device, the signal being generated based on a presence of a portion of a user within a proximity of the sensor;

means for determining a key of the input device corresponding to the sensor from which the signal is received;

means for generating a visual representation of the input device based on the determination of the key of the input device; and

means for outputting the visual representation of the input device to a display device, wherein the sensor detects the presence of the portion of the user prior to the user operating the key of the input device.

21. A system, comprising:

A computing device; and

an input device, coupled to the computing device, having a sensor for detecting the presence of a portion of a user within a proximity of the sensor, wherein the sensor provides a signal to the computing device indicative of the presence of a portion of the user within proximity of the sensor, and wherein the computing device determines a key of the input device corresponding to the sensor and outputs a visual representation of the input device based on the determination of the key of the input device.

22. The system of claim 21, wherein the sensor include is one of a fiber optic sensor, an electromechanical sensor, a pressure sensor, and a heat sensor.

23. The system of claim 21, wherein the input device is one of a keyboard, computer mouse, trackball device, gamepad, touchpad, and a game controller.

24. The system of claim 21, wherein a device driver for the input device resident in the computing device is used to determine a key of the input device corresponding to the sensor from which the signal is received and output the visual representation of the input device.

25. An input device for use with a computing device, comprising:

one or more user manipulatable keys;

one or more sensors positioned in association with the one or more user manipulatable keys; and

a coupling mechanism for coupling the input device to the computing device, wherein the one or more sensors are configured to detect the presence of a portion of a user within a proximity of the one or more sensors prior to the user operating the associated key of the input device, and wherein the one or more sensors send a signal indicative of the presence of a portion of a user to the computing device via the coupling mechanism.