Tongue-operated input device for control of electronic systems

• US 7,995,031 B2
• Filed: 06/10/2004
• Issued: 08/09/2011
• Est. Priority Date: 04/07/2003
• Status: Active Grant

• Current Assignee: University of Delaware
• Original Assignee: University of Delaware
• Inventors: Manal, Kurt
• Primary Examiner(s): NGUYEN, KIMNHUNG T
• Application Number:
  US10/864,491
• Publication Number:
  US 20050275620A1
• Time in Patent Office: 2,616 Days
• Field of Search: 345156-158, 825/19, 340/825.19, 600/549, 600/590, 600/593
• US Class Current: 345/157
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34

Abstract

A method and apparatus for tongue-operated control of an electronic system is presented. The apparatus includes a sensor-mounting device secured in the mouth, a sensor that interfaces to the tongue and a sensor interface device that converts sensor outputs to sensor signals proportional to a measure of the interface of the tongue to the sensor, computes control signals from a vector sum of sensor signals, and couples either control signals or sensor signals to the electronic system by cable, radio frequency or infrared transmission.

Claims

1. An apparatus for tongue-operated control of an electronic system, the apparatus comprising:

a sensor-mounting device configured to reside in a user'"'"'s mouth;

one or more sensors mounted on the sensor-mounting device and configured to interface with a user'"'"'s tongue; and

a sensor interface device configured to convert information from the sensors into control signals, connect the apparatus to the electronic system, and communicate the control signals to the electronic system, the sensor interface device configured to measure sensor signal voltages from each sensor;

compare the sensor signal voltages with a predetermined threshold value;

compute a vector sum using sensor signal voltages that exceed the predetermined threshold values;

determine magnitude data and angle data corresponding to said vector sum;

generate control signals indicative of a rate related to the magnitude data and a direction related to the angle data; and

transmit the control signals for control of the electronic system.

2. The apparatus of claim 1, wherein the sensor-mounting device comprises a dental retainer or a mouthguard.

3. The apparatus of claim 1, wherein the sensor interface device comprises a wired connection for transmitting control signals to the electronic system.

4. The apparatus of claim 1, wherein the sensor interface device comprises a wireless connection for transmitting control signals to the electronic system.

5. The apparatus of claim 4, wherein the wireless connection comprises a radio frequency communications device or an infrared signal communications device.

6. A system for controlling an electronic system, the system comprising:

the electronic system; and

the tongue-operated controller of claim 1 in communication with the electronic system.

7. The system of claim 6, wherein the sensor interface device resides at least in part with the sensor-mounting device.

8. The system of claim 6, wherein the sensor interface device resides at least in part with the electronic system.

9. The system of claim 6, wherein the electronic system comprises a computer or a motorized wheelchair.

10. The apparatus of claim 1, wherein the sensor-mounting device is a mouthpiece.

11. The apparatus of claim 1, wherein the apparatus is configured to allow the user to select one or more regions of the one or more sensors as an indication of a desired rate and direction of movement for control of the electronic system.

12. The apparatus of claim 1, wherein the one or more sensors are selected from the group consisting of:

pressure sensors, temperature sensors, and a single surface sensing device comprising a 2-dimensional array of miniature sensors.

13. The apparatus of claim 1, wherein the one or more sensors comprises one or more protrusions from the sensor-mounting device.

14. The apparatus of claim 1, wherein the one or more sensors comprises four protrusions from the sensor-mounting device, each protrusion representing one of the four primary directions.

15. The apparatus of claim 1, wherein the sensor interface device is located on the sensor-mounting device.

16. The apparatus of claim 1, wherein the one or more sensors comprise non-joystick sensors mounted on a single surface, the one or more sensors operative by selection of one or more regions of the surface by the user'"'"'s tongue, the one or more sensors representing at least four primary directions indicated by a set of co-ordinate X-Y axes that form a set of ortho-normal basis vectors that completely span a 2 dimensional space.

17. The apparatus of claim 16, wherein the sensor interface device is located on the sensor-mounting device.

18. A system for controlling an electronic system, the system comprising:

the electronic system; and

a tongue-operated controller in communication with the electronic system, the tongue-operated controller comprising;

a sensor-mounting device configured to reside in a user'"'"'s mouth;

one or more sensors mounted on the sensor-mounting device and configured to interface with a user'"'"'s tongue; and

a sensor interface device configured to convert information from the sensors into control signals, connect the apparatus to the electronic system, and communicate the control signals to the electronic system, the sensor interface device configured to measure sensor signal voltages from each sensor;

compare the sensor signal voltages with a predetermined threshold value;

compute a vector sum using sensor signal voltages that exceed the predetermined threshold values;

determine magnitude data and angle data corresponding to said vector sum;

generate control signals indicative of a rate related to the magnitude data and a direction related to the angle data; and

transmit the control signals for control of the electronic system.

19. The system of claim 18, wherein the sensor interface device comprises an A/D converter.

20. The system of claim 18, wherein the electronic system comprises an input interface indicator, wherein the input interface indicator is configured to move at a rate related to the magnitude data and in a direction related to the direction data.

21. The system of claim 20, wherein the electronic system further comprises a display screen with an on-screen program icon, in which the input interface indicator is configured to allow a user to select the on-screen program icon.

22. The system of claim 21, wherein the on-screen program icon is selected from the group consisting of:

a key for an on-screen keyboard, an icon for starting a computer program, an icon for making a selection in an on-screen computer program, and a combination thereof.

23. The system of claim 20, wherein the input interface indicator comprises at least one of a cursor or an arrow.