Sign language translator

• US 20020152077A1
• Filed: 04/11/2002
• Published: 10/17/2002
• Est. Priority Date: 04/12/2001
• Status: Abandoned Application

• Current Assignee: Randall R. Patterson
• Original Assignee: Randall R. Patterson
• Inventors: Patterson, Randall R.
• Application Number:
  US10/121,280
• Publication Number:
  US 20020152077A1
• Time in Patent Office: Days
• US Class Current: 704/271
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves

Abstract

A method and apparatus for translation of hand positions into symbols. A glove for wearing on an operator'"'"'s hand includes bend sensors disposed along the operator'"'"'s thumb and each finger. Additional bend sensors are located between selected fingers and along the wrist. A processor generates a hand position signal using bend sensor signals read from the bend sensors and transmits the hand position signal to an output device. The output device receives the hand position signal and generates a symbol representative of the hand position signal using the received hand position signal and a lookup table of hand position signals associated with a set of symbols. The output device then produces either a visual or audio output using the symbol.

Claims

1. A hand sign language translator apparatus comprising:

a transmit subsystem having;

a sign language sensor processing subsystem, the sign language sensor processing subsystem generating a hand position signal in response to a hand position; and

a transmitter for transmitting the hand position signal; and

a remote receive subsystem, having;

a receiver for receiving a transmitted hand position signal;

a memory for storing a plurality of symbols, each symbol associated with a reference hand position signal; and

a processing subsystem for generating a comparison signal representative of a symbol by matching the hand position signal to a reference hand position signal associated with the symbol and outputting the symbol as represented by the hand position and processing the comparison signal for output of the symbol as represented by the hand position.

2. The hand sign language translator apparatus of claim 1, wherein:

the sign language sensor processing subsystem includes a plurality of voltage dividing sensors adapted for mounting on a hand, each voltage dividing sensor being driven by a voltage source and providing a respective sensor signal in response to a hand position, each sensor signal being combined to form the hand position signal; and

the stored reference hand position signal includes reference sensor signals corresponding to the sensor signals in the hand position signal.

3. The hand sign language translator apparatus of claim 2, wherein the plurality of voltage dividing sensors are adapted for mounting along selected finger, palm, wrist and finger gaps of the hand.

4. The hand sign language translator apparatus of claim 2, wherein the voltage dividing sensors are each a flexible sensor whose resistance value changes when bent.

5. The hand sign language translator apparatus of claim 1, wherein the transmit subystem includes:

an analog to digital converter for converting the hand position signal from an analog hand position signal to a digital hand position signal; and

wherein the transmitter is a radio frequency transmitter for transmitting the digital hand position signal.

6. The hand sign language translator apparatus of claim 1, wherein the memory stores a reference hand position signal associated with a training symbol, the reference hand position signal being representative of a particular user hand position, the user hand position being formed by a particular user in response to the training symbol.

7. The hand sign language translator apparatus of claim 2, wherein the processing subsystem includes means for generating a difference window for each reference hand position signal using the sensor signals in the hand position signal and the corresponding reference sensor signals in the reference hand position signal and for selecting as a match the reference hand position signal having a smallest difference window.

8. The hand sign language translator apparatus of claim 7, wherein the difference window is generated from differences in values between the sensor signals and the corresponding reference sensor signals.

9. The hand sign language translator apparatus of claim 7, wherein the difference window is generated from summing the differences in values between the sensor signals and the corresponding reference sensor signals.

10. The hand sign language translator apparatus of claim 7, wherein the difference window is generated from summing the differences in values between the sensor signals and the corresponding reference sensor signals raised to a specified power.

11. The hand sign language translator apparatus of claim 1, wherein the processing subsystem includes means for generating a plurality of translation symbols and corresponding precision values for a series of hand position signals and for selecting a translation symbol using the plurality of translation symbols and corresponding precision values.

12. The hand sign language translator apparatus of claim 11, wherein the processing subsystem further includes means for selecting a translation symbol from the plurality of translation symbols having a local maximum in precision as determined from the plurality of precision values.

13. The hand sign language translator apparatus of claim 12, wherein the processing subsystem further includes means for selecting a translation symbol whose corresponding precision value exceeds a specified threshold.

14. The hand sign language translator apparatus of claim 1, wherein the receiver receives the hand position signal transmitted by the transmit subsystem and the processing subsystem compares the hand position signal with the reference hand position signals.

15. The hand sign language translator apparatus of claim 1, wherein the remote receive subsystem is portable.

16. The hand sign language translator apparatus of claim 1, wherein the processing subsystem includes a visual symbol display device responsive to the comparison signal for output of the symbol that the hand position represents.

17. The hand sign language translator apparatus of claim 16, wherein the visual symbol display device is a liquid crystal display.

18. The hand sign language translator apparatus of claim 1, wherein the processing subsystem includes means for converting the comparison signal to an audible sound representative of the symbol.

19. The hand sign language translator apparatus of claim 1, wherein each symbol can be selected from alphabet letters, punctuation, symbols and phrases.

20. A method of translating hand sign language positions into symbols comprising:

providing a sign language sensor, the sign language sensor generating a hand position signal in response to a hand position;

transmitting the hand position signal by a transmit system to a remote receive subsystem;

receiving a transmitted hand position signal by the remote receive subsystem;

storing in memory a plurality of symbols, each symbol associated with a reference hand position signal;

generating a comparison signal representative of a symbol by matching the transmitted hand position signal to a reference hand position signal associated with the symbol; and

processing the comparison signal for output of the symbol as represented by the hand position.

21. The method of claim 20,:

wherein providing a sign language sensor includes adapting for mounting a plurality of voltage dividing sensors on a hand, each voltage dividing sensor being driven by a voltage source and providing a respective sensor signal in response to a hand position, each sensor signal being combined to form the hand position signal; and

wherein a stored reference hand position signal includes reference sensor signals corresponding to the sensor signals in the hand position signal.

22. The method of claim 21, further comprising adapting for mounting the plurality of voltage dividing sensors along selected finger, palm, wrist and finger gaps of the hand.

23. The method of claim 21, wherein the voltage dividing sensors are each a flexible sensor whose resistance value changes when bent.

24. The method of claim 20, wherein transmitting the hand position signal to a remote receive subsystem includes:

converting the hand position signal from an analog hand position signal to a digital hand position signal; and

radio frequency transmitting the digital hand position signal.

25. The method of claim 20, wherein the storing in memory of the plurality of symbols associated with reference hand position signals includes:

determining a reference hand position signal representative of a particular user hand position, the user hand position being formed by the particular user in response to a training symbol; and

storing in the memory the reference hand position signal associated with the training symbol.

26. The method of claim 21, wherein matching the hand position signal to a reference hand position signal includes:

generating a difference window for each reference hand position signal using the sensor signals in the hand position signal and the corresponding reference sensor signals in the reference hand position signal; and

selecting as a match the reference hand position signal having a smallest difference window.

27. The method of claim 26, wherein the difference window is generated from differences in values between the sensor signals and the corresponding reference sensor signals.

28. The method of claim 26, wherein the difference window is generated from summing the differences in values between the sensor signals and the corresponding reference sensor signals.

29. The method of claim 26, wherein the difference window is generated from summing the differences in values between the sensor signals and the corresponding reference sensor signals raised to a specified power.

30. The method of claim 20, wherein matching the hand position signal to a reference hand position signal includes:

generating a plurality of translation symbols and corresponding precision values for a series of hand position signals; and

selecting a translation symbol using the plurality of translation symbols and corresponding precision values.

31. The method of claim 30, further including selecting a translation symbol from the plurality of translation symbols having a local maximum in precision as determined from the plurality of precision values.

32. The method of claim 31, further including selecting a translation symbol whose corresponding precision value exceeds a specified threshold.

33. The method of claim 20, further comprising receiving the hand position signal transmitted by the transmit system by the remote receive subsystem and comparing at the remote receive subsystem the hand position signal with the reference hand position signals.

34. The method of claim 20, wherein the remote receive subsystem is portable.

35. The method of claim 20, wherein the processing the comparison signal for output of the symbol that the hand position represents includes visually displaying the symbol on a display device.

36. The method of claim 33, wherein the display device is a liquid crystal display.

37. The method of claim 20, wherein the processing the comparison signal for display of the symbol that the hand position represents includes converting the comparison signal to an audible sound representative of the symbol.

38. The method of claim 20, wherein each symbol can be selected from alphabet letters, punctuation, symbols and phrases.

39. A sign language sensor comprising:

a plurality of voltage dividing sensors, each voltage dividing sensor being respectively adapted for mounting along selected finger, palm and finger gap locations of a hand; and

a voltage source coupled to each voltage dividing sensor being driven;

each respective voltage dividing sensor providing a divided output signal in response to each hand element position, each respective hand element voltage divided output signal being combinable to form a hand position signal representative of a sign language symbol;

wherein the voltage dividing sensors are flexible sensors whose resistance values change when bent; and

wherein the voltage dividing sensors are mounted on a glove worn on a hand that provides the hand position signal.