Tactile communication system

• US 20040098256A1
• Filed: 12/16/2003
• Published: 05/20/2004
• Est. Priority Date: 12/29/2000
• Status: Abandoned Application

• Current Assignee: John Christian Doughty Nissen
• Original Assignee: John Christian Doughty Nissen
• Inventors: Nissen, John Christian Doughty
• Application Number:
  US10/465,963
• Publication Number:
  US 20040098256A1
• Time in Patent Office: Days
• US Class Current: 704/220
• CPC Class Codes: G10L 13/02 Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 2021/065 Aids for the handicapped in understanding
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence

Abstract

This invention concerns a system of communication including a tactile device for single-handed input of phonetic information and a corresponding tactile device for output of that information onto a single hand. The phonetic information input using the tactile input device can be output as synthesized speech, and the tactile output device can receive phonetic information obtained from a speech recognition engine. Thus the input device acts as a “talking hand”, and the output device acts as a “listening hand”. The phonemic information is suitable for tactile or speech output, either directly or indirectly, locally or remotely, via a transmission system such as a telephone network. The system involves a scheme in which the fingers are used for consonants and the thumb for vowels, with fingers and thumb used together for voiced consonants.

Claims

1. A system comprising:

an input device,

an output device,

a processor to process the input received from the input device, to convert the input to a form suitable for output, and to output it on the output device;

in which the input device;

includes a first means which the user of the system operates to indicate vowels or vowel sounds,

includes a separate second means which the user operates to indicate consonants or consonant sounds,

where a particular unvoiced consonant is indicated by a certain operation of the second means, and the corresponding voiced consonant is indicated by combining the same operation of the second means with the operation of the first means indicating any vowel; and

in which possible forms of the output include;

a speech waveform as synthesised by the processor, for output through an audio output device;

characters for a one-handed serial tactile display device corresponding to the input device in having a third means to indicate vowels and a fourth means to indicate consonants, where a particular unvoiced consonant is indicated by a certain operation of the fourth means, and the corresponding voiced consonant is indicated by combining the same operation of the fourth means with the operation of the third means indicating any vowel;

a form for digital transmission to equipment local to another person, thence for output on the tactile display device or audio output device, for sensory reception of the communication by that person.

2. A system as claimed in claim 1, in which the input and corresponding output:

is essentially phonetic, in that there are sounds associated with the position or position of depression of thumb on the first means and fingers on the second means,

can distinguish the phonemes of a language, even when these are significantly more numerous than the letters of that alphabet, as in the case of English (around 44 phonemes versus 26 letters in the alphabet).

3. A system as claimed in any preceding claim, in which:

the sound from a plosive consonant is produced when the finger is moved away from the position indicating that consonant on the second means;

the presence of absence of a thumb on the first means indicates at that moment whether the plosive is voiced or not, respectively;

if the thumb is present throughout the period that the finger is in the consonant position, and both digits are moved away from, or released from, their positions simultaneously, a short schwa sound is produced, as would be normal following the voiced consonant at the end of a word;

the sound of a non-plosive consonant is produced while the finger is in the position indicating that consonant;

the presence of absence of a thumb at the beginning of a fricative consonant indicates whether a fricative consonant is voiced or not, thus allowing a change of vowel between that preceding the consonant and that following the consonant.

4. A system as claimed in any preceding claim, in which the vowels with composite sound (diphthongs or triphthongs) are produced:

by moving the thumb on the first means from one vowel position to another (typically to or from the schwa vowel position for English);

or

by adding a ‘

liquid’

consonant such as ‘

y’

or ‘

w’

at the beginning or end of the vowel or both, so for example ‘

quite’

is produced by /k/ /w/ /ah/ /y/ /t/ and ‘

quiet’

by /k/ /w/ /ah/ /er/ /t/ where /er/ stands for the schwa sound.

5. A system as claimed in any preceding claim, in which vowels can be modified or coloured by the addition of consonant finger indications on the second means, such as:

/w/ for rounded lips;

/m/, /n/ or /ng/ for nasalisation;

/r/ for either schwa endings or, in rhotic accents, for r-colouring;

/l/ for l-colouring;

/h/ for whispering the vowel—

vowels are otherwise voiced.

6. A system as claimed in any preceding claim, in which:

the positions for consonants are arranged in an order and juxtaposition corresponding to tongue positions in the mouth for their formation in speech, ranging from lip position (e.g. for /p/) to the back of the mouth (e.g. for /k/);

the positions for the vowels are arranged in a two-dimensional arrangement according to position of a conventional ‘

vowel diagram’

, in which the two axes represent front-back and open-closed respectively, with the schwa sound centrally.

7. A system as claimed in any preceding claim, in which particular positions of thumb on the first means, finger on the second means, and combinations thereof, are chosen for particular letters of the alphabet, thus allowing the system to be used for alphabetic input, but with a close correspondence to the phonetic scheme such that each letter has a unique sound, which can be emitted as an option.

8. A system as claimed in any preceding claim, in which the system can operate in a non-alphabetic mode for input of non-alphabetic characters, e.g. numerals.

9. A system as claimed in any preceding claim, in which the input device uses an array of keys or buttons for the consonant, and a second array for the vowels.

10. A system as claimed in any of claims 1 to 8, in which the first means is a tactile surface for detecting movement, position, or depression of the thumb in a 2-dimensional vowel space, with axes representing open/close and front/back tongue positions.

11. A system as claimed in any preceding claim, in which the input device is mounted on a wrist in such a way that a small visual display such as an LCD, also mounted on the wrist, can be seen whilst the input device is being operated.

12. A system as claimed in any preceding claim, in which a visual display provides indicia for the phoneme positions, to help a novice to use the input device.

13. A system as claimed in any preceding claim, in which the back end of a speech recognition engine is used to convert the phoneme stream produced by the input device into a stream of ordinary text, suitable for display on an alphanumeric display device.

14. A system as claimed in any preceding claim, in which the front end of a speech recognition engine is used to convert the speech produced by a speaker into a phoneme stream suitable for display through the tactile output device.

15. A system as claimed in any preceding claim, in which the tactile device has four or more pines for the first means and two or more pins for the second means, where different said pins move or vibrate corresponding to different vowels or consonant input on the input device in corresponding positions under thumb or fingers.

16. A system as claimed in any of claim 1 to 14, in which the first means is a tilting device allowing the thumb to detect the position of a received vowel in vowel space, corresponding to the vowel space mentioned in claim 10.

17. A system as claimed in claim in any preceding claim, in which the sensors (for input) or vibrators (for output) or both are mounted in a glove.

18. A system as claimed by any preceding claim, in which the sound output from the synthesiser is adjusted for particular phonemes in various languages and accents.