Augmentive communications system and method

• US 5,047,953 A
• Filed: 07/31/1989
• Issued: 09/10/1991
• Est. Priority Date: 07/31/1989
• Status: Expired due to Fees

• Current Assignee: The Detroit Institute For Children
• Original Assignee: The Detroit Institute For Children
• Inventors: Smallwood, John M., Custer, William A.
• Primary Examiner(s): Kemeny, Emanuel S.
• Application Number:
  US07/387,961
• Time in Patent Office: 771 Days
• Field of Search: 364/513.5, 364/419, 381/51-53
• US Class Current: 704/271
• CPC Class Codes: A61F 4/00 Methods or devices enabling patients or disabled persons to operate an apparatus or a device not forming part of the body operating or control means for prostheses A61F2/48, A61F2/68
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B

Abstract

An augmentive communications system ("ACS") and method for enabling handicapped individuals to generate sentences and also to control external devices. The ACS may employ auditory or visual feedback to present category and word choices to the user. With a single switch the user may select categories and words from these choices which then are stored in an input buffer to permit the construction of sentences. Alternatively, the user may select choices which permit the control of external devices such as a wheelchair by manipulating the single switch. The microprocessor controlled ACS system incorporates a simplified programming language and interpreter to permit nonprogrammers to construct user programs that are tailored to the particular needs of the individual user. In addition, as the user gains proficiency in using the ACS, the user program can be easily revised to permit more efficient and sophisticated communications.

Claims

1. In a programmable system for enabling a user to generate sentences from a set of stored words and phrases by actuating a single switch in response to choices presented to said user, a method of generating said sentences in said system comprising the steps of:

storing in said programmable system at least one set of numbered instructions executable by said system which defines said choices and their order of presentation, said set of instructions including individually numbered instructions, each having a first line number for identification, a command symbol, at least one word to be presented to said user as one of said choices, and at least one second line number for indicating which individual instruction to execute next;

executing said instructions in said system by;

(a) locating a first individual instruction to be executed from the set of instructions;

(b) determining if there is more than one second line number in the instruction to be executed;

(c) when there is no more than one second line number in the instruction to be executed, executing the function defined by the command symbol of the instruction to be executed, and proceeding to the individual instruction indicated by the second line number designated in the instruction to be executed;

(d) when there is more than one second line number in the instruction to be executed, presenting a word in an individual instruction indicated by the first such second line number to said user;

(e) determining if said single switch has been actuated within a predetermined interval of time after said word is presented to said user;

(f) when said switch is actuated within said-predetermined interval of time, executing a function defined by a command symbol in the individual instruction indicated by the first such second line in the instruction to be executed, and proceeding to the next second line number designated in the instruction to be executed;

(g) when said switch is not activated within said predetermined interval of time, presenting to said user a word in another individual instruction indicated by the next second line number in the instruction to be executed; and

(h) repeating steps (e), (f), and (g) for each successive second line number listed in the instruction to be executed.

2. A method of generating sentences as in claim 1 and in which the programmable system includes a message buffer,

wherein one of said command symbols will cause said system to add said word in the line to said message buffer.

3. A method of generating sentences as in claim 2 further comprising the steps of:

determining when the length of time said switch is actuated falls within a predetermined range;

when said length of time is within said predetermined range, presenting said user with control choices which, when chosen, will cause said system to form one of a plurality of steps including the steps of;

presenting the word in said message buffer to said user; and

presenting the word in said message buffer to a person other than said user.

4. A method of generating sentences as in claim 3 wherein said control choices further include choices which:

cause said system to remove the previous word from said message buffer;

remove all the words from the message buffer; and

turn the system off.

5. A method of generating sentences as in claim 3 wherein:

said control choices further include choices which cause said system to activate at least one of a plurality of relays, said relays being connected to external devices.

6. A method of generating sentences as in claim 1 further comprising the steps of:

providing a first speaker which is in close proximity to said user wherein said speaker will be heard primarily by said user; and

step (d) further comprises the step of transmitting an audio speech signal representative of said word to said first speaker.

7. A method of generating sentences as in claim 3 further comprising the steps of:

providing a second speaker which is easily heard by a person other than said user, and wherein said step of presenting said word in said message buffer to a person other than said user further includes the step of transmitting a speech signal representative of said word stored in said buffer to said second speaker.

8. A programmable system for enabling a user to generate sentences from a set of stored words and phrases by actuating a single switch in response to choices presented to said user, said system comprising:

means for storing in said system a set of instructions executable by said system, which defines said choices and their order of presentation, said set of instructions including individual instructions, each having a first line number for identification, a command symbol, at least one word to be presented to said user as one of said choices, and at least one second line number for indicating which line to execute next;

means for executing said instructions in said system including;

(a) means for locating a first instruction line within the set of instructions;

(b) means for determining if there are more than two second line numbers in an instruction;

(c) means for executing a function defined by a command symbol in an instruction;

(d) means for presenting a word includes in an instruction to said user;

(e) means for determining if said single switch has been actuated within a predetermined interval of time after a word is presented to said user; and

(f) means for executing a function defined by a command symbol in an instruction; and

(g) means for proceeding to another instruction indicated by a second line number in an instruction currently being executed.

9. A system as in claim 8 further comprising:

an message buffer; and

means responsive to one of said command symbols for causing said system to add a word in an instruction designated by a second line number in an instruction currently being executed to said message buffer.

10. A system of generating sentences as in claim 9 further comprising:

means for determining whether said switch is actuated for more than a predetermined length of time;

means for presenting said switch is actuated for more than a predetermined length of time;

means for presenting said user with control choices;

means for selectively presenting words added to said message buffer to said user; and

means for selectively presenting words added to said message buffer to a person other than said user.

11. A system as in claim 10 further comprising:

means for causing said system to remove a word previously added to said message buffer from said message buffer; and

means for removing all the words from the message buffer substantially at

12. A system as in claim 8 further comprising:

a plurality of relays connectable to an external device having a plurality of controllable functions; and

means responsive to said control choices for causing said system to activate selectively at least one of said plurality of relays, whereby said user can actively control said controllable functions of said external device using said single switch when said system is connected thereto.

13. A system as in claim 8 further comprising:

a first speaker which is in proximity to said user such that said speaker will be heard primarily by said user; and

means for transmitting an audio speech signal representative of said word to said first speaker.

14. A system as in claim 8, wherein said means for executing said instructions includes an interpreter program, and wherein said individual instructions form part of a simplified computer language easily learned by persons without experience in computer programming.