Method and apparatus for voice control of a computer

• US 4,704,696 A
• Filed: 01/26/1984
• Issued: 11/03/1987
• Est. Priority Date: 01/26/1984
• Status: Expired due to Term

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Reimer, Jay B., Doiron, Robert D.
• Primary Examiner(s): Kemeny, E. S. Matt
• Application Number:
  US06/574,117
• Time in Patent Office: 1,377 Days
• Field of Search: 381/36-39, 381/41-43, 381/45, 381/49, 381/50, 381/110, 364/513.5, 364/188, 364/190, 364/410, 364/521
• US Class Current: 704/275
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence

Abstract

A voice control system for controlling execution of a computer program includes a microphone (10) operative to receive voice commands having the output thereof connected to a clipping circuit (12) which amplifies and clips the microphone output to generate a zero-crossing signal. The output of circuit (12) is connected to a microprocessor (14) which on detecting speech input interrupts program execution in a CPU (15) and "freezes" display device (16) on which the game is displayed. Microprocessor (14) then processes the input signal to recognize the voice command by determining the relative frequency content of discrete portions of the command. Once it has recognized the command, microprocessor (14) prompts the CPU (15) to execute the command and resume execution of the game program at the point of interrupt. By suspending the progress of the game during the speech input and recognition interval, the voice control system minimizes the time-constraint problems associated with voice input.

Claims

1. Apparatus for voice control of program execution in a computer in which a program is being instituted, said apparatus comprising:

operator input means for receiving spoken speech from an operator in the form of an audible voice command affecting the operation of the computer program and generating an input analog speech signal representative of the voice command;

signal conditioning means for receiving the input analog speech signal from said operator input means and providing word-discrimination information as an output based upon the zero-crossing rate of the input analog speech signal, said signal conditioning means being effective to divide the input analog speech signal into a plurality of discrete speech signal portions and to produce a waveform sequence for each speech signal portion alternating between plus and minus polarity signs to define a zero-crossing signal from which a zero-crossing count can be obtained;

event counter means operably associated with the output of said signal conditioning means for detecting signal transitions in the waveform sequences between plus and minus polarity signs and maintaining a zero-crossing count of each detected polarity transition in the waveform sequences corresponding to each of the speech signal portions as provided by said signal conditioning means;

memory means storing a plurality of reference templates of digital speech data respectively respresentative of individual words comprising a vocabulary of voice commands each of said reference templates being defined by a plurality of binary segments of one bit each having a logic state of alternative high and low levels corresponding to respective thresholds related to high and low zero-crossing counts;

processing means operably connected to said event counter means and said memory means, said processing means being responsive to the output of said event counter means to interrupt the execution of the computer program upon detection of a predetermined condition relative to the zero-crossing count maintained by said event counter means and including comparator means for comparing the zero-crossing count attributable to each speech signal portion of the input analog speech signal as obtained by said event counter means with said plurality of reference templates stored in said memory means to determine the particular reference template which has the same sequence of logic states assigned to the one-bit binary segments for portions of the input analog speech signal as are reflected by the zero-crossing count of such portions of the input analog speech signal as a recognition of the particular voice command provided by the spoken speech of the operator;

said processing means further including means to execute the recognized voice command as represented by said particular reference template during the interruption of the execution of the program; and

means responsive to the execution of the recognized voice command by said executing means for resuming execution of said program being run in the computer.

2. Apparatus as set forth in claim 1, wherein said processing means further includes

means for sampling said zero-crossing signal as produced by said signal conditioning means to detect the presence of non-zero frames of speech data included in said zero-crossing signal;

and

said processing means being responsive to the detection of a predetermined number of consecutive non-zero frames of speech data by said sampling means as said predetermined condition for interrupting the execution of the computer program.

3. Apparatus as set forth in claim 2, wherein said sampling means is effective for sampling said zero-crossing signal at a first predetermined number of pre-selected time intervals to determine a frequency content for each of said time intervals equal to the number of zero-crossings occuring in the time interval;

and said processing means further including

means for discriminating the frequency content of each of said time intervals between first and second discrete levels corresponding to high and low logic states based upon the respective numbers of zero-crossings,

means for determining the frequency level of a first portion of the voice command as one of the first and second discrete levels depending upon the frequency levels of said time intervals, and

means for causing said sampling means and said discriminating means to repeat sampling of said zero-crossing signal and discrimination of the frequency content for a second predetermined number of time intervals until the end of the zero-crossing signal is detected;

said frequency level-determining means being effective for determining the frequency level of a second portion of the voice command as one of the first and second discrete levels depending upon the frequency levels of said second number of time intervals; and

said processing means being effective to compare the frequency levels of said first and second portions of the voice command with said plurality of reference templates as stored in said memory means to identify which voice command was spoken by the operator for reception by said operator input means.

4. Apparatus as set forth in claim 3, wherein said discriminating means comprises

means for comparing the frequency content of each of said time intervals with a pre-selected threshold to detect a high frequency level when the number of zero-crossings in a respective time interval exceeds said threshold and to detect a low frequency level when the number of zero-crossings is equal to or less than said threshold.

5. Apparatus as set forth in claim 4, wherein said processing means includes speech sensing means for detecting word-discrimination information form said signal conditioning means indicative of a voice command, and further including means responsive to said sensing means to delay interruption of the execution of the program being run by the computer for a predetermined time after said sensing means has detected word-discrimination information from said signal conditioning means indicative of a voice command.

6. Apparatus as set forth in claim 5, further including display means operably coupled to said processing means for displaying the results of the program being run by the computer, said display means being responsive to the execution of the recognized voice command by said executing means for displaying the effect of the executed voice command.