Computerized system for teaching speech

• US 5,487,671 A
• Filed: 01/21/1993
• Issued: 01/30/1996
• Est. Priority Date: 01/21/1993
• Status: Expired due to Fees

• Current Assignee: Digispeech (Israel), Ltd.
• Original Assignee: DSP Solutions Ltd. (Avnet Incorporated)
• Inventors: Ordentlich, Erik, Shpiro, Zeev, Groner, Gabriel F.
• Primary Examiner(s): Apley, Richard J.
• Assistant Examiner(s): Richman, Glenn E.
• Application Number:
  US08/007,242
• Time in Patent Office: 1,104 Days
• Field of Search: 434/185, 434/156, 434/157, 434/167, 434/169, 364/419.01, 364/419.02, 364/419.03
• US Class Current: 434/185
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04
• CPC Class Codes: G09B 19/06 Foreign languages with audible presentation of material to be studied G09B5/04
• CPC Class Codes: G09B 7/04 characterised by modifying the teaching programme in response to a wrong answer, e.g. repeating the question, supplying a further explanation

Abstract

Apparatus for interactive speech training having an audio specimen generator for playing a pre-recorded reference audio specimen to a user for attempted repetition by the user and a reference audio specimen library in which reference audio specimens are stored and to which the audio specimen generator has access. The audio specimen library contains a multiplicity of recordings of speaker dependent audio specimens produced by a plurality of speech models. A speaker independent parameter database stores a plurality of speaker independent references which are different from the reference audio specimens stored in the reference audio specimen library. The speaker independent references are classified according to at least one of age, gender or dialect, but is independent of other speaker characteristics within each category. An audio specimen scorer scores a user'"'"'s repetition audio specimen by comparison of at least one parameter of the user'"'"'s repetition audio specimen with a speaker independent reference.

Claims

1. Apparatus for interactive speech training comprising:

an audio specimen generator for playing a pre-recorded reference audio specimen to a user for attempted repetition thereby;

a reference audio specimen library in which reference audio specimens are stored and to which the audio specimen generator has access, wherein said audio specimen library comprises a multiplicity of recordings of speaker dependent audio specimens produced by a plurality of speech models;

a speaker independent parameter database storing a plurality of speaker independent references which are different from the reference audio specimens stored in said reference audio specimen library; and

an audio specimen scorer for scoring a user'"'"'s repetition audio specimen by comparison of at least one parameter of the user'"'"'s repetition audio specimen with a speaker independent reference, said speaker independent reference being characterized in that it is classified in a category according to at least one of age, gender and dialect categories.

2. Apparatus according to claim 1 wherein the audio specimen scorer comprises:

a reference-to-response comparing unit for comparing at least one feature of a user'"'"'s repetition audio specimen to at least one feature of the reference audio specimen; and

a similarity indicator for providing an output indication of the degree of similarity between at least one repetition audio specimen feature and at least one reference audio specimen feature.

3. Apparatus according to claim 2 and also comprising a user response memory to which the reference-to-response comparing unit has access, for storing a user'"'"'s repetition of a reference audio specimen.

4. Apparatus according to claim 2 wherein said reference-to-response comparing unit comprises a volume/duration normalizer for normalizing the volume and duration of the reference and repetition audio specimens.

5. Apparatus according to claim 2 wherein said reference-to-response comparing unit comprises a parameterization unit for extracting audio signal parameters from the reference and repetition audio specimens.

6. Apparatus according to claim 5 and wherein said reference-to-response comparing unit also comprises means for comparing the reference audio specimen parameters to the repetition audio specimen parameters.

7. Apparatus according to claim 6 wherein said means for comparing comprises a parameter score generator for providing a score representing the degree of similarity between the audio signal parameters of the reference and repetition audio specimens.

8. Apparatus according to claim 7 wherein said output indication comprises a display of said score.

9. Apparatus according to claim 2 wherein said output indication comprises a display of at least one audio waveform.

10. Apparatus according to claim 1 and also comprising a prompt sequencer operative to generate a sequence of prompts to a user.

11. Apparatus according to claim 1 wherein the plurality of speech models differ from one another in at least one of the following characteristics:

sex;

age; and

dialect.

12. Apparatus according to claim 1 and also comprising a conventional personal computer.

13. Apparatus for interactive speech training comprising:

a reference audio specimen database in which non-speaker independent reference audio specimens are stored;

a speaker independent parameter database in which speaker independent references are stored;

a prompt sequencer operative to generate a sequence of prompts including said reference audio specimens to a user, prompting the user to produce a corresponding sequence of audio specimens, wherein said sequence of prompts branches in response to user performance; and

a reference-to-response comparing unit for comparing at least one feature of each of the sequence of audio specimens generated by the user, to a speaker independent reference from said speaker independent parameter database, said speaker independent reference being characterized in that it is classified in a category according to at least one of age, gender and dialect categories.

14. Apparatus according to claim 13 wherein the reference to which an individual user-generated audio specimen is compared comprises a corresponding stored reference audio specimen.

15. Apparatus according to claim 13 wherein the sequence of prompts is at least partly determined by a user'"'"'s designation of his native language.

16. Apparatus according to claim 13 wherein the prompt sequencer comprises a multi-language prompt sequence library in which a plurality of prompt sequences in a plurality of languages is stored and wherein the prompt sequencer is operative to generate a sequence of prompts in an individual one of the plurality of languages in response to a user'"'"'s designation of the individual language as his native language.

17. Apparatus for interactive speech training comprising:

a reference audio specimen database in which non-speaker independent reference audio Specimens are stored;

a speaker independent parameter database in which speaker independent references are stored;

a prompt sequencer operative to generate a sequence of prompts, including said non-speaker independent references, to a user, prompting the user to produce a corresponding sequence of audio specimens, wherein the sequence of prompts is at least partly determined by a user'"'"'s designation of his native language; and

a speaker independent reference-to-response comparing unit for comparing at least one feature of each of the sequence of audio specimens generated by the user, to a speaker independent reference from said speaker independent parameter database, said speaker independent reference being characterized in that it is classified in a category according to at least one of age, gender and dialect categories.

18. Apparatus for interactive speech training comprising:

a reference audio specimen database in which non-speaker independent reference audio specimens are stored;

a speaker independent parameter database in which speaker independent references are stored;

apparatus for receiving and storing audio specimens generated by a user in response to reference audio specimens from said reference audio specimen database; and

a speaker independent reference-to-response comparing unit for comparing at least one feature of the audio specimen generated by the user, to a speaker independent reference from said speaker independent parameter database, said speaker independent reference being characterized in that it is classified in a category according to at least one of age, gender and dialect categories, the comparing unit comprising;

an audio specimen segmenter for segmenting a user-generated audio specimen into a plurality of segments; and

a segment comparing unit for comparing at least one feature of at least one of the plurality of segments to a speaker independent reference from said speaker independent parameter database.

19. Apparatus according to claim 18 wherein said audio specimen segmenter comprises a phonetic segmenter for segmenting a user-generated audio specimen into a plurality of phonetic segments.

20. Apparatus according to claim 19 wherein at least one of the phonetic segments comprises a phoneme.

21. Apparatus according to claim 19 wherein at least one of the phonetic segments comprises a syllable.

22. Apparatus according to claim 20 wherein the phoneme comprises a vowel.

23. Apparatus according to claim 20 wherein the phoneme comprises a consonant.

24. Apparatus for interactive speech training comprising:

a reference audio specimen database in which non-speaker independent reference audio specimens are stored;

a speaker independent parameter database in which speaker independent references are stored;

an audio specimen recorder for recording audio specimens generated by a user in response to reference audio specimens from said reference audio specimen database; and

a speaker-independent audio specimen scorer for scoring a user-generated audio specimen based on at least one speaker-independent reference parameter from said speaker independent parameter database, said speaker independent reference parameter being characterized in that it is classified in a category according to at least one of age, gender and dialect categories.

25. Apparatus according to claim 24 wherein at least one speaker-independent parameter comprises a threshold value for the amount of energy at a predetermined frequency.

26. Apparatus for interactive speech training comprising:

a reference audio specimen database in which non-speaker independent reference audio specimens are stored;

a speaker independent parameter database in which speaker independent references are stored;

apparatus for receiving and storing audio specimens generated by a user in response to reference audio specimens from said reference audio specimen database; and

a speaker independent reference-to-response comparing unit for comparing at least one feature of the audio specimens generated by the user, to a speaker independent reference from said speaker independent parameter database, said speaker independent reference being characterized in that it is classified in a category according to at least one of age, gender and dialect categories.