Method and system for the automatic generation of speech features for scoring high entropy speech
First Claim
1. A computer-implemented method of automatically generating a scoring model for scoring a speech sample to characterize speaking proficiency, the method comprising:
- receiving one or more training speech samples in response to a prompt;
determining one or more speech features for each of the training speech samples, wherein the speech features include a previously assigned score, wherein the previously assigned score is assigned by a human rater based on a training speech sample; and
generating a scoring model using a computer based on the speech features, wherein the scoring model is effective for scoring spontaneous speech responses;
wherein the scoring model is independent of speech recognition accuracy associated with the training speech samples;
wherein the scoring model is used to generate a numeric speaking proficiency score for a received spontaneous speech response.
1 Assignment
0 Petitions
Accused Products
Abstract
A method and system for automatically generating a scoring model for scoring a speech sample are disclosed. One or more training speech samples are received in response to a prompt. One or more speech features are determined for each of the training speech samples. A scoring model is then generated based on the speech features. At least one of the training speech samples may be a high entropy speech sample. An evaluation speech sample is received and a score is assigned to the evaluation speech sample using the scoring model. The evaluation speech sample may be a high entropy speech sample.
-
Citations
21 Claims
-
1. A computer-implemented method of automatically generating a scoring model for scoring a speech sample to characterize speaking proficiency, the method comprising:
-
receiving one or more training speech samples in response to a prompt; determining one or more speech features for each of the training speech samples, wherein the speech features include a previously assigned score, wherein the previously assigned score is assigned by a human rater based on a training speech sample; and generating a scoring model using a computer based on the speech features, wherein the scoring model is effective for scoring spontaneous speech responses; wherein the scoring model is independent of speech recognition accuracy associated with the training speech samples; wherein the scoring model is used to generate a numeric speaking proficiency score for a received spontaneous speech response. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer-implemented method for scoring a spontaneous speech sample to characterize speaking proficiency, the method comprising:
-
retrieving a scoring model, wherein the scoring model has been trained using speech features that include a previously assigned score for a training speech sample, wherein the previously assigned score is assigned by a human rater based on the training speech sample; wherein the scoring model is independent of speech recognition accuracy associated with the spontaneous speech sample; and assigning a numeric speaking proficiency score to a received spontaneous speech sample using the scoring model using a computer. - View Dependent Claims (14, 15, 16, 17)
-
-
18. A system for automatically generating a scoring model for scoring a spontaneous speech sample to characterize speaking proficiency, the system comprising:
-
a processor; and a processor-readable storage medium, wherein the processor-readable storage medium contains one or more programming instructions for automatically generating a scoring model for scoring a spontaneous speech sample, the programming instructions when executed causing the processor to carry out steps comprising; receiving one or more spontaneous training speech samples in response to a prompt, determining one or more speech features for each of the training speech samples, wherein the speech features include a previously assigned score, wherein the previously assigned score is assigned by a human rater based on a training speech sample, and generating a scoring model based on the speech features; wherein the scoring model is independent of speech recognition accuracy associated with the training speech samples; wherein the scoring model is used to generate a numeric speaking proficiency score for a received spontaneous speech response.
-
-
19. A system for scoring a spontaneous speech sample to characterize speaking proficiency, the system comprising:
-
a processor; and a processor-readable storage medium, wherein the processor-readable storage medium contains one or more programming instructions for scoring a spontaneous speech sample, the programming instructions when executed causing the processor to carry out steps comprising; retrieving a scoring model, wherein the scoring model has been trained using speech features that include a previously assigned score for a training speech sample, wherein the previously assigned score is assigned by a human rater based on the training speech sample, wherein the scoring model is independent of speech recognition accuracy associated with the spontaneous speech sample, and assigning a numeric speaking proficiency score to a spontaneous speech sample using the scoring model.
-
-
20. An article of manufacture comprising a non-transitory computer-readable medium for automatically generating a scoring model for scoring a spontaneous speech sample to characterize speaking proficiency comprising programming instructions, which when executed cause a processing system to perform steps comprising:
-
receiving one or more spontaneous training speech samples in response to a prompt, determining one or more speech features for each of the training speech samples, wherein the speech features include a previously assigned score, wherein the previously assigned score is assigned by a human rater based on a training speech sample, and generating a scoring model based on the speech features; wherein the scoring model is independent of speech recognition accuracy associated with the training speech samples; wherein the scoring model is used to generate a numeric speaking proficiency score for a received spontaneous speech response.
-
-
21. An article of manufacture comprising a non-transitory computer-readable medium for scoring a spontaneous speech sample to characterize speaking proficiency comprising programming instructions, which when executed cause a processing system to perform steps comprising:
-
retrieving a scoring model, wherein the scoring model has been trained using speech features that include a previously assigned score for a training speech sample, wherein the previously assigned score is assigned by a human rater based on the training speech sample, wherein the scoring model is independent of speech recognition accuracy associated with the spontaneous speech sample, and assigning a numeric speaking proficiency score to a spontaneous speech sample using the scoring model.
-
Specification