SPOKEN LANGUAGE LEARNING SYSTEMS
First Claim
1. A computing system to facilitate learning of a spoken language, the system comprising:
- a user interface to prompt a user of the system to produce a spoken language goal and to capture audio data comprising speech captured from said user in response;
a speech analysis system to analyse said captured audio data to determine acoustic or linguistic pattern features of said captured audio data;
a pattern matching system to match one or more subsets of said pattern features to a database of pattern features and to determine feedback data responsive to said match; and
a feedback system to provide feedback to said user using said feedback data to facilitate said user to achieve said spoken language goal.
0 Assignments
0 Petitions
Accused Products
Abstract
This invention relates to systems, methods and computer program code for facilitating learning of spoken languages. We describe a computing system to facilitate learning of a spoken language, the system comprising: a user interface to prompt a user of the system to produce a spoken language goal and to capture audio data comprising speech captured from said user in response; a speech analysis system to analyse said captured audio data to determine acoustic or linguistic pattern features of said captured audio data; a pattern matching system to match one or more subsets of said pattern features to a database of pattern features and to determine feedback data responsive to said match; and a feedback system to provide feedback to said user using said feedback data to facilitate said user to achieve said spoken language goal.
-
Citations
20 Claims
-
1. A computing system to facilitate learning of a spoken language, the system comprising:
-
a user interface to prompt a user of the system to produce a spoken language goal and to capture audio data comprising speech captured from said user in response; a speech analysis system to analyse said captured audio data to determine acoustic or linguistic pattern features of said captured audio data; a pattern matching system to match one or more subsets of said pattern features to a database of pattern features and to determine feedback data responsive to said match; and a feedback system to provide feedback to said user using said feedback data to facilitate said user to achieve said spoken language goal. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A carrier carrying computer program code to, when running, facilitate learning of a spoken language, the code comprising code to implement:
-
a user interface to prompt a user of the system to produce a spoken language goal and to capture audio data comprising speech captured from said user in response; a speech analysis system to analyse said captured audio data to determine acoustic or linguistic pattern features of said captured audio data; a pattern matching system to match one or more subsets of said pattern features to a database of pattern features and to determine feedback data responsive to said match; and a feedback system to provide feedback to said user using said feedback data to facilitate said user to achieve said spoken language goal.
-
-
14. A speech processing system for processing speech and outputting instruction data items responsive to identified acoustic and linguistic patterns in said speech, the system comprising:
-
a front end processing module, having an input to receive analogue speech data, an analogue to digital converter to convert said analogue speech data into digital speech data, means for performing a Fourier analysis on said digital speech data to provide a frequency spectrum of said digital speech data, means for generating feature vector data and prosodic feature data from said frequency spectrum of said digital speech data, said prosodic feature data comprising a combination of a determined fundamental frequency of a segment of said digital speech data corresponding to a phone or a word, a duration of said digital speech data and an energy in said segment of digital speech data; a statistical speech recognition module coupled to said front end processing module, having an input to receive said feature vector data and said prosodic feature data, and comprising a lexicon, an acoustic model, and a language model, said lexicon having an input to receive said prosodic feature data, a memory storing a pre-determined mapping of said prosodic feature data to acoustic data items, and an output to output said acoustic data items, said acoustic data items being one or more of data defining phones and data defining words and data defining syllables, said acoustic model having an input to receive said acoustic data items, said feature vector data and said prosodic feature data, and comprising a probabilistic model operable to determine the probability of said acoustic data items existing in said feature vector data and said prosodic feature data, selecting said acoustic data items with a highest match probability and outputting said acoustic data items with said highest match probability, said language model having an input to receive said acoustic data items from said lexicon and an output to output a language data item, said language data item comprising data identifying one or more of phones, words and syllables in said digital speech data, the language model comprising means to analyse at least one previously generated language data item and said acoustic data items from said lexicon and to generate a further said language data item for output; an acoustic pattern feature extraction module coupled to said statistical speech recognition module and said front end processing module, having an input to receive said acoustic data items from said statistical speech recognition module, having an input to receive said prosodic feature data from said front end processing module, and means for determining acoustic features of said acoustic data items from said prosodic data items, said acoustic features comprising pitch trajectory, and outputting acoustic feature data items defining said acoustic features; a linguistic pattern feature extraction module coupled to said statistical speech recognition module and having an input to receive said language data items, a memory storing predefined linguistic structures, said linguistic structures storing at least one of grammatical patterns and semantic patterns, means for matching said language data items to said predefined linguistic structures, and means for outputting a linguistic structure data item comprising data characterising a linguistic structure of said language data items according to said predefined linguistic structures in said linguistic structure memory; a pattern feature memory, configured to store a plurality of pattern-instruction pairs, a pattern item in said pattern-instruction pair defining a language learning goal and an instruction in said pattern-instruction pair defining an instruction item responsive to said pattern item defining a language learning goal; a pattern matching module coupled to said acoustic pattern feature extraction module and said linguistic pattern feature extraction module and said pattern feature memory, having an input to receive said acoustic feature data items from said acoustic pattern feature extraction module, having an input to receive said linguistic structure data items from said linguistic pattern feature extraction module, and means for matching said acoustic feature data items to said plurality of pattern-instruction pairs in said pattern feature memory by comparing said pattern items in said pattern-instruction pair and said acoustic feature data items output from said acoustic pattern feature extraction module, means for matching said linguistic structure data items to said plurality of pattern-instruction pairs by comparing said linguistic structure data items with said pattern items in said plurality of acoustic and linguistic pattern-instruction pairs, outputting said instruction items responsive to said pattern items in said plurality of acoustic and linguistic pattern-instruction pairs. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification