Text dependent speaker recognition with long-term feature based on functional data analysis

• US 9,153,235 B2
• Filed: 03/13/2013
• Issued: 10/06/2015
• Est. Priority Date: 04/09/2012
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Chen, Ruxin, Zhang, Chenhao, Zheng, Thomas Fang
• Primary Examiner(s): Baker, Charlotte M
• Application Number:
  US13/799,647
• Publication Number:
  US 20130268272A1
• Time in Patent Office: 937 Days
• Field of Search: 704/243, 702/51, 702/60, 702/61, 702/65
• US Class Current: 1/1
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/02 Preprocessing operations, e.g. segment selection; Pattern representation or modelling, e.g. based on linear discriminant analysis [LDA] or principal components; Feature selection or extraction
• CPC Class Codes: G10L 17/08 Use of distortion metrics or a particular distance between probe pattern and reference templates
• CPC Class Codes: G10L 17/24 the user being prompted to utter a password or a predefined phrase

Abstract

One or more test features are extracted from a time domain signal. The test features are represented by discrete data. The discrete data is represented for each of the one or more test features by a corresponding one or more fitting functions, which are defined in terms of finite number of continuous basis functions and a corresponding finite number of expansion coefficients. Each fitting function is compressed through Functional Principal Component Analysis (FPCA) to generate corresponding sets of principal components. Each principal component for a given test feature is uncorrelated to each other principal component for the given test feature. A distance between a set of principal components for the given test feature and a set of principal components for one or more training features with the processing system is calculated. The test feature is classified according to the distance calculated with the processing system.

Claims

1. A method, comprising:

extracting one or more test features from a time domain signal, wherein the one or more test features are represented by discrete data with a processing system;

representing the discrete data for each of the one or more test features by a corresponding one or more fitting functions with the processing system, wherein each fitting function is defined in terms of a finite number of continuous basis functions and a corresponding finite number of expansion coefficients;

compressing the fitting functions through Functional Principal Component Analysis (FPCA) with the processing system to generate corresponding sets of principal components of the fitting functions for each test feature, wherein each principal component for a given test feature is uncorrelated to each other principal component for the given test feature;

calculating a distance between a set of principal components for the given test feature and a set of principal components for one or more training features with the processing system;

classifying the test feature according to the distance calculated with the processing system; and

adjusting a state of the processing system according to a classification of the test feature determined from the distance calculated.

2. The method of claim 1, wherein the time domain signal is a time domain speech signal.

3. The method of claim 2, wherein the one or more test features include one or more mel-frequency cepstral coefficient (MFCC) features.

4. The method of claim 1, wherein the time domain signal is a time domain speech signal and wherein classifying the test feature according to the distance calculated includes determining whether the time domain signal corresponds to a particular individual speaking a particular utterance.

5. The method of claim 1, wherein the each principal component is an integral of a product of a corresponding one of the one or more fitting functions with a weighting function.

6. The method of claim 1, wherein representing the discrete data for each of the one or more test features by a corresponding one or more fitting functions includes minimizing a sum of square errors between the discrete data for a feature and a corresponding fitting function.

7. The method of claim 1, wherein representing the discrete data for each of the one or more test features by a corresponding one or more fitting functions includes minimizing a quantity that includes a sum of square errors between the discrete data for a feature and a corresponding fitting function and an integral of the second derivative of the corresponding fitting function multiplied by a smoothing parameter.

8. The method of claim 1, wherein the one or more basis functions are Fourier basis functions.

9. A non-transitory computer readable medium having computer-executable instructions embodied therein, the instructions being configured to implement a method upon execution, the method comprising:

extracting one or more test features from a time domain signal, wherein the one or more test features are represented by discrete data with a processing system;

representing the discrete data for each of the one or more test features by a corresponding one or more fitting functions with the processing system, wherein each fitting function is defined in terms of a finite number of continuous basis functions and a corresponding finite number of expansion coefficients;

compressing the fitting functions through Functional Principal Component Analysis (FPCA) with the processing system to generate corresponding sets of principal components of the fitting functions for each test feature, wherein each principal component for a given test feature is uncorrelated to each other principal component for the given test feature;

calculating a distance between a set of principal components for the given test feature and a set of principal components for one or more training features with the processing system;

classifying the test feature according to the distance calculated with the processing system;

adjusting a state of the processing system according to a classification of the test feature determined from the distance calculated.

10. A system comprising:

a processor;

a memory;

a set of processor-executable instructions embodied in the memory, the instructions being configured to implement a method upon execution, the method comprising;

extracting one or more test features from a time domain signal, wherein the one or more test features are represented by discrete data with a processing system;

representing the discrete data for each of the one or more test features by a corresponding one or more fitting functions with the processing system, wherein each fitting function is defined in terms of a finite number of continuous basis functions and a corresponding finite number of expansion coefficients;

compressing the fitting functions through Functional Principal Component Analysis (FPCA) with the processing system to generate corresponding sets of principal components of the fitting functions for each test feature, wherein each principal component for a given test feature is uncorrelated to each other principal component for the given test feature;

calculating a distance between a set of principal components for the given test feature and a set of principal components for one or more training features with the processing system;

classifying the test feature according to the distance calculated with the processing system;

adjusting a state of the processing system according to a classification of the test feature determined from the distance calculated.

11. The system of claim 10, wherein the time domain signal is a time domain speech signal.

12. The system of claim 11, wherein the one or more test features include one or more mel-frequency cepstral coefficient (MFCC) features.

13. The system of claim 10, wherein the time domain signal is a time domain speech signal and wherein classifying the test feature according to the distance calculated includes determining whether the time domain signal corresponds to a particular individual speaking a particular utterance.