Method and system for building an integrated user profile
First Claim
1. A method for assigning values to user profile properties based on user speech analysis, comprising:
- receiving extracted features from a feature extraction module, including at least acoustic features, the extracted features representing user speech observed over a first time period;
deriving features by executing a function that uses one or more of the extracted features as input, wherein at least one of the derived features is derived from an extracted acoustic feature;
storing, using a processor, derived features;
computing, using a processor, extended features as a function of one or more of;
the extracted features;
the derived features; and
statistics based on the extracted features and the derived features received during a second time period that is longer than the first time period;
deriving a value of a user profile property by executing a classifier that uses the computed extended features as input, the classifier trained on labeled extended features for the user profile property; and
storing, by a processor, the value assigned to the user profile property in a user profile.
9 Assignments
0 Petitions
Accused Products
Abstract
A system and method are provided for adding user characterization information to a user profile by analyzing user'"'"'s speech. User properties such as age, gender, accent, and English proficiency may be inferred by extracting and deriving features from user speech, without the user having to configure such information manually. A feature extraction module that receives audio signals as input extracts acoustic, phonetic, textual, linguistic, and semantic features. The module may be a system component independent of any particular vertical application or may be embedded in an application that accepts voice input and performs natural language understanding. A profile generation module receives the features extracted by the feature extraction module and uses classifiers to determine user property values based on the extracted and derived features and store these values in a user profile. The resulting profile variables may be globally available to other applications.
223 Citations
19 Claims
-
1. A method for assigning values to user profile properties based on user speech analysis, comprising:
-
receiving extracted features from a feature extraction module, including at least acoustic features, the extracted features representing user speech observed over a first time period; deriving features by executing a function that uses one or more of the extracted features as input, wherein at least one of the derived features is derived from an extracted acoustic feature; storing, using a processor, derived features; computing, using a processor, extended features as a function of one or more of; the extracted features; the derived features; and statistics based on the extracted features and the derived features received during a second time period that is longer than the first time period; deriving a value of a user profile property by executing a classifier that uses the computed extended features as input, the classifier trained on labeled extended features for the user profile property; and storing, by a processor, the value assigned to the user profile property in a user profile. - View Dependent Claims (2, 3, 4, 5, 6, 19)
-
-
7. A system for assigning values to user profile properties based on user speech analysis, comprising:
-
a processor; and a non-transitory computer-readable storage medium storing instructions, which when executed by the processor, cause the processor to; receive extracted features, including at least acoustic features, the extracted features representing user speech observed over a first time period; derive features by executing a function that uses one or more of the extracted features as input, wherein at least one of the derived features is derived from an extracted acoustic feature; store derived features; compute extended features as a function of one or more of; the extracted features; the derived features; and statistics based on the extracted features and the derived features received during a second time period that is longer than the first time period; derive a value of a user profile property by executing a classifier that uses the computed extended features as input, the classifier trained on labeled extended features for the user profile property; and store the value assigned to the profile property in a user profile. - View Dependent Claims (8, 9, 10, 11)
-
-
12. A non-transitory computer-readable storage medium storing instructions for assigning values to user profile properties based on user speech analysis, the instructions, which when executed by a processor, cause the processor to:
-
receive extracted features, including at least acoustic features, the extracted features representing user speech observed over a first time period; derive features by executing a function that uses one or more of the extracted features as input, wherein at least one of the derived features is derived from an extracted acoustic feature; store derived features; compute extended features as a function of one or more of; the extracted features; the derived features; and statistics based on the extracted features and the derived features received during a second time period that is longer than the first time period; derive the value of a user profile property by executing a classifier that uses the computed extended features as input, the classifier trained on labeled extended features for the user profile property; and store the value assigned to the profile property in a user profile. - View Dependent Claims (13, 14, 15, 16)
-
-
17. A method to determine user profile property values based on textual input, comprising:
-
receiving from a text-based natural language application a textual input entered by a user; creating a parse tree by processing the textual input against a grammar; deriving linguistic features from the parse tree; computing, using a processor, extended features as a function of one or more of; the linguistic features; and statistics based on the derived linguistic features; deriving the value of a user profile property by executing a classifier that uses the computed extended features as input, the classifier trained on labeled extended features for the user profile property; and storing the value assigned to the user profile property in a user profile. - View Dependent Claims (18)
-
Specification