Exponential priors for maximum entropy models
First Claim
1. A computer implemented method that facilitates maximizing probability values comprising:
- employing a maximum entropy model using at least one of a plurality of Exponential priors to maximize probability values;
employing an update function for the maximum entropy model, the update function comprising an observed_count-discount term; and
bounding a parameter value.
2 Assignments
0 Petitions
Accused Products
Abstract
The subject invention provides for systems and methods that facilitate optimizing one or mores sets of training data by utilizing an Exponential distribution as the prior on one or more parameters in connection with a maximum entropy (maxent) model to mitigate overfitting. Maxent is also known as logistic regression. More specifically, the systems and methods can facilitate optimizing probabilities that are assigned to the training data for later use in machine learning processes, for example. In practice, training data can be assigned their respective weights and then a probability distribution can be assigned to those weights.
-
Citations
11 Claims
-
1. A computer implemented method that facilitates maximizing probability values comprising:
-
employing a maximum entropy model using at least one of a plurality of Exponential priors to maximize probability values;
employing an update function for the maximum entropy model, the update function comprising an observed_count-discount term; and
bounding a parameter value. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A data packet adapted to be transmitted between two or more computer processes facilitating providing suggestions to an online user, the data packet comprising:
information associated with employing a maximum entropy model using at least one of a plurality of Exponential priors to maximize probability values;
employing an update function for the maximum entropy model, the update function comprising an observed_count-discount term; and
bounding a parameter value.
Specification