Classifying knowledge aging in emails using Naïve Bayes Classifier

• US 7,672,912 B2
• Filed: 10/26/2006
• Issued: 03/02/2010
• Est. Priority Date: 10/26/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Penev, Kamen, Marshall, Stuart H.
• Primary Examiner(s): Vincent; David R
• Assistant Examiner(s): Olude-Afolabi; Ola
• Application Number:
  US11/586,923
• Publication Number:
  US 20080154813A1
• Time in Patent Office: 1,223 Days
• Field of Search: None
• US Class Current: 706/14
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: H04L 51/212 using filtering or selective blocking

Abstract

The Naïve Bayes Classifier predicts the classification of a set of data based on the features of that data and a series of counts reflecting the information obtained from prior data sets, with one count per feature per class. An external boost can be applied to the counts generated by the NBC to account for external information. Such a boost is added to the counts generated by the NBC, and the boosted counts are then used by the NBC. A boost can be applied to some or all of the counts and the boost for each count can be applied independently. Likewise, the counts can be periodically aged by multiplying the counts with an aging factor of between 0 and 1 per period. Aging factors can be applied uniformly across all counts, or can be individually applied, enabling some counts to age more than others.

Claims

1. A method to be performed on a computing device, the computing device comprising a central processing unit and a memory, the method comprising:

using the central processing unit to obtain one or more counts generated by a statistical classifier, the one or more counts being based on historical verified data, comprising one or more data entries, that is consumed by the statistical classifier;

selecting one or more aging factors reflecting a correlation between the historical verified data'"'"'s age and its relevance to new data, wherein the selecting the one or more aging factors comprises providing a user interface for selecting the one or more aging factors;

aging the one or more counts with the one or more aging factors;

classifying new data using the statistical classifier employing the aged one or more counts.

2. The method of claim 1 further comprising:

selecting an initial set of one or more aging factors;

aging the one or more counts with the initial set of one or more aging factors to form an initial aged set of counts;

determining an initial predictive accuracy of the statistical classifier using the initial aged set of counts;

selecting a subsequent set of one or more aging factors;

aging the one or more counts with the subsequent set of one or more aging factors to form an subsequent aged set of counts;

determining a subsequent predictive accuracy of the statistical classifier using the subsequent aged set of counts;

comparing the initial predictive accuracy to the subsequent predictive accuracy; and

selecting the one or more aging factors based on a highest relative predictive accuracy of the statistical classifier using the aged one or more counts.

3. The method of claim 1 further comprising:

maintaining both the one or more counts and the aged one or more counts.

4. The method of claim 1, wherein the one or more aging factors are greater than 1.

5. The method of claim 1, wherein the aging the one or more counts is performed on a periodic basis.

6. The method of claim 1, wherein the aging the one or more counts occurs on an individual data entry basis.

7. The method of claim 1, wherein the selecting the one or more aging factors is based on a piecewise continuous aging function.

8. A statistical classification system comprising:

a central processing unit coupled to a system memory, the system memory comprising;

a statistical model comprising a series of counts, with each count counting a number of occurrences of a feature value per class amongst a set of data entries;

a statistical classifier for generating the statistical model and using the statistical model to classify new data entries;

and a count modification mechanism, external to the statistical classifier, for modifying the series of counts, wherein the count modification mechanism comprises a user interface for viewing or selecting modification data, wherein the count modification mechanism comprises a boosting mechanism for selecting one or more boost values for one or more counts of the series of counts, and, an aging mechanism for selecting one or more aging factors for one or more counts of the series of counts.

9. The statistical classification system of claim 8, wherein the series of counts comprises an aged series of counts and a non-aged series of counts.

10. The statistical classification system of claim 8, wherein the count modification mechanism further comprises a boosting mechanism for selecting one or more boost values for the one or more counts of the series of counts.

11. The statistical classification system of claim 8, wherein the aging mechanism selects the one or more aging factors by performing steps comprising:

selecting an initial set of one or more aging factors;

aging the one or more counts with the initial set of one or more aging factors to form an initial aged set of counts;

determining an initial predictive accuracy of the statistical classifier using the initial aged set of counts;

selecting a subsequent set of one or more aging factors;

aging the one or more counts with the subsequent set of one or more aging factors to form an subsequent aged set of counts;

determining a subsequent predictive accuracy of the statistical classifier using the subsequent aged set of counts;

comparing the initial predictive accuracy to the subsequent predictive accuracy; and

selecting the one or more aging factors based on a highest relative predictive accuracy of the statistical classifier using the aged one or more counts.