Bounds for the Loss in Probability of Correct Classification Under Model Based Approximation
2006 (English)In: Journal of Machine Learning Research, ISSN 1532-4435 (print), 1533-7928 (online), Vol. 7, 2449-2480 p.Article in journal (Refereed) Published
In many pattern recognition/classification problem the true class conditional model and class probabilities are approximated for reasons of reducing complexity and/or of statistical estimation. The approximated classifier is expected to have worse performance, here measured by the probability of correct classification. We present an analysis valid in general, and easily computable formulas for estimating the degradation in probability of correct classification when compared to the optimal classifier. An example of an approximation is the Na¨ıve Bayes classifier. We show that the performance of the Naïve Bayes depends on the degree of functional dependence between the features and labels. We provide a sufficient condition for zero loss of performance, too.
Place, publisher, year, edition, pages
2006. Vol. 7, 2449-2480 p.
Bayesian networks, na¨ıve Bayes, plug-in classifier, Kolmogorov distance of variation, variational learning
IdentifiersURN: urn:nbn:se:liu:diva-13104OAI: oai:DiVA.org:liu-13104DiVA: diva2:17842