The Relationship between PAC the Statistical Physics framework the Bayesian framework and the VC framework 1994 39 citations ? 8 self

Abstract:  : This paper discusses the intimate relationships between the supervised learning frameworks mentioned in the title. In particular, it shows how all those frameworks can be viewed as particular instances of a single overarching formalism. In doing this many commonly misunderstood aspects of those frameworks are explored. In addition the strengths and weaknesses of those frameworks are compared, and some novel frameworks are suggested (resulting, for example, in a "correction" to the familiar bias-plus-variance formula) . "Give a man a hammer, and every problem looks like a nail." - Paraphrase of comment by J. Friedman. "Have toolbox will travel." - Motto for The Handy Hardware Company, which is now out of business. "Careful with that axe Eugene." - R. Waters 2 INTRODUCTION i) Background. In the last decade several theoretical frameworks for addressing supervised learning have been discussed in the neural net community. Some of them are represented in the other papers in this proceed...