THE TEACHING OF MATHEMATICS

THE TEACHING OF MATHEMATICS
A Classroom Note: Entropy, Information, and Markov Property
Zoran R. Pop-Stojanović

Abstract

How to introduce the concept of the Markov Property in an elementary Probability Theory course? From this author's teaching experience, it appears that the best way that gives a natural intuitive flavor and preserves the mathematical rigor, is to use concepts of entropy and information from the classical Shannon Information Theory, as suggested in the brilliant monograph of A. Rényi [5]. Following this path, the connection between Entropy and Markov Property is presented.

Creative Commons License

Keywords: Random variable, Independence, Entropy, Information, Conditional Probability, Sufficient Function, Markov Chain.

Pages:  1$-$12     

Volume  IX ,  Issue  1 ,  2006