Information Theory Part-1: An Introduction to the Fundamental Concepts

Preface
Acknowledgements
List of Abbreviations
Elements of Probability Theory
Introduction, Definition and Interpretations of Shannon;s Measure of Information
Properties of Shannon’s of Information
Conditional and Mutual Information
Multivariate Mutual Information
Entropy and the Second Law of Thermodynamics
Appendix - A: Proof of an Equivalent Markovian Property
Appendix - B: Proof of the Uniqueness of the Function H
Appendix - C: The SMI for the Continuous Random Variable
Appendix - D: Functional Derivatives and Functional Taylor Expansion
Appendix - E: Some Inequalities for Convex Functions
Appendix - F: Distribution Functions in 1D Models
Appendix - G: Entropy Change in an Expansion Process in a Gravitational Field
Notes
References and Suggested Reading
Index