Information Theory And Statistics: A Tutorial

Download

E-Book Overview

Information Theory and Statistics: A Tutorial is concerned with applications of information theory concepts in statistics, in the finite alphabet setting. The topics covered include large deviations, hypothesis testing, maximum likelihood estimation in exponential families, analysis of contingency tables, and iterative algorithms with an "information geometry" background. Also, an introduction is provided to the theory of universal coding, and to statistical inference via the minimum description length principle motivated by that theory. The tutorial does not assume the reader has an in-depth knowledge of Information Theory or statistics. As such, Information Theory and Statistics: A Tutorial, is an excellent introductory text to this highly-important topic in mathematics, computer science and electrical engineering. It provides both students and researchers with an invaluable resource to quickly get up to speed in the field.

E-Book Content

Information Theory and Statistics: A Tutorial Information Theory and Statistics: A Tutorial Imre Csisz´ ar R´ enyi Institute of Mathematics, Hungarian Academy of Sciences POB 127, H-1364 Budapest, Hungary [email protected] Paul C. Shields Professor Emeritus of Mathematics, University of Toledo, Ohio, USA [email protected] Boston – Delft R in Foundations and Trends Communications and Information Theory Published, sold and distributed by: now Publishers Inc. PO Box 1024 Hanover, MA 02339 USA Tel. +1 781 871 0245 www.nowpublishers.com
You might also like

Computational Biochemistry And Biophysics
Authors: Oren M. Becker , Alexander D. MacKerell Jr. , Benoit Roux , Masakatsu Watanabe    233    0

Computationalism: New Directions
Authors: Matthias Scheutz    214    0

Modular Algorithms In Symbolic Summation And Symbolic Integration
Authors: Jürgen Gerhard (auth.)    138    0

Lecture Notes On Computer Algebra
Authors: Ziming Li.    153    0

Curve And Surface Reconstruction: Algorithms With Mathematical Analysis
Authors: Tamal K. Dey    155    0

Plasticity Of Metals: Experiments, Models, Computation: Final Report Of The Collaborative Research Centre 319, ''stoffgesetze Fur Das Inelastische Verhalten Metallischer Werkstoffe - Entwicklung Und Technische Anwendung'' 1985 - 1996
Authors: Elmar Steck , Reinhold Ritter , Udo Peil , Alf Ziegenbein , Collaborative Research Centres    125    0

Mathematical Thinking And Writing: A Transition To Abstract Mathematics
Authors: Randall Maddox    166    0

A Field Guide To Algebra
Authors: Antoine Chambert-Loir    179    0

Abstract Algebra
Authors: Pierre Antoine Grillet (auth.)    192    0

Set Theory And Its Philosophy: A Critical Introduction
Authors: Michael Potter    169    0