An Introduction to Information Theory

By: Reza, Fazlollah M.

Written for an engineering audience, this book has a threefold purpose: (1) to present elements of modern probability theory -- discrete, continuous, and stochastic; (2) to present elements of information theory with emphasis on its basic roots in probability theory; and (3) to present elements of coding theory. The emphasis throughout the book is on such basic concepts as sets, the probability measure associated with sets, sample space, random variables, information measure, and capacity. These concepts proceed from set theory to probability theory and then to information and coding theories. No formal prerequisites are required other than the usual undergraduate mathematics included in an engineering or science program. However, since these programs may not include a course in probability, the author presents an introductory treatment of probability for those who wish to pursue the general study of statistical theory of communications. The book is divided into four parts: memoryless discrete themes, memoryless continuum, schemes with memory, and an outline of some recent developments. An appendix contains notes to help familiarize the reader with the literature in the field, while the inclusion of many reference tables and an extensive bibliography with some 200 entries makes this an excellent resource for any student in the field.

• Format: Paperback
• Language: English
• ISBN: 0486682102
• ISBN13: 9780486682105
• Release Date: January 1994
• Publisher: Dover Publications
• Length: 528 Pages
• Weight: 1.19 lbs.
• Dimensions: 1.0" x 5.4" x 8.4"

Customer Reviews

A Must Read for Beginners

This Reza book is what the Ash book should have been (both are published by Dover). While the Ash book focuses on much moreadvanced topics in information theory and requires a much higher level knowledge of mathematics, it gives no real cluewhatsoever as to what information theory really is... at leastif your of the "engineer" mentality... the Ash book won't bemuch help because it's to rigorous and not practical enough(i.e...

The best book for beginners

This book is the best, like introduction in the theoryinformation. The examples are great, the analogies withthe circuit are helpful. The review of mathematical backgrounds,in special the statistical, the theorems, permit agood comprehension.The new books in this topic are bad, because they separatethe aplications and the theory, don't waste your money in them!

A crisp and clear treatment.

Like most Dover mathematics books, this is a high-quality reprint of an older textbook (1961). I have read the first 100 pages, and am very impressed thus far. The writing is crisp and clear, and moves at a good pace. The book seems to me to be ideal for self-study and as a lead-in to more modern (and complex) treatments. In a way, the age of the book stands in its favor, as Information Theory was just being canonized...