Entropy optimization has become a powerful tool for data analysis and problem solving that has an infinite array of real-world applications. This senior-level textbook provides a unified conceptual framework for the study of probabilistic systems with its elucidation of three key concepts: Shannon's Information Theory, Jayne's Maximum Entropy Principle, and Kullback's Minimum Cross-Entropy Principle. A wide array of real-world problems and applications...