This new book offers a new, theoretical approach to information dynamics, i.e., information processing in complex dynamical systems. The presentation establishes a consistent theoretical framework for the problem of discovering knowledge behind empirical, dynamical data. The book is an essential book for advanced graduates, researchers, and professionals in neural computing, information theory, nonlinear dynamics and complex systems modeling.