The dynamic programming principle.- Implementing dynamic programming.- Modeling for dynamic programming.- Numerical dynamic programming for discrete states.- Approximate dynamic programming and reinforcement learning for discrete states.- Numerical dynamic programming for continuous states.- Approximate dynamic programming and reinforcement learning for continuous states.