Continous State and Action Spaces.- Relational and First-Order Knowledge Representation.- Hierarchical Approaches.- Predictive Approaches.- Multi-Agent Reinforcement Learning.- Partially Observable Markov Decision Processes (POMDPs).- Decentralized POMDPs (DEC-POMDPs).- Features and Function Approximation.- RL as Supervised Learning (or batch learning).- Bounds and complexity.- RL for Games.- RL in Robotics.- Policy Gradient Techniques.- Least Squares...