1.Introduction.- 2.Background.- 3.Reinforcement Learning for Information Seeking dialogue strategies.- 4.The bootstrapping approach to developing Reinforcement Learning-based strategies.- 5.Data Collection in aWizard-of-Oz experiment.- 6.Building a simulated learning environment from Wizard-of-Oz data.- 7.Comparing Reinforcement and Supervised Learning of dialogue policies with real users.- 8.Meta-evaluation.- 9.Adaptive Natural Language Generation.- 10.Conclusion.- References.- Example Dialogues.- A.1.Wizard-of-Oz Example Dialogues.- A.2.Example Dialogues from Simulated Interaction.- A.3.Example Dialogues from User Testing.- Learned State-Action Mappings.- Index.