- The Early History of Illinois: From Its Discovery by the French, in 1673, Until Its Cession to Great Britain in 1763, Including the Narrative of Marquette's Discovery of the Mississippi
- The Professions
- Address in Commemoration of the Inauguration of George Washington as First President of the United States: Delivered Before the Two Houses of Congress
- Address in Commemoration of the Inauguration of George Washington: As First President of the United States; Delivered Before the Two Houses of Congress, December 11, 1889 (Classic Reprint)
- Addresses and Poem On the Occasion of the One-Hundredth Anniversary of the Incoroporation of Bowdoin College: June 27 and 28, 1894