- A Dissertation Upon Extraordinary Awakenings, or Religious Stirs: Conversion, Regeneration, Renovation, and a Change of Heart; Conference Meetings; Extraordinary Gifts in Extempore Prayer; Evangelical
- The Universalist Manual: Or Book of Prayers and Other Religious Exercises: Adapted to the Use Both
- A Catechism of the Bible
- Universal Grace, a Doctrine Worthy of All Acceptation: A Sermon Delivered at Monroe, (Conn.) by REV. Menzies Rayner, as a Farewell Discourse, on Resigning His Pastoral Office, Over the Episcopal Churc
- Parable of the Rich Man and Lazarus: Illustrated in Nine Lectures, Delivered in the First Universali