The woman in "Sunday Morning" is torn between two viewpoints. Can she live in the moment and know when to let go of the good things on earth? Or, should she put her stock in Christian ideas of sacrifice and duty, hoping that they will help her find a happiness outside of the physical and natural world? In the final stanza, she seems to choose the worship of nature over the worship of a supernatural God.
By rejecting the supernatural elements of Christianity at the end of the poem, the woman rejects Christianity itself as a path to happiness.