The speaker remembers the turning point in their relationship. Perhaps she was conscious of the shift, and so perhaps it was a conscious decision to love her husband.
Quote #5
You dragged your feet when you went out. (19)
This is another detail that draws upon the husband's own memory, in case he forgot just how sorry he was to leave her.