The speaker only mentions his soul once, but we can bet it's on his mind. In lines 32-34, the suit "flaps and hum[s]/ as if you were my soul" in the wind. This makes the soul seem like an annoyance, something that bothers the speaker when he's trying to do other things. Could he be saying that thinking about his soul annoys him? We know that he is concerned with mortality, too, so maybe these big questions distract him from his daily life. Or maybe, daily life reminds him of the more spiritual aspects of living. Either way, the soul keeps on flapping, annoying him as he tries to go about his life.