Lord, who createdst man in wealth and store,Though foolishly he lost the same (1-2)
Although Herbert doesn't go out and shout SIN NO MORE to Adam, he makes it clear in stanza 2 that Adam's mistakes are more than just foolishness: they're genuine sins. Why else would every subsequent human be born into "sorrow" (11)? Because Adam committed the first sin against God, everyone else inherits it and must figure out some way to chuck it. For Herbert and other good Christians, that means using Christ's resurrection to repent.
Decaying more and more,Till he becameMost poor (3-5)
Although "decay" usually refers to bacterial decomposition of organic substances (see: bananas), in the context of Adam's slip-up, it also means moral decay. That forbidden fruit might have tasted good and all, but now Adam's soul is rotting, so thanks for nothing.
My tender age in sorrow did begin (11)
There's a lot of blame in this one line and it's directed towards Adam. If he hadn't sinned, maybe the speaker could have been born in joy or glee or even just moderate okayness. Instead, every human comes into the world with Adam's baggage, or what Christians call original sin. Not only does that mean they have something to repent right off the bat; it also signals that they'll confront a life of hard work and pain.