Lord, who createdst man in wealth and storeThou foolishly he lost the same (1-2)
Okay, okay, it's easy for our speaker blame it all on Adam. God gave him a garden and a wife and the chance to just laze around with the tame tigers without even getting dressed—and he totally blew it with that apple. That first human mistake, which introduced a whole lotta bad into the world (we're talking pain, work, and evil), is the reason everyone else keeps losing money and getting sick.
And sing this day thy victories (9)
"This day" refers to Easter, a holiday that commemorates Christ's biggest victory: giving death the smack down and rising out of the tomb to eternal life. Good Christians celebrate by singing hymns or, if you're a poet named Herbert, writing shaped poetry called "Easter Wings."
Then shall the fall further the flight in me (10)
Adam's fall was bad, no doubt about it. But Herbert voices a unique take on the badness in this last line. It's only because Adam fell that it's necessary for the speaker to rise up out of human sin and poverty. And that opportunity to rise is actually a good thing and not just because flying is awesome. It gives the speaker the chance to worship God and get closer to him.