It sure seems like the speaker of "Upon Julia's Clothes" is in love with Julia; the very fact that he calls her "my Julia" (1) suggests a little romance. But of course the poem is really about her clothes, and it's the way the speaker describes those clothes that reveals his true feelings. The poem is interested in the question of how our feelings for someone affect the way we imagine them and their clothes.
This speaker doesn't love Julia. Not even close. He just thinks she's hot.
His obsession with her clothes (material possessions), and the fact that he calls her "my Julia" tells us that this speaker doesn't love her; he just views her as a trophy. Not cool dude.