"Portrait in Georgia" is a good example of the blurred line between genders. By keeping the reader in the dark about the subject's gender, the poet forces the reader to reconsider gender and race lines. Is this poem about a white woman? A black woman? A black man? Can it be about all three at once? There are so many different ways to read this one, it'll have your head spinning for sure.
The poem is describing a white woman, but the lynching victim it's using in the metaphor is clearly a black man. Why? Because Toomer wanted to poetically address the racial and gender dynamics of the South.
There is no man in this poem whatsoever. It's entirely about women—the white woman being described, and an African American female lynching victim who provides the imagery to do the describing.