There has been a lot of talk about who the mysterious woman in this poem might have been. Because of her wiry hair and dun skin, some have speculated that Shakespeare's "Dark Lady" may have been of African descent. (Source)
Or maybe (others think) she was a married woman named Emilia Lanier who came from a Jewish background. There's a pretty interesting bit about her on PBS.