I don't think poor, white people are an edge case. As of 2007, 9.9% of the white, non-hispanic population lived in poverty (compared to 27.6% of black people and 26.6% of hispanics). The numbers are lower, but they are far from edge cases. The source of adversity in the human experience is not solely rooted in race.
Thus African Americans are more than twice as likely to live under the poverty line. Those are not I odds I would like to gamble with had I been born black.
There will always be some people who have it better than others. I would prefer that we make sure that those who have it the worst comparatively don't have it that bad on an absolute scale.