I don't know.
I think Ulfric is misinterpreted as Racist.
I mean, Sure. Galmar is racist (So is every other Stone-fist in Windhelm) but Ulfric's not.
1) the Argonians: The Argonians being essentially forced into slave labor is the handiwork of the Shatter-shield clan. the Shatter-shield clan is wealthy, and an Influential family, but doesn't speak for either the Stormcloak Cause nor Ulfric Himself.
aside from that, even if the Shatter-shields were to stop what they were doing, the Argonians wouldn't be able to come into the city. here is why: the Dunmer living in The Grey Quarters are, unlike the other dunmer in skyrim, actually refugees. they escaped Morrowind when the Argonians attacked it (In retaliation of four eras of enslavement, but I digress) and the Dunmer live up to 500 years, so they probably still remember the Argonians. if the Argonians were allowed in the City, there would be daily fight. they have to be forced to live separated.
2) the Dunmer. the Dunmer's state of living is their own fault. here's why, According to the Decree of Monument, The Dunmer were given the right to live, and I quote, "untithed to any thane or hold, and self-governed, with free worship, with no compensation to Skyrim or the Empire except as writ in the Armistice of old wheresoever those might still apply"
A Little bit of Research helps one to find out, according to the Armistice, the Dunmer were given right to do whatever they liked in their land, without any help from the Empire, nor any legion patrol in the Dunmer Regions.
That means that the Grey Quarters is, according to the Decree of Monument, Dunmer County, it's not the responsibility of the Nords to take care of it. the Dunmer were just lazy, didn't work, and couldn't improve their own state of Living.
3) The Hatred of Altmer: That's also not true. There are two almer living in the city, both have their own business, and nobody seems to care either way, Ulfric included.
What Ulfric Hates is the Aldmeri Dominion. which, yes, everyone in Skyrim shares that hatred.
4) What's more, Ulfric doesn't ever say, or do, anything racist in the game. Check his dialogues in the UESP, or even the unused Dialogues if you want. not one racist word or expression. (I repeat that Galmar is openly racist. I don't argue with that)
and yes. The Empire is racist. The Orcs helped them fight in the Great war, and then the Empire didn't give a damn to improve their state of living. same thing with the Khajiit, Nords (Who are basically discriminated in their own homes) and even Redguards.