What is the effect of comparing the campus building to an "old plantation manor house" in Invisible Man

I think this brings back the whole aura of slavery. Even though blacks are permitted on campus, there is a sense that they are only tolerated on the terms of the old white men that run the school. The underlying spirit of racism still pervades the campus building.