I think basing Affirmative Action on actual financial need and not race would be fairer. I'm not opposed to private companies and universities who choose to put an Affirmative Action policy into place (heck, the ones that do this might get more minority applicants), but the government has no place in forcing that ideology upon other institutions or itself. Yes, it's an ideology, even if it's a true one.
Yes, white people fucked over basically every minority in US history. No, that doesn't mean their descendants have to be looked over for a position they are qualified for just because someone else who is equally qualified happens to be a minority. If it really gets down to the point where you have to pick between a white applicant and a black applicant, and both are equally qualified, and you want to be fair, flip a damn coin.