Affirmative Action...slowly degrading our overall quality of goods/output...?

In theory it could degrade quality over time but the 'quota' usually isn't large enough to be a significant factor in reality. In addition, it's just as likely that hiring a minority you hire is good and several majority candidates you hire are not.