ai-testing AI Fairness Metrics: Measuring Demographic Parity, Equalized Odds, and Calibration In 2018, Amazon scrapped an AI hiring tool that had been in development for four years.