Fairness Threshold Explorer

Set separate decision thresholds by subgroup and watch sensitivity, specificity and PPV trade off against one another.

  • fairness
  • thresholds
  • subgroup
  • equal opportunity
Sensitivity gap (M−F)
0.097
Specificity gap (M−F)
-0.037
PPV gap (M−F)
0.032
Prevalence (M / F)
0.304 / 0.208

Fairness metrics by group

Thresholds are set independently per group above.
GroupNPrevalenceSensitivitySpecificityPPV
Male260.0000.3040.9370.8950.796
Female240.0000.2080.8400.9320.764
Difference (M−F)0.097-0.0370.032

Predicted probability distributions by group

th (M)th (F)00.10.20.30.40.50.60.70.80.910510152025303540Predicted probabilityCount
MaleFemale
You cannot equalize everything at once
With unequal base rates and imperfect discrimination, no single pair of thresholds can equalize sensitivity, specificity and PPV simultaneously (the impossibility result of Chouldechova/Kleinberg et al.). Choosing which fairness criterion to satisfy is a value judgment, not a technical one.