Mitigation#

Warning

This page is currently under construction. Please check back later for updates.

Introduction#

This page is currently under construction. Please check back later for updates.

Note

Bias mitigation can be approached through pre-processing, in-processing, and post-processing methods.

Bias in AI systems can lead to systematic disadvantages for certain individuals or groups. To address and reduce these biases, several mitigation methods can be employed throughout the development process, from data generation to model deployment. This document outlines various techniques and strategies for mitigating bias in AI systems.

Pre-processing Methods

Pre-processing techniques aim to mitigate bias by transforming the data before it is used to train a model. This can include:

  • Reweighting: Adjusting the weights of data points to ensure balanced representation across groups.

  • Resampling: Over-sampling underrepresented groups or under-sampling overrepresented groups to achieve a balanced dataset.

  • Data Augmentation: Generating synthetic data to bolster the representation of minority groups.

  • Fair Representation Learning: Learning new representations of data that remove sensitive information while retaining useful information for prediction.

In-processing Methods

In-processing techniques modify the learning algorithm itself to reduce bias during the model training phase. This can include:

  • Adversarial Debiasing: Training the model in conjunction with an adversary that penalizes the model for producing biased predictions.

  • Fairness Constraints: Incorporating constraints that enforce fairness criteria directly into the optimization objective of the learning algorithm.

  • Regularization Techniques: Adding regularization terms to the loss function that penalize bias.

Post-processing Methods

Post-processing techniques adjust the predictions of the trained model to mitigate bias. This can include:

  • Calibrated Equalized Odds: Adjusting the decision thresholds for different groups to achieve equalized odds across groups.

  • Reject Option Classification: Allowing uncertain predictions to be reconsidered, particularly for disadvantaged groups, to improve fairness.

  • Output Adjustment: Modifying the output probabilities to ensure fair treatment across groups.

Summary Table#

The following table summarizes the bias mitigation methods and their applicability at different Machine Learning (ML) tasks.

Table 4 Bias Mitigation Methods#

Type Strategy

Method name

Binary Classification

Multi Classification

Regression

Clustering

Recommender Systems

Preprocessing

Correlation Remover

X

X

X

Preprocessing

Disparate Impact Remover

X

X

X

X

Preprocessing

Learning Fair Representation

X

Preprocessing

Reweighing

X

X

Preprocessing

Fair Clustering

X

Inprocessing

Adversarial Debiasing

X

Inprocessing

Exponentiated Gradient

X

X

Inprocessing

Fair K Center Clustering

X

Inprocessing

Fair K Median Clustering

X

Inprocessing

Fair Scoring Classifier

X

Inprocessing

Fairlet Clustering

X

Inprocessing

Grid Search

X

X

Inprocessing

Debiasing Learning

X

Inprocessing

Blind Spot Aware

X

Inprocessing

Popularity Propensity

X

Inprocessing

Meta Fair Classifier

X

Inprocessing

Prejudice Remover

X

Inprocessing

Two Sided Fairness

X

Inprocessing

Variational Fair Clustering

X

Postprocessing

Debiasing Exposure

X

Postprocessing

Fair Top-K

X

Postprocessing

LP Debiaser

X

X

Postprocessing

MCMF Clustering

X

Postprocessing

ML Debiaser

X

X

Postprocessing

Plugin Estimator and Recalibration

X

Postprocessing

Wasserstein Barycenters

X

Postprocessing

Calibrated Equalized Odds

X

Postprocessing

Equalized Odds

X

Postprocessing

Reject Option Classification

X

Postprocessing

Disparate Impact Remover for RS

X