holisticai.bias.metrics

The holisticai.bias.metrics module includes classification, regression, multiclass, recommender and clustering bias metrics

Binary Classification

abroca	ABROCA (area between roc curves)
accuracy_diff	Accuracy Difference
average_odds_diff	Average Odds Difference
classification_bias_metrics	Classification bias metrics batch computation
cohen_d	Cohen D
disparate_impact	Disparate Impact.
equal_opportunity_diff	Equality of opportunity difference
false_negative_rate_diff	False negative Rate difference
false_positive_rate_diff	False positive rate difference
four_fifths	Four Fifths
statistical_parity	Statistical parity.
true_negative_rate_diff	True negative Rate difference
z_test_diff	Z Test (Difference)
z_test_ratio	Z Test (Ratio)

Multiclass Classification

accuracy_matrix	Multiclass Accuracy Matrix
confusion_matrix	Confusion Matrix
confusion_tensor	Confusion Tensor
frequency_matrix	Frequency Matrix
multiclass_average_odds	Multiclass Average Odds
multiclass_bias_metrics	Multiclass bias metrics batch computation
multiclass_equality_of_opp	Multiclass Equality of Opportunity
multiclass_statistical_parity	Multiclass statistical parity
multiclass_true_rates	Multiclass True Rates
precision_matrix	Multiclass Precision Matrix
recall_matrix	Multiclass Recall Matrix

Regression

avg_score_diff	Average Score Difference
correlation_diff	Correlation difference
disparate_impact_regression	Disparate Impact quantile (Regression version)
mae_ratio	MAE ratio
max_statistical_parity	Max absolute statistical parity
no_disparate_impact_level	No disparate impact level
regression_bias_metrics	Regression bias metrics batch computation
rmse_ratio	RMSE ratio
statistical_parity_auc	Statistical parity (AUC)
statistical_parity_regression	Statistical Parity quantile (Regression version)
zscore_diff	ZScore Difference

Clustering

cluster_balance	Cluster Balance
cluster_dist_entropy	Minority Cluster Distribution Entropy
cluster_dist_kl	Cluster Distribution KL
cluster_dist_l1	Cluster Distribution Total Variation
clustering_bias_metrics	Clustering bias metrics batch computation
min_cluster_ratio	Minimum Cluster Ratio
silhouette_diff	Silhouette Difference
social_fairness_ratio	Social Fairness Ratio

Recommender

aggregate_diversity	Aggregate Diversity
avg_f1_ratio	Average f1 ratio
avg_precision_ratio	Average precision ratio
avg_recall_ratio	Average recall ratio
avg_recommendation_popularity	Average Recommendation Popularity
exposure_entropy	Exposure Entropy
exposure_kl	Exposure KL Divergence
exposure_l1	Exposure Total Variation
gini_index	GINI index
mad_score	Mean Absolute Deviation
recommender_bias_metrics	Recommender bias metrics batch computation
recommender_mae_ratio	Recommender MAE ratio
recommender_rmse_ratio	Recommender RMSE ratio