lm_polygraph.ue_metrics.ece module

class lm_polygraph.ue_metrics.ece.ECE(normalize=False, n_bins=20)

Bases: UEMetric

Expected Calibration Error (ECE) metric. Only applicable to binary quality metrics.

normalize_scores(scores: List[float]) → List[float]

Performs min-max normalization of scores. Parameters:

scores (List[float]): List of scores to normalize.

Returns:

List[float]: Normalized scores.