lm_polygraph.ue_metrics.rev_pairs_prop module

class lm_polygraph.ue_metrics.rev_pairs_prop.ReversedPairsProportion[source]

Bases: UEMetric

Calculates Reversed Pairs Proportion metrics. For uncetainty estimations e and ground-truth uncertainties g, the class calculates the proportion of pairs (i, j), such that e[i] < e[j] and g[i] > g[j].