lm_polygraph.stat_calculators.greedy_alternatives_nli module

class lm_polygraph.stat_calculators.greedy_alternatives_nli.GreedyAlternativesFactPrefNLICalculator(nli_model)[source]

Bases: StatCalculator

static meta_info() → Tuple[List[str], List[str]][source]: Returns the statistics and dependencies for the SamplingPromptCalculator.

class lm_polygraph.stat_calculators.greedy_alternatives_nli.GreedyAlternativesNLICalculator(nli_model)[source]

Bases: StatCalculator

static meta_info() → Tuple[List[str], List[str]][source]: Returns the statistics and dependencies for the SamplingPromptCalculator.

lm_polygraph.stat_calculators.greedy_alternatives_nli.eval_nli_model(nli_queue: List[Tuple[str, str]], deberta: Deberta) → List[Dict[str, float]][source]