lm_polygraph.stat_calculators.sample module

class lm_polygraph.stat_calculators.sample.BlackboxSamplingGenerationCalculator(samples_n: int = 10)[source]

Bases: StatCalculator

Calculates several sampled texts for Blackbox model (lm_polygraph.BlackboxModel).

static meta_info() → Tuple[List[str], List[str]][source]: Returns the statistics and dependencies for the calculator.

class lm_polygraph.stat_calculators.sample.OutputWrapper[source]

Bases: object

decoder_hidden_states = None

encoder_hidden_states = None

hidden_states = None

class lm_polygraph.stat_calculators.sample.SamplingGenerationCalculator(samples_n: int = 10)[source]

Bases: StatCalculator

For Whitebox model (lm_polygraph.WhiteboxModel), at input texts batch calculates: * sampled texts * tokens of the sampled texts * probabilities of the sampled tokens generation

static meta_info() → Tuple[List[str], List[str]][source]: Returns the statistics and dependencies for the calculator.