Skip to main content

Samplers and probes

Inferlets that exercise the forward-pass output surface — every sampler kind, every probe kind, scoring candidate strings, watermarking generated text.

InferletWhat it shows
sampler-suiteEnd-to-end correctness check for every sampler kind (token / distribution / raw-logits / logprob / logprobs / entropy) attached to the same forward-pass slot.
raw-logits-demoMicrobench for Sampler::raw_logits(). Measures per-call overhead vs. greedy.
output-validationScore candidate strings by their normalized log-probability (yes/no, A/B/C/D).
best-of-nBest-of-N generation with diversity ranking.
watermarkingText watermarking via green/red token partitioning.