#garak

Reproducible LLM Scanner Benchmarks: What Everyone Forgets to Pin

An LLM security scanner benchmark that isn't pinned to a model version, a seed, and a corpus hash isn't reproducible. Here's the full list of what to pin and why.