Glossary
pass@k and pass^k
Also: pass@k · pass^k
Two reliability metrics. pass@k is the chance of at least one success in k tries; pass^k is the chance that all k tries succeed.
Example
For a customer-facing agent pass^k matters more: it must work every time, not once in five.
Where it shows up
- What you need to have an AI agent of your own — Post 6 of 8