pass@k and pass_wedge_k

high-variance multi-step agent loops

Variance is the property that makes distributional metrics necessary; the metric exists because the system is stochastic.

1 source videos