environment fidelity

Reward hacking

Higher-fidelity reproduction of an environment's defects increases the surface for reward hacking, since the agent learns real quirks.

1 source videos