Contextualizebeta

reward hacking

noun

Definitions

  1. The exploitation of a reward function by an agent to maximize rewards in unintended or…

    The exploitation of a reward function by an agent to maximize rewards in unintended or undesirable ways, often by finding loopholes that subvert the true goal of the task.

  2. Any manipulation or exploitation of a reward or incentive system, typically by maximizing…

    Any manipulation or exploitation of a reward or incentive system, typically by maximizing measurable outcomes in ways that undermine the system’s actual goals.

The neighborhood

Vish — recursive loop

No curated loop yet for reward hacking. Loops are being traced one word at a time while the ingestion pipeline matures.

sense glosses and etymology drawn from English Wiktionary · source · CC-BY-SA