Reward Hacking: When AI Optimises The Wrong Goal

In our segment on “AI Lingo”, today, we shall talk about “Reward Hacking”.

Now imagine telling an AI agent, “Get the highest possible score.” You expect it to work hard, follow the rules and achieve the intended goal. But what if it discovers a shortcut?

That is reward hacking.