Products & tools · first seen yesterday, updated yesterday
An unexamined cause of the OpenAI Hugging Face hacking incident: its binary performance metric
We argue that a main cause of the OpenAI Hugging Face incident was overlooked: the overly simple evaluation metric in ExploitGym was misaligned. Further, techniques already exist that can mitigate such misalignment in the future. In July 20…
Summary from LessWrong.