One Regret Is Enough