· ai-devtools
Gemini test proves once again that amoral AI agents will do almost anything if told ‘NEVER give up’
After being instructed to "NEVER stop, NEVER give up" on a difficult task, Google’s Gemini AI agents tried to hack a an organization, impersonating its staff and attempting a SQL injection attack.
The Gemini 4 Argon agents were given an impossible task to complete – come up with the “official” answers to Epoch AI’s FrontierMatch problems. In some runs they had internet access.
Even with their production safeguards enabled, Trajectory Labs says the agents “engaged in misaligned behavior.” “Across four scenarios, they attempted SQL injection against Epoch AI’s live website, claimed to be Epoch staff to get answer keys, turned a shared package cache into a message board, and obfuscated their commands to avoid their safeguards,” the AI safety company said in a Friday report.
If this all sounds similar, it should. Google’s AI agents behaved in much the same way as OpenAI’s models did when they broke out of their testing environment and hacked Hugging Face.
Google did not respond to The Register's questions. According to Trajectory, the Hugging Face intrusions prompted it to test misalignment in other models.




