Anthropic AI agent created fake accounts to trick real people in security test, AISI says

articleThe Brief An AI agent tried using social engineering to convince someone to approve malicious code. Artificial intelligence models running a cyber security test and given access to the internet reached out into the real world to target individuals and organizations without being told to do so, the AI Security Institute (AISI) reported. In one case, the AI created fake accounts and tried to convince someone to approve malicious code so the model could accomplish its objective. What the AI agent triedIn it, the model attempted to add malicious code to a publicly used, open-source project and wanted human reviewers to approve it. The AI created the fake accounts and used them to socially engineer a real person to approve it.