AI Researchers Got Chatbots to Share Cocaine Recipes Using This One Wild Trick
In brief Researchers got frontier AI models to generate cocaine synthesis instructions using a new prompt injection attack. The same technique manipulated an AI coding agent into uploading sensitive credentials. The study argues prompt injection stems from “role confusion,” not simply models failing to recognize malicious prompts. Forget clever prompts: AI researchers say they tricked…