
Chatbots aren’t telling you their secrets
Adi Robertson
created: Aug. 13, 2025, 12:46 p.m. | updated: Aug. 13, 2025, 3:37 p.m.
On Monday, xAI’s Grok chatbot suffered a mysterious suspension from X, and faced with questions from curious users, it happily explained why.
Wait, no — “it appears related to content refinements by xAI, possibly tied to prior issues like antisemitic outputs,” it said.
When you ask a bot questions about itself, there’s a good chance it’s simply telling you what you want to hear.
Without meaningful access to documentation about how the system works, there’s no one weird trick for decoding a chatbot’s programming from the outside.
After Grok’s South Africa fixation was patched out, xAI started releasing its system prompts, offering an unusual level of transparency, albeit on a system that remains mostly closed.
4 days, 2 hours ago: The Verge