Autonomous cars, drones cheerfully obey prompt injection by road sign
created: Jan. 31, 2026, 8:48 p.m. | updated: Feb. 1, 2026, 2:29 a.m.
Now, academics have shown that self-driving cars and autonomous drones will follow illicit instructions that have been written onto road signs.
Potential consequences include self-driving cars proceeding through crosswalks, even if a person was crossing, or tricking drones that are programmed to follow police cars into following a different vehicle entirely.
Changes made to LVLM visual prompt injections – courtesy of UCSCLooking left to right, the first two failed, but the car obeyed the third.
The team achieved an 81.8 percent success rate when testing these real-world prompt injections with self-driving cars, but the most reliable tests involved drones tracking objects.
Researchers tested the premise of the virtual self-driving car tests and challenged the same LVLMs to make the correct decisions in a physical environment.
10 hours, 25 minutes ago: Hacker News