
“Bugs are 100x more expensive to fix in production” study might not exist (2021)
created: June 1, 2025, 9:02 p.m. | updated: June 2, 2025, 4:14 a.m.
"Software research is a train wreck," says Hillel Wayne, a Chicago-based software consultant who specialises in formal methods, instancing the received wisdom that bugs are way more expensive to fix once software is deployed.
There's one tiny problem with the IBM Systems Sciences Institute study: it doesn't exist."
The reference to [IBM81] notes that the information comes from "course notes" at the IBM Systems Sciences Institute.
Wayne is as concerned with the state of software research as with the defect question itself.
He suggested focusing on what "empirical research overwhelmingly shows," which is that "code review is a good way to find software bugs and spread software knowledge.
6 days, 21 hours ago: Hacker News