It is true that at the frontier of intelligence, the most powerful closed source LLMs dominate their open source counterparts. How Do Open Source LLMs Stack Up Against Closed Source LLMs? A common question organizations ask us is how the cost and performance of open source models stack up against closed source models. At the frontier, closed source models like Claude Opus 4.0, OpenAI’s o3 model, and Gemini 2.5 Pro dominate. However, open source models like Qwen 3 235B-A22B and DeepSeek R1 (and the to-be-released R2) are closing the gap quickly.