That’s why Mirhoseini has been using AI to optimize AI chips. Back in 2021, she and her collaborators at Google built a non-LLM AI system that could decide where to place various components on a computer chip to optimize efficiency. Elsewhere at Google, scientists built a system that they used to optimize various parts of the company’s LLM infrastructure. “You’re not limited by data anymore, because the model can just arbitrarily generate more and more experiences,” Mirhoseini says. Perfecting agent designOne area where LLMs haven’t yet made major contributions is in the design of LLMs themselves.