Key takeaways

  • The performance gap between frontier AI models from US tech companies and the best open-weights models from Chinese companies has closed to…
  • 4 months, according to a Mozilla report.
  • Most organizations should ideally be using open models as the default for the majority of their work, according to the latest State of Open…

What happened

4 months, according to a Mozilla report. That explains why many companies are shifting to the significantly cheaper open models for routine work—and helps reveal a narrow band of workloads where frontier models are worth the cost.

7 times as long as the longest job that the best open model can reliably finish. “If the open frontier can handle a seven-hour job, the closed frontier can handle a 12-hour one,” Krikorian told Ars. ” Tasks requiring between eight and 12 hours are typically the ones that a closed frontier model can do and the open models cannot handle yet, Krikorian said.

No models are generally capable of reliably doing tasks longer than 12 hours, whereas tasks taking less than eight hours can be done by either type of model and could be handed off to the cheaper open models. There are many nuances and caveats for such comparisons.

For example, closed frontier models often come with their own harness—the software layer that helps the models access various tools and memory to perform agent-like actions. Harnesses custom-built by AI labs for their models can sometimes boost performance on various tasks, whereas the models may perform less well with third-party harnesses.

To level the playing field, the benchmarking company Vals AI has been evaluating different open and closed models by using its own neutral harness. 8 while costing about five times less per completed task. In other words, paying for closed frontier models buys about a four-month head start at about five times the per-task cost—but only when currently looking at tasks taking between eight and 12 hours.

“Pay when that head start is worth it, something like a deadline that lands before the open frontier catches up would be here,” Krikorian told Ars. ” The surging popularity of open-weights models can be seen on OpenRouter, the AI gateway and marketplace that gives developers access to hundreds of different models from multiple providers.

A paper by Frank Nagle and Daniel Yue for the Linux Foundation found that open models earned just 4 percent of overall revenue compared to closed models getting 96 percent of revenue—although they were looking at data from May through September of 2025.

Why it matters

Most organizations should ideally be using open models as the default for the majority of their work, according to the latest State of Open Source AI report from Mozilla, published on September 15 and shared with Ars prior to publication.

The report highlights how a leading open model, Moonshot AI’s Kimi K3, achieves a composite AI performance score on the Artificial Analysis Intelligence Index that is just three points behind Anthropic’s Fable 5 closed frontier model, all while costing just 30 percent of the latter.

“Closed earns its premium in a few places: expert professional work, high-intensity retrieval, and long context,” Raffi Krikorian, chief technology officer at Mozilla, said in an email to Ars. ” The open-weights AI models allow anyone to download the main model components and run the models on their own computers, but developers still typically withhold vital information such as training data, the data pipeline, and training code.

By comparison, US tech companies such as Anthropic and OpenAI mostly offer closed frontier models that keep everything proprietary, requiring customers to pay more for access. Organizations still pay for closed frontier models because they work out of the box and come bundled with “compliance packaging, support, and accountability,” whereas many organizations lack the staff to run open-weights models well, Krikorian explained.

But the steadily narrowing performance gap between open and closed frontier models, coupled with the cost-effectiveness of open models, is now widely recognized by many companies. For example, the delivery company DoorDash has been using Kimi for routine work while reserving Fable for more difficult tasks that would normally take human experts longer to complete.

Unsurprisingly, this has accelerated the usage of open models since Mozilla’s inaugural State of Open Source AI report was published on July 14. The narrowing performance gap is being measured in several ways.

For example, the research nonprofit METR has defined an AI model’s time horizon as the length of tasks—measured by how long human experts require to complete them—that can be handled by AI models with a “reliable” 50 percent success rate. That time horizon has been doubling on a set cadence that has accelerated over time.

What to watch

The Mozilla report noted that eight of the top 10 models ranked by token volumes in August 2026 provide open weights. However, open models are still lagging behind closed frontier models in revenue.