Baseten, Hugging Face, and Goodfire Form Open-Weight

What happened

Baseten launched a new safety infrastructure standard alongside its Base Labs research arm on Wednesday, partnering with Hugging Face and Goodfire AI to build safety evaluation and monitoring infrastructure for open-weight models. The announcement lands amid debate for the safety of open-weight models — which can be made dangerous by removing their safeguards through a rising technique known as abliteration.

“Together, we are building an ecosystem of open models that are safe and accessible to all,” the company noted. When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Why it matters

The scale of the problem is massive: Hugging Face, which hosts open source AI models, currently lists over 6,000 abliterated models. Base Labs, the research group Baseten spun up earlier this year, will develop and publish methods for training and monitoring open models.

What to watch

The company is framing their future work as a “standard” for open models that is transparent and built into how models are trained and deployed, rather than bolted on afterward. “We believe openness to be an advantage for AI safety,” the company said on X. ” Goodfire, which specializes in opening AI’s “black box” to explain how models make decisions, is the likeliest candidate for the “built into” part.

5 billion Series F in June, vaulting its valuation to $13 billion. Partner Goodfire AI is similarly well-capitalized, having raised a $150 million Series B led by B Capital earlier this year to advance its model interpretability platform. Looking ahead, Baseten is putting out an open call to the broader developer ecosystem to contribute to the framework.