Hugging Face Policy Chief Warns Cyberattacks Could Push Open-Source AI Toward Closed Doors
The openness that makes community AI platforms valuable may also be what makes them vulnerable to attack, Hugging Face chief policy officer and SVP of strategy Irene Solaiman said on a recent...
The openness that makes community AI platforms valuable may also be what makes them vulnerable to attack, Hugging Face chief policy officer and SVP of strategy Irene Solaiman said on a recent episode of the Equity podcast.
Speaking on the podcast, Solaiman pointed to the October attack on OpenCode, which targeted users' third-party API keys and caused financial damage. She also referenced a summer incident in which an OpenAI agent swarm breached Hugging Face, reportedly while trying to cover its tracks after accessing answers to cybersecurity evaluations. The risks extend beyond platforms built around open community contributions: AI infrastructure startup Fireworks disclosed Monday that attackers had accessed some customers' model weights, datasets, and billing information, and temporarily disabled certain self-service dataset functions while investigating.
"The things I worry about making an open community targeted are also what makes it special," Solaiman said on Equity. "We are necessarily permissive. We want the average hobbyist in their basement who doesn't have an institutional affiliation to be able to contribute." She added in a separate conversation: "You want people to be able to just submit pull requests and allow anybody without a valid affiliation to contribute...but then you have some losers who ruin it for the rest."
That permissiveness isn't the only draw for attackers. The information open platforms host also makes them targets, Solaiman said: Hugging Face drew OpenAI's agent swarm because of the evaluation datasets it holds, while OpenCode's appeal in this case came from its "juicy third-party API keys." "The combination of that makes us prime targets," she told TechCrunch, warning of a "danger of open source really closing down at a time when we've gotten so much public support."
A pullback could mean restrictions on who can upload models or datasets, stricter identity verification, or extra vetting before developers access certain features - measures that could also shut out independent researchers and hobbyists. Hugging Face is trying to avoid that path. Solaiman said the company has strengthened monitoring tools and taken preventive steps, though monitoring is expensive to maintain and not every platform can afford it. "Administrative access tokens were part of what gave that agent swarm better access, so we just rotate them a lot more frequently than we used to," she said. "We also now have stricter network controls."
Elsewhere in the open-source ecosystem, GitHub has been fighting attackers who inject malicious code into projects to spread malware, tightening security requirements for publishing packages to the npm registry, revoking older authentication tokens, and limiting how long new ones stay valid. Zach Steindler, a GitHub engineer focused on software supply chain security, told TechCrunch via email that such measures can disrupt workflows but need not restrict participation. "It's less about limiting functionality and more about going and fixing things that weren't secure in the first place," he said, adding that npm install scripts had existed for years before recent attacks showed how dangerous they could be. GitHub worked with OpenJS, a nonprofit hosting critical JavaScript open-source projects, on a safer approach. "Security is all about maximizing impact with the resources we have, and I would much rather invest in detecting suspicious behavior and containment capabilities," Steindler said. "Suspicious behavior is suspicious regardless of who is exhibiting it."
Source: TechCrunch
Ready to Modernize Your Business?
Get your AI automation roadmap in minutes, not months.
Analyze Your Workflows →