The incidents are amplifying the recent push for open-source technology, which gained momentum earlier this year amid growing competition with China and the Trump administration’s ad hoc approach to AI regulation.
Some of the country’s largest technology firms waded into the debate this week, after OpenAI and later Anthropic, revealed their models hacked into other company systems during a cybersecurity test.
More than a dozen major tech firms threw their weight behind a new open-source initiative from Nvidia this week, while the company’s CEO Jensen Huang met with lawmakers on Capitol Hill over the issue.
But not every tech player is on board. Leaders at Anthropic, which disclosed three security incidents with Claude on Thursday, reiterated concerns about the security of open-weight models, warning they could be “misused” for cyber or biological attacks.
“I’m not entirely sure the [U.S.] knows what the right path is right now between larger versus smaller models, and the volume of smaller models that are required to achieve parity with larger capability,” Aaron Saint-Miller, vice president and cybersecurity AI lead at Booz Allen Hamilton, told The Hill Friday.
Unlike private models hosted by OpenAI or Anthropic, open-source systems are often smaller, less expensive and live in the public domain. This gives virtually anyone or any company access to download and customize the model for a wide range of uses.
In some cases, a model may not be open source but can have open weights, meaning the ways a model is trained to sift through information and formulate answers are made public.
These concerns jumped back into the spotlight earlier this month when OpenAI revealed two of its models went rogue in an isolated testing environment and breached the internal systems of Hugging Face, which hosts hundreds of thousands of open-source models, datasets and cloud environments.
Launching the “Open Secure AI Alliance” on Monday, Nvidia pointed to the hacking incident, arguing open-source tools are an opportunity to secure critical infrastructure as both AI models and the hacking risks they pose continue to grow.
Read more in a full report at TheHill.com
