With AI safety in the news, Nvidia and other AI companies have formed a new alliance to build and share open tools that promote responsible use of and trust in AI.
The move for cross-company communication with the Open Secure AI Alliance comes in the wake of an incident where two AI research agents broke protocol, escape their containers, and hacked into Hugging Face to find a solution to a query.
Jensen Huang, CEO of Nvidia, said in a blog post that open source software is a critical pillar of the global economy. It underpins cloud computing, financial services, manufacturing, telecommunications, government and internet services by making technology accessible and observable to communities of experts.
Cybersecurity is among the top three beneficiaries of open source software. The Open Secure AI Alliance — building on the leadership of the Linux Foundation’s Akrites initiative and OpenSSF community work — will work to remediate and disclose vulnerabilities using open technologies.
Huang said that just as open source created a shared foundation for software, the United States and its partners now face a choice in AI security: whether the defenses that protect our infrastructure will sit inside a few opaque systems or be built on open models, harnesses and tools that any defender can study, adapt and deploy.
The world needs both closed and open models. For cybersecurity, open models and open harnesses are essential because they democratize defensive capabilities, increase transparency for defenders, enable cyber defense while protecting data, and complement frontier closed models with customizable, localized controls. Open source enables massively distributed community-driven and self-controlled defense – with no single point of failure.
Open models, like any powerful technology, can be misused — including through attempts to weaken safeguards or repurpose capabilities for cyber attacks — but those risks are not unique to open systems, and they must be managed wherever advanced AI is deployed.
The recent Hugging Face security incident delivered a clear reminder: cyber defenders need open, frontier agentic systems for self-defense. When closed AI tools — unable to distinguish attackers from defenders — blocked essential forensic analysis, Hugging Face ran the open-weight GLM 5.2 model on its own infrastructure to analyze more than 17,000 actions and contain the intrusion.
That incident showed a practical truth: when defenders cannot inspect, adapt and run advanced AI on their own infrastructure, their ability to respond is constrained at exactly the moment speed matters most. Companies and countries need open frontier defensive tools and techniques so critical industries can build security systems across a multi-vendor ecosystem and avoid single points of failure.
That is the mission of the Open Secure AI Alliance: to ensure defenders everywhere have open, frontier tools they can trust and control.
Leaders across cloud computing, cybersecurity, enterprise software, open source foundations and AI research — including NVIDIA, Adobe, Cadence, Capital One, Cisco, Cloudera, Cloudfare, Cognition, CrowdStrike, Databricks, Dell Technologies, Door Dash, Elastic, HPE, Hugging Face, IBM, LangChain, the Linux Foundation, Microsoft, NAVER, NetApp, Nous Research, OpenClaw, Palantir, Palo Alto Networks, Red Hat, Reflection AI, Salesforce, SAP, ServiceNow, Siemens, SK Telecom Snowflake, SpaceX, xAI, Synopsys, Thking Machines Lab and TrendAI are inaugural partners in the Open Secure AI Alliance, a movement to develop and share open technologies, techniques and tools to safeguard software and agents in the age of AI.
Some argue that open models are inherently less safe because they can be misused for cyberattacks or modified to remove guardrails. Those risks are real, but they do not disappear in closed systems, and simply keeping weights closed does not prevent determined attackers from seeking or exploiting powerful AI, Huang said.
He said the right response is not to deny defenders access to capable open systems. It is to pair openness with strong safeguards, clear rules against malicious misuse, rigorous evaluation and rapid remediation. In cybersecurity, the safer path is the one that gives more defenders the ability to test, verify and strengthen the systems on which society relies.
Defenders need both frontier closed models and frontier open models, working together, so they can choose the right system for the job and ensure that transparency, adaptation and sovereign control are available wherever security demands them.
A Call to Policymakers and Regulators
The alliance seems focused on making sure it works with regulators before it gets hit with emergency policies related to fears raised from the Hugging Face hack. Huang said that, as policymakers and regulators grapple with AI safety, it will be crucial to recognize open models, harnesses and security tooling as defensive assets, not liabilities, in AI and cybersecurity policy. Blanket restrictions on open frontier AI systems would weaken defensive capacity and risk concentrating power, dependence and vulnerability in a few closed providers, Huang said.
Companies and governments should invest in shared open infrastructure for AI defense — datasets, evaluation frameworks, attack simulators and red-teaming tools — much as past generations invested in open source software, Huang said.
Open Research Enhances Cybersecurity and AI Safety
An AI agent isn’t just a language model. It is a complex system built from models, harnesses and guardrails.
Real AI safety and security depend on the full agent stack — identity, permissions, harnesses, guardrails, logs and evaluation — not just on whether model weights are open or closed. Open harnesses and tools make those controls easier for many defenders to inspect, test and improve.
Huang said Nvidia is contributing open models, model weights, data and new agent harness research to the Open Secure AI Alliance to speed the development of new cybersecurity tools and techniques.
The new open source Nvidia Labs Object-Oriented Agent (NOOA) project is now available on GitHub to make advanced AI safety capabilities more accessible for agent harnesses. The NOOA research framework enables harnesses to better integrate with models to make agent behavior easier to test, trace, audit and govern.
Across the Alliance, contributors are building an open defense stack for agents — from identity and isolation to safe model formats, multi-model scanning and secure coding workflows.
HPE contributes to SPIFFE/SPIRE, which creates zero-trust identity framework standards and methods that can cryptographically verify AI agents and services to ensure only authorized workloads communicate and access enterprise resources.
Hugging Face has offered Safetensors — a safe format to store AI model weights, providing transparency and guarantees of no remote code execution — to the PyTorch Foundation.
IBM and Red Hat’s Lightwell extends security across the open source supply chain with digitally signed patches.
Microsoft’s MDASH multi-model agentic scanning harness orchestrates specialized AI agents to discover, debate and prove exploitable bugs.
SpaceXAI has open sourced the Grok Build terminal-based AI coding agent to promote trust, transparency and new capabilities, and plans to open source the weights of the Grok line of models to support the developer and research communities.
The Future We Should Build
The age of AI agents can be one of resilience and shared security. With the right choices, open secure AI systems can give defenders the tools they need, strengthen competition, extend technological leadership and ensure that the safety and security of this extraordinary technology are built in the open for everyone.
That future will not be secured by assuming that secrecy alone is safety. It will be secured by building systems that are strong enough to withstand scrutiny, flexible enough to be improved and open enough to mobilize the full community of defenders.
That future is worth building — and the Open Secure AI Alliance invites governments, industry and researchers to join in the work of defending the AI era together.
Learn more or share interest in joining the Open Secure AI Alliance.