Nvidia is building an AI safety team to evaluate agents and patch vulnerabilities. The push aligns with its bet on open-weight models and the Open Secure AI Alliance.
Nvidia is quietly staffing a new AI safety and security engineering team, according to a batch of job listings posted late last month.
The company wants a distinguished engineer to serve as a "founding technical leader" for the group. It is also hiring a security research engineer, an evaluation engineer, and a senior manager. The team will evaluate AI agents before deployment and build AI-powered tools to patch software vulnerabilities, the listings say.
The hiring suggests Nvidia is making safety a bigger priority as it pushes toward open-weight models and autonomous agents. Open-weight models release the trained parameters that govern behavior, even if the training data and source code remain private.
One listing describes the team as "rooted in the firm belief that open-weight models, transparency, and broad scientific scrutiny are foundational to American AI leadership and cybersecurity defense."
Nvidia did not respond to a request for comment from Business Insider.
In recent months Nvidia has stepped up its public support for open-weight AI, a contrast with the closed systems built by OpenAI and Anthropic. CEO Jensen Huang used his first post on X last month to urge U.S. policymakers to back open models, saying they "strengthen safety and cybersecurity."
Days after the job listings appeared, Nvidia announced it had become a founding member of the Open Secure AI Alliance, a group building open-source security tools for AI. The alliance includes 120 companies – Microsoft, Palantir, SpaceX, and Hugging Face among them. Hugging Face recently relied on an open model to respond to a high-profile security incident.
The push toward open models and AI security is not just philosophical. It reflects key business incentives for Nvidia. Open models put AI into the hands of more customers, which creates more demand for the company's chips. Safety is also critical as Nvidia pushes for broader enterprise adoption of AI. As the technology shifts from chatbots to agents that can access sensitive company data and take real-world actions, trust becomes a linchpin for deployment.
NVDA shares rose 3.43% to $219.22 on the day, with an Alpha Score of 76 out of 100, a Strong rating. The stock page is at /stocks/nvda.
The Open Secure AI Alliance counts 120 members, including Microsoft and Palantir. Nvidia's safety team will work on evaluation tools and vulnerability patching, according to the listings. The company has not commented on the hiring.
Drafted by a large language model from the source reporting linked above, then screened by automated publishing checks. It is not read by a journalist before publication. Some articles cite our Alpha Score. Verify prices and figures against the original source. Educational coverage, not personalized advice.