Microsoft releases new AI red teaming tools for developers

As reported by CyberScoop, Microsoft has released two new open-source tools, Rampart and Clarity, designed to enhance the security of agentic AI development and aid incident responders.

Rampart, built on the PyRIT framework, focuses on continuous testing of code during the development process to identify vulnerabilities, particularly cross-prompt injection attacks. It allows for multiple rounds of testing to confirm fixes. Clarity, available as a desktop app, web interface, or embedded tool, provides real-time security guidance to developers, helping them identify potential risks and more secure design alternatives.

Microsoft has found internal benefits, condensing a week's worth of vulnerability testing into hours with Rampart. The company emphasizes the need for AI safety to be an engineering discipline integrated into the development pipeline.

Source: CyberScoop