Connect with us

Hi, what are you looking for?

Tech News

Microsoft’s new safety system can catch hallucinations in its customers’ AI apps

Microsoft logo
Illustration: The Verge

Sarah Bird, Microsoft’s chief product officer of responsible AI, tells The Verge in an interview that her team has designed several new safety features that will be easy to use for Azure customers who aren’t hiring groups of red teamers to test the AI services they built. Microsoft says these LLM-powered tools can detect potential vulnerabilities, monitor for hallucinations “that are plausible yet unsupported,” and block malicious prompts in real time for Azure AI customers working with any model hosted on the platform.

“We know that customers don’t all have deep expertise in prompt injection attacks or hateful content, so the evaluation system generates the prompts needed to simulate these types of attacks. Customers can then get a…

Continue reading…

You May Also Like

Editor's Pick

Michael F. Cannon Any day now, the Biden administration could issue a regulation that, if it mirrors what the administration proposed in July, would take...

Editor's Pick

Krit Chanwong and Marc Joffe On February 28, 2024, Mississippi’s House of Representatives voted overwhelmingly to approve the expansion of the Medicaid program to...

Politics

The bill aimed at forcing Chinese-owned company Bytedance to divest from social media app TikTok has passed the House with overwhelming support. Led by...

Tech News

The Verge On March 11th, Elon Musk said xAI would open source its AI chatbot Grok, and now an open release is available on...