xxx
As rogue AI agents cause security problems and product outages even at sophisticated companies such as Meta and Amazon, major firms such as ServiceNow as well as startups are developing new AI to monitor and stop them.
1
You’re reading the Applied AI Newsletter
View all newsletters
The new AI, also known as guardian AI agents, comes in the form of a cloud application and can be laborious to set up. To use a guardian AI app, customers need to connect it to other AI agents they use—including ones developed with OpenClaw, Claude Code and Agentforce—using standard application programming interfaces or model context protocol servers that enable such connections or monitoring.
Customers must then tell the guardian app how the various AI agents they use should behave, given the agents’ tendency to stray from their original mission. For instance, a company might tell the guardian AI app to make sure that whenever an AI agent generates internal financial reports, it should always check Bloomberg when the reports reference stock prices.
If the report-making AI agent goes against that or another one of the company’s guidelines, the guardian agent can send an alert to employees to either stop the report-making agent or change the agent’s behavior the next time the same thing happens.
From: ‘Guardian’ Apps Aim to Stop AI Agents From Going Rogue — The Information.
xxx