The AI risk conversation every financial institution is having
Our discovery process with a potential client inevitably includes questions about their business goals, existing technology infrastructure, and operational challenges. Recently, we’ve found that potential clients are increasingly interested in discussing AI risk. These conversations tend to center on two topics:
- AI risk threshold: the actions an agent should never take without human approval
- AI risk appetite: how far and how fast an agent can go with everything else
One common result of these conversations is a short, specific list of actions AI agents must never execute on their own.
Zennify CEO Michael Rouleau said as much when discussing the new opportunities Claudeforce affords for financial services:
“When your risk committee asks what (AI) could do to us, that’s the list they want, and it needs to be short.”
The goal isn’t to limit what AI agents can do. It’s to define and enforce the boundaries that allow them to do more safely.
Making the “never list” a priority.
When a CFO asks how we made an agent safe enough to approve, we can offer a rather safe answer: right now, the agent only reads. It can pull a client’s positions, holdings, cash balances, recent activity, and open service cases from Salesforce, then assemble everything an advisor needs before a client meeting. It doesn’t change anything, place trades, move money, update an address or beneficiary, or send the client a message. Each of those actions still belongs to a human representative.
For years, the line between what an agent could and couldn’t touch ran between the back office and the front office. Agents stayed in the back, focused on internal operations work like sentiment analysis on service calls, where a mistake stayed inside the institution and never reached a client. Anything client-facing, like advisor prep or direct client communications, was off limits.
We’re seeing that line slowly decay. But the new boundary isn’t simply between reading and writing. It’s about what an agent is authorized to access, what it can recommend, and what it is permitted to execute. Each of these requires its own controls, because even reading can introduce risk depending on the information being accessed.
AI agents are increasingly capable of taking action, but not every action carries the same level of risk. Creating a service case may be appropriate without intervention, while changing an account or executing a transaction may require explicit human approval. The distinction comes down to authorization, risk, and the controls surrounding each action.
“In financial services, you’d better be able to trust your agent all the time.”
Trusting an AI agent means trusting the controls around it. Even when an agent makes a mistake, the architecture should prevent it from executing an action it isn’t authorized to take. That’s why the never list has to be written before your team starts designing and building the agent. When you decide to reduce an agent’s responsibilities after it’s already launched, you’re retrofitting controls onto a live system, revoking tools the agent already uses, adding approval steps, and retesting workflows your team already relies on.
