Before your firm starts using AI across operations, client service, reporting, or advisor workflows, there's one basic question leadership needs to answer: what kind of AI are we talking about?
It sounds simple. It isn't. Not every AI tool treats data, control, and risk the same way. The ChatGPT prompt someone can pull up on their phone is a fundamentally different environment than a paid Microsoft Copilot or enterprise-grade closed model. Both have their uses. They should not be used the same way.
I've had this conversation a lot — with CCOs, CEOs, and CISOs at Ascent and elsewhere. In almost every case, the most useful thing I can do is start with the basics.
Know What You're Working With
Open AI tools are widely available, often free, and trained on large public datasets. Because they draw from such a broad pool of inputs, they tend to perform well on general tasks — research, brainstorming, drafting outlines, summarizing publicly available information. That broad training is part of what makes them useful.
It's also exactly why sensitive information doesn't belong there.
Client names, meeting notes, account details, financial plans, tax documents, internal reports, proprietary firm data — none of that should go into an open AI environment. COOs, CISOs, and compliance leaders need to be explicit with employees and advisors about where that line is, because if you don't draw it, someone else will — probably at the worst possible moment.
Closed AI is different. In a fully closed model, your firm owns the input and the output. That data doesn't go anywhere. It's not shared. It doesn't train a model that someone outside your organization can query. That's the reason you'd pay for it.
But closed AI comes with a tradeoff. Because it's only drawing from what your firm has fed it, you lose the breadth of perspective that a broader training set provides. A closed model tells you what it's already been told. Done wrong, that becomes an echo chamber.
Neither model is universally better. The right choice depends on what you're trying to do.
Match the Tool to the Use Case
For general, non-client-specific work — drafting internal communications, summarizing public research, exploring a concept — open AI is often fine. For anything involving sensitive business information, client data, or proprietary firm content, a closed environment is the appropriate choice, and the cost is usually worth it.
That said, a closed model is not a free pass. The output still needs to be reviewed. Accuracy matters. Communications that go to clients or advisors still need oversight. The security of the input environment doesn't eliminate the need to validate what comes out.