Written by Kiwi Dynamics Team 1What single workflow will this fix first
A good agency will point to one clear, well-scoped workflow, meeting notes, invoice chasing, intake, and explain exactly how it changes on day one. If the answer is vague, transforming your business with AI, or covers every department at once, that is a sign of a pitch built for the sale rather than a plan built for your firm.
2Will it run in production, not a demo
Ask directly whether what gets delivered is a live, working system your team uses daily, or a proof of concept that needs another round of funding to become real. Plenty of agencies are excellent at demos and have never actually shipped the thing into a client's day-to-day operations, and that gap only becomes obvious after the contract is signed.
3How is success actually measured
Success should be measured in something concrete, hours given back per week, days sales outstanding reduced, response time to enquiries cut from days to hours, not a vague sense that the team feels more efficient. An agency that cannot commit to a measurable outcome before starting is one that will not be able to prove the outcome afterward either.
4Who owns the data it touches
Professional services firms hold sensitive client information, contracts, financials, personal details, and any AI system touching it needs a clear answer about where that data lives, who can access it, and whether it is used to train anything outside your firm. This question matters more here than almost anywhere else, and an agency that has not thought about it clearly has not built anything real yet.
5What happens when it gets something wrong
Every AI system makes mistakes sometimes, and the honest agencies plan for that rather than pretend it will not happen. Ask what the fallback looks like when a draft is wrong, an intake bot misroutes a lead, or a summary misses something, and whether a human is always in the loop for anything that matters.
6How long until it is actually live
A workflow that takes six months to reach production has usually lost momentum, budget approval, and the original problem may have changed shape by the time it ships. Good agencies scope tightly enough to get a first real workflow live in weeks, then expand from there once it is proven, not the other way around.
7Does it work with our existing tools
The tools already running the firm, the practice management system, the CRM, the accounting software, are not going anywhere, and a new AI system needs to work with them rather than ask the team to change how they operate. An agency that proposes ripping out existing tools before anything is proven is proposing more risk than the problem justifies.
8What does it cost after the build
The build cost is only part of the number, ask what it costs to run month to month, who pays for the underlying model usage, and whether the price scales with the firm's growth in a way that still makes sense a year in. Surprises in ongoing cost are one of the most common reasons a good pilot gets quietly switched off.
9Who maintains it once you leave
Once the agency's engagement ends, someone needs to be able to fix a bug, update a workflow when the firm's process changes, or answer a question about how it works. Ask explicitly who that is, whether it is the agency on retainer, an internal person trained up, or nobody, because nobody is a more common answer than it should be.
10Can we talk to a client you've built for
A reference from an actual client, ideally one in a similar industry, is worth more than any case study slide, because it lets you ask directly whether the system still works six months later and whether it delivered what was promised. An agency confident in its work will make that introduction without hesitation.
The honest answer to most of these questions separates agencies selling a vision from ones that have actually shipped. Kiwi Dynamics builds production AI for professional services firms across New Zealand and Australia, one well-scoped workflow at a time, measured in hours given back and happy to answer every question on this list.