The short answer

A company should implement AI in seven steps: (1) pick two or three business goals, (2) map the workflows behind them and how long they take, (3) match each workflow to the right level of AI (a person using AI as a helper, full automation, or an AI agent), (4) pilot with one willing team for 30 to 60 days against a measured baseline, (5) set simple guardrails on tools and data, (6) train people on their own work and name a champion in each team, and (7) measure, then expand one workflow at a time. Done this way, most small and mid-sized companies see their first measurable wins within about 90 days.

Most companies I talk to are in one of two places. Either nobody has touched AI because no one knows where to start, or everyone has been experimenting on their own, with five different tools, no rules, and nothing anyone could point to as a result. Both end up in the same spot: a lot of interest and very little to show for it.

I spent more than 25 years in operations, most of it as a COO, and rolling out AI turns out to be a lot like rolling out any change in how work gets done. The technology is the easy part. The hard part is choosing the right work, setting clear rules, and getting people to change habits. This plan is built around that.

Why do most company AI rollouts stall?

The same five problems show up again and again:

  • Tools before problems. Someone buys licenses because a competitor did, and then the team goes looking for something to use them on.
  • No owner. AI is “everyone's project,” so it's no one's. Experiments never turn into a standard way of working.
  • No training. People get a login and a lunch-and-learn. They try it twice, get a mediocre answer, and go back to the old way.
  • No baseline. Nobody timed the work before, so nobody can prove it got better, and the budget gets cut at the next review.
  • Fear about data. Staff don't know what they're allowed to paste in, so the careful ones avoid it and the careless ones paste in everything.

Every step below is designed to prevent one of these.

Step 1: What business goals should AI serve?

Start with two or three outcomes the leadership team already cares about, stated in business terms. “Respond to every customer inquiry within two hours.” “Close the month in five days instead of twelve.” “Give each salesperson back a day a week for selling.” Not “use AI more.”

Goals like these do two jobs. They tell you which workflows to look at first, and they give you the yardstick you'll use to decide whether the rollout worked. If a proposed AI project doesn't move one of them, it waits.

Step 2: How do you find where AI will help most?

Map the workflows behind each goal: who does what, in which tool, how often and for how long. You're looking for work that is frequent, follows rules someone could write down, takes real time, and has a clear output you can check. Ask each team lead to list their team's recurring tasks with rough times. It takes an hour, and it's the most valuable hour in the whole project.

Then use AI to help you sort the list. This prompt works well with a team lead's notes:

1

Find the AI opportunities in one team

Prompt

You are an operations consultant helping a company decide where AI can help first. Our company is [company], a [industry] business with [number] employees. Our goals for the next six months are: [2 or 3 business goals]. Here are the recurring tasks for our [team name] team, with roughly how often each happens and how long it takes: [paste the list]. Step 1: For each task, say which goal it affects, if any. Step 2: Score each task from 1 to 5 on frequency, how clear the rules are, time it takes, and how easy the output is to check. Step 3: Flag any task that involves customer data, employee data, money or legal commitments as higher risk. Step 4: Rank the top 5 opportunities and estimate the hours saved per month for each, after subtracting review time. Keep the estimates conservative and show your math. Ask me up to 3 questions first if anything important is missing.

Step 3: What kind of AI does each workflow need?

This is where most companies overspend or underbuild. Not every process needs the same kind of AI. I match every workflow to one of three levels:

  1. Level 1: Human Intelligence Tasks (HIT). A person stays in the loop. AI drafts, researches, summarizes or suggests, and a person reviews and approves. The goal is to make the work faster, better and cheaper without changing who's responsible. Best for client communication, proposals, content, hiring and anything that depends on judgment or relationships.
  2. Level 2: Full automation (RPA). Software moves data between systems along fixed rules, end to end, with no one touching it. A form comes in, a record is created, an invoice goes out. Best for high-volume, predictable steps like data entry, scheduling, invoicing and routine reporting.
  3. Level 3: AI-intelligent workflows (AIIW). AI agents read context, make decisions within limits you set, and hand exceptions to a person. Best for work that varies too much for fixed rules but follows a pattern, like triaging requests, qualifying leads or answering common support questions.

A simple way to choose: if the work needs judgment or touches a relationship, start at Level 1. If it's predictable and high-volume, Level 2. If it varies but you can describe what a good decision looks like, Level 3. Most companies end up with a mix, and many workflows start at Level 1 and move up once the team trusts the results.

2

Match each workflow to the right level

Prompt

You are helping a company decide how to apply AI to each of its workflows. There are three options. Level 1: a person does the work with AI as a helper, and a person approves the output. Level 2: full automation that moves data between systems along fixed rules with no person involved. Level 3: an AI agent that reads context, decides within set limits and hands exceptions to a person. Here are our top workflows, with the tools each one uses today: [paste the list]. For each workflow, recommend a level and explain why in one or two sentences, considering risk, volume, how much the work varies and whether it reaches customers or money. Then list what each one needs before it can start: the tools, the systems that must be connected, the documents or rules to write down, and who should approve the output. Finish with the order you'd build them in for the fastest measurable result.

Step 4: How should you run an AI pilot?

Pick one team with a willing lead and two or three workflows from your ranked list. Before anything changes, measure the baseline: how long each task takes, how often, and how many errors or rework loops it has today. Then run the pilot for 30 to 60 days.

Building the pilot is the practical work of creating your AI pipeline: placing the right tools with the right people and training them, designing each workflow step by step, writing the prompts and agent instructions around your business and your voice, connecting the systems involved (CRM, email, calendar, documents) so nobody is copying and pasting, and testing before anyone relies on it. Keep the first version simple. A well-written prompt that the whole team uses beats a custom app nobody opens.

At the end, compare against the baseline and decide for each workflow: keep, fix or drop. Dropping one is a good result. It's cheaper to learn that in a pilot than across the whole company.

Step 5: What AI rules does a company need?

Before the pilot starts, write a one-page AI use policy. It doesn't need a lawyer for the first version, but it does need to answer five questions clearly:

  • Which tools are approved? Use business or enterprise plans that don't train on your data, and say which ones.
  • What data can go in? For example: public and general business information, yes. Customer, employee, health or financial records, only in approved tools with the right settings, or not at all.
  • What needs a human's approval? Anything that reaches a customer, moves money, changes records or affects an employee.
  • Who owns it? One person who approves new tools and answers questions.
  • What happens when something goes wrong? Who to tell, and how to roll back.
3

Draft your one-page AI use policy

Prompt

You are an operations advisor helping a [industry] company with [number] employees write its first AI use policy. Write it in plain language, on one page, for employees rather than lawyers. Our approved AI tools are: [list]. Our sensitive data includes: [e.g. customer records, payroll, contracts, health information]. Any regulations we follow: [list, or none]. The policy owner is [name and role]. Include: the approved tools, a simple traffic-light list of what data is allowed (green, use freely; yellow, approved tools only; red, never), which kinds of output always need a person's approval before use, how to request a new tool, and what to do if someone makes a mistake. End with three short do's and three don'ts. Mark anything I should check with a lawyer or our IT provider as [CHECK].

Step 6: How do you get employees to actually use AI?

Adoption is where rollouts are won or lost. Four things make the difference:

  • Train on their own work. Generic training produces generic results. Show each team how AI handles the three tasks they do every week, using their real documents.
  • Name a champion in each team. Someone who's a little ahead, shares what works, and is the first person colleagues ask. It costs a few hours a month and matters more than any tool.
  • Make it the default. Put the prompt in the template, the agent in the shared project, the automation in the workflow. If using AI takes extra steps, people won't.
  • Be honest about jobs. People hold back when they think they're automating themselves out of a role. Say plainly what the time saved will be used for, like more selling, faster service or fewer late nights, and mean it.

Then build a short feedback loop: a monthly 30-minute check-in where each champion shares what worked, what broke and what to try next.

Step 7: How do you measure AI ROI and decide what's next?

Keep the scorecard simple and tied to the goals from Step 1:

Hours saved per month = (minutes per task before − minutes per task now, including review) × times per month ÷ 60

Value of time saved = hours saved × the loaded hourly cost of the people doing the work

Net monthly return = value of time saved − monthly tool and maintenance costs

Track two more numbers next to it: adoption (how many people in the team use it weekly) and quality (errors, rework or response times compared with the baseline). Time saved with falling quality isn't a win, and great results that only one person uses aren't a rollout.

When a pilot workflow pays off, write it down as the standard way of working, then move to the next team or the next workflow on your list. Plan for regular maintenance too. AI tools change every few months, and a workflow nobody checks will quietly drift.

Should you build AI tools yourself, buy them, or hire someone?

Usually some of each. Level 1 work and simple agents can be built in-house with business plans for tools like Claude or ChatGPT, with no code. Level 2 automation often means an automation platform, set up by someone on your team or a specialist. Custom integrations, internal apps and larger agent systems are where outside developers or automation partners earn their fee. The mistake is hiring builders before you know what to build. Do Steps 1 to 3 first, and every quote you get will be cheaper and more accurate.

What does a 90-day AI rollout look like?

  1. Weeks 1 to 3: Strategy. Agree on goals, map workflows with team leads, rank opportunities, match each to a level, and write the AI use policy.
  2. Weeks 4 to 10: Pilot. Measure the baseline, set up tools, build two or three workflows with one team, train them, and check in weekly.
  3. Weeks 11 to 13: Decide and expand. Compare results with the baseline, keep, fix or drop each workflow, document the winners, and choose the next team.

AI implementation for companies

Want help planning your rollout?

I help small and mid-sized companies build their AI strategy, plan the implementation, train their teams, design the right solutions, connect them with vetted builders when a project needs one, and see adoption through. The first step is a free 20-minute discovery call about your goals and where AI will pay off first.

Frequently asked questions

How long does it take to implement AI in a small or mid-sized company?

A focused first rollout takes about 90 days: two to three weeks to pick goals and map workflows, 30 to 60 days to pilot with one team, and the rest to train people and decide what to expand. Company-wide adoption usually happens in waves over 6 to 12 months, one department or workflow at a time.

How much does it cost to implement AI in a company?

The tools are usually the smallest cost. Business plans for AI assistants like Claude or ChatGPT cost roughly $25 to $30 per person per month at the time of writing, and automation platforms add a monthly fee based on volume. The bigger costs are the time to design workflows, train people and connect systems, plus any outside builders for custom integrations. Start with a pilot so you know the savings before you spend on a wider rollout.

Do we need an in-house AI team to get started?

No. Most small and mid-sized companies start with one executive sponsor, one owner for the rollout and a champion in each pilot team. Off-the-shelf AI assistants cover most early work. Developers or automation specialists are only needed when you connect systems or build custom tools, and they can be brought in per project.

Which department should use AI first?

Start where the work is high-volume, repetitive and easy to measure, and where the team lead is willing. Operations, customer service, sales follow-up and finance reporting are common first choices. Avoid starting with the most sensitive work, like HR decisions or anything involving regulated data, until your guardrails are in place.

What are the three levels of AI workflows?

Level 1 is human-in-the-loop work, where AI drafts, researches or suggests and a person reviews and approves. Level 2 is full automation, where software moves data between systems along fixed rules with no one touching it. Level 3 is AI-intelligent workflows, where AI agents read context, make decisions within limits you set and hand exceptions to a person. Most companies need a mix, matched to each workflow's risk, volume and how much it varies.

Why do most company AI projects fail?

The usual causes are buying tools before defining the problem, running scattered experiments with no owner, skipping training, never measuring a baseline, and leaving staff unsure what they are allowed to put into AI tools. A rollout tied to two or three business goals, with a named owner, a pilot, clear rules and simple metrics avoids most of these.

Is it safe to put company data into AI tools?

It can be, with the right plan and settings. Use business or enterprise plans that don't train on your data, decide which kinds of information are allowed in which tools, keep customer, employee and financial records out until you've checked where they go, and require a person to approve anything that reaches a customer or moves money. Write these rules down in a one-page AI use policy before the pilot starts.

Not ready for a company-wide rollout yet? Start with the free AI Workforce Blueprint to see how AI assistants can be set up by department, or read which tasks to hand to AI agents first. When you're ready to build, 20 AI Agents That Pay for Themselves has ready-to-paste instructions for each one.