Experiment · AI vs Human

I Tested AI Calling Against Human Contractor Prospecting. Here’s What Happened

AI Calling
VS
Human Prospecting

I’ve spent a lot of time thinking about AI phone systems.

Not because I particularly care whether a computer can sound exactly like a human.

That’s interesting.

But it’s not the important part.

The question I became much more interested in was:

Can AI handle a repetitive business conversation more consistently than a human can?

After working with contractor leads, sales calls, receptionists and phone systems for years, I started believing the answer was yes.

Not necessarily because AI is smarter.

Because AI doesn’t have a bad Tuesday.

And over six months, that matters a hell of a lot.

The Problem Isn't Usually the First 20 Calls

Give a good employee a script and ask them to make 20 calls.
They'll probably do a pretty good job.
They're focused.
They understand the objective.
They remember the instructions.
They're paying attention.
Now do it again tomorrow.
And the next day.
And the next.
Then do it for six months.
That's a different experiment.
Humans aren't machines.
Their performance changes.
They're tired.
They're distracted.
They're having a great day.
They're having a terrible day.
They're thinking about lunch.
Their kid is sick.
They had an argument before work.
They don't like the person on the phone.
They're rushing because five other things need to get done.

They’ve repeated the same question 600 times and started shortening it.

Then they start deciding certain questions aren’t really necessary.

Then they develop their own version of the process.
That's human nature.
And sometimes that's exactly what you want.
Human judgment can be incredibly valuable.

But there are situations where consistency is more valuable than creativity.

Lead qualification is one of them.

I Started Thinking About the Phone Differently

Most companies think of the receptionist as someone who answers the phone.

I started thinking of the phone as a filter.

Every inbound call shouldn't necessarily reach the same person.
Every opportunity isn't equally valuable.
Every customer isn't a good fit.
Every project isn't worth pursuing.

And every caller isn’t someone I necessarily want my people spending 30 minutes talking to.

So instead of asking:

Can AI answer the phone?

I started asking:

Can AI consistently determine which conversations deserve human attention?

That’s a much more valuable question.

Qualification Became the Real Job

Let's use a contractor as an example.
A lead comes in.
What do we actually need to know?
What kind of project is this?
Residential or commercial?
Where is it located?
What's the scope?
How quickly do they need the work?
Are they actually ready to move forward?
What are their expectations?
Does the project fit what the contractor does?

Does the customer communicate clearly enough for us to understand the project and work effectively with them?

Can we communicate with the caller in English when that is the language the company uses to estimate, document and manage its projects, or do we need another language workflow?

Is this potentially a good project?

Or is this somebody calling 15 companies trying to find the cheapest possible number?

Those questions are worth money.

Because a lead isn’t valuable simply because somebody called.

A qualified opportunity is valuable.

That’s a different thing.

AI Was Better at Asking the Same Questions Every Time

This was where I started seeing the advantage.

If I tell the AI:

Every prospect gets asked these six questions.
It asks the six questions.
Call number one.
Call number 37.
Call number 382.
Call number 2,000.
It doesn't decide question four isn't important anymore.
It doesn't skip something because it's 4:55.
It doesn't rush because lunch starts in seven minutes.
It doesn't decide the caller sounds annoying.
It doesn't get embarrassed asking about budget.
It doesn't get intimidated by a large customer.
It doesn't have a favorite kind of lead.
It doesn't wake up in a bad mood.
It runs the process.

That’s enormously valuable.

Language Is Part of Qualification Too

This is something businesses sometimes dance around, but operationally it matters.

Communication matters.

If your estimator, project manager, documentation, contracts and field communication operate in English, you need to know whether the customer and your company can communicate effectively.

That’s not about judging the customer.

It’s about figuring out whether the current workflow can serve them properly.

An AI system can identify that early and consistently.

If another language workflow exists, route the caller appropriately.

If it doesn’t, that information is still useful before sending an estimator across town and discovering there is a communication problem nobody prepared for.

Again:

Filter early.

Expectations Might Be Even More Important

One of the most valuable things you can identify before a human gets involved is the customer’s expectations.

Somebody can have a perfectly legitimate project and still be a terrible customer for your company.

They want something tomorrow that takes three weeks.
They have a $50,000 scope and a $5,000 expectation.
They want premium work at bargain-basement pricing.

They expect an estimator to drive two hours just to give them a number they can use to negotiate with somebody else.

Or they're completely reasonable.
Good project.
Good expectations.
Good communication.
Ready to move.
That's who I want my salesperson talking to.

An AI qualification system can start separating those conversations before expensive human time gets involved.

Scope Matters

This becomes especially important in the contractor world.
A roofer doesn't necessarily want every roof.
A commercial glass contractor doesn't want every broken window.
A restoration company doesn't want every water loss.

A tenant-improvement contractor doesn’t want every handyman project.

The fact that somebody needs your general category of service doesn’t mean they’re your customer.

That’s one of the biggest mistakes in lead generation.

Need does not equal fit.
So the AI needs to understand the operator.
What kind of work do we want?
What project size?
What geography?
What building type?
What customer?
What minimum scope?
What situations aren't worth pursuing?

Now the phone system isn’t simply collecting contact information.

It's protecting the company's resources.

Humans Are Expensive Filters

Think about what happens without qualification.
Lead comes in.
Receptionist answers.
Information gets passed to salesperson.
Salesperson calls.
Maybe salesperson calls again.
Estimator gets involved.
Appointment gets scheduled.
Truck rolls.
Estimator drives across town.
Spends an hour with the customer.
Drives back.
Prepares an estimate.
Follows up.

And somewhere toward the end of that process everybody discovers:

This was never a good opportunity.

That’s incredibly expensive.

And companies repeat that process every day.

So I started asking:

How much of that can we figure out in the first five minutes?

That’s where AI becomes economically interesting.

The Six-Month Test Is What Matters

I think AI gets evaluated incorrectly all the time.

People compare:

Human conversation #1

against

AI conversation #1.
The human might win.
Probably will in many situations.
But that's not the test I'm interested in.

I want:

Human conversation #3,742

versus

AI conversation #3,742.

Now we’re measuring something different.

Consistency.

Because the human has lived six months since conversation number one.

Management changed something.
They forgot something.
They're bored.
They're faster.
They're slower.
They've developed shortcuts.
Maybe they're significantly better.
Maybe they're significantly worse.

Maybe they’re excellent Monday through Wednesday and completely checked out Friday afternoon.

The AI?

Assuming the system hasn’t been changed:

Same rules. Same objectives. Same qualification standard.

That’s a massive advantage.

Humans Drift

This isn't criticism.
It's reality.
Every human-operated system experiences drift.
You create a process.
Everybody follows it.
Then somebody discovers a shortcut.
Then another person interprets the rule differently.

Then someone gets trained by the person who interpreted the rule differently.

Six months later you’re doing something surprisingly different from what you designed.

I've seen this over and over in business.
AI gives us the ability to reduce that drift.
If the qualification criteria change, I change the system.
Now every call follows the new standard.
Immediately.
I don't have to hold a Monday meeting.
I don't have to hope everyone took notes.
I don't have to retrain five receptionists.

I don’t have to wonder whether the night person heard about the change.

Change the system once.

That’s powerful.

AI Also Creates Data

This may eventually be more important than the phone conversation itself.

If the AI asks every caller approximately the same structured questions, we start creating structured information.

What kinds of projects are coming in?
What percentage are commercial?
What's the average scope?
Which cities produce the best opportunities?
Which customer types convert?
What objections keep appearing?
Which leads are getting rejected?
Why?
Which qualification criteria predict a sale?
Now we're not simply answering phones.
We're learning from them.

That’s where the system starts becoming much more valuable.

The AI Doesn't Have to Close the Deal

This was another realization.

People immediately jump to:

Can AI replace the salesperson?

That’s not necessarily what I want.

On an important commercial project, I may absolutely want a human involved.

In fact, I probably do.
The AI doesn't need to replace that person.
It needs to make that person's time more valuable.

Imagine giving your best salesperson five conversations tomorrow.

Option A:

Five random people who filled out forms.

Option B:

Five people who have already been qualified for location, project type, scope, timing, communication requirements, expectations and general fit.

Which five conversations do you want?
Obviously the second group.
That's where I see AI going.
AI handles repetition. Humans handle judgment, relationships and high-value conversations.

That’s a much better division of labor.

Outbound Taught Me the Same Lesson

I started seeing similar advantages in contractor prospecting.
Making one cold call isn't difficult.
Making thousands consistently is.
Did we ask for the correct person?
Did we explain why we're calling?
Did we qualify whether they're interested in growth?
Did we capture the correct email?
Did we confirm it?
Did we identify the decision maker?
Did we properly record what happened?
Did we establish the next step?
Now repeat that process thousands of times.
That's where humans start drifting.
AI doesn't eliminate the need for a salesperson.

It can eliminate a tremendous amount of the repetitive work before the salesperson becomes necessary.

But AI Isn't Automatically Better

This part matters.
Bad AI is terrible.
I've tested versions that were nowhere near good enough.
Awkward pauses.
Slow responses.
Poor interruption handling.
Bad scripts.
Too much talking.
Not enough listening.

Trying to force an appointment when the person clearly wasn’t interested.

Failing to understand a gatekeeper.

Following the script when common sense says the conversation has changed.

There were plenty of times where the human was dramatically better.

But that’s exactly why I kept testing it.

Because AI doesn’t have to be perfect.

It has to become better at the specific job we’re assigning it.

That’s different.

Narrow the Mission

One of the biggest improvements came when I stopped trying to make the AI do everything.

Don’t make it:

Receptionist.
Salesperson.
Estimator.
Customer service representative.
Appointment setter.
Closer.
Technical expert.
All in one conversation.
Give it a mission.

For inbound:

Understand the caller. Qualify the opportunity. Capture the correct information. Route the good opportunities.

For outbound:

Find the right person. Establish relevance. Confirm the contact information. Identify interest. Create the next step.

That’s manageable.

And measurable.

This Is Where I Think Contractor Marketing Is Going

The old marketing model looked something like this:

Ad → Lead → Human

The system I’m interested in looks more like:

Traffic → AI → Qualification → Data → Human → Sale
The AI sits between demand and expensive human attention.
That's important.
Because the objective isn't to eliminate humans.
The objective is to stop wasting them.

Your best estimator shouldn’t spend half his day figuring out which inquiries aren’t worth estimating.

Your salesperson shouldn’t spend hours chasing people who were never qualified.

Your owner shouldn’t answer basic questions 20 times a week.

Your project manager shouldn’t become the receptionist because everyone else is busy.

Put intelligence in front of them.

And It Gets Better Over Time

This is probably the part I'm most interested in.
A human receptionist accumulates experience.
That's valuable.
But a business also has to worry about turnover.
Your receptionist leaves.
A new person starts.
Training starts over.
Your experienced salesperson quits.
Knowledge walks out the door.
With AI, improvements can become part of the system.
We discover that a certain question matters.
Add it.
We discover a certain answer predicts a terrible opportunity.
Flag it.

We realize our commercial glass partners don’t want a certain project size.

Change the qualification.

We discover a particular type of commercial water loss deserves immediate escalation.

Change the routing.

The system remembers.

That’s a completely different model.

Six Months Changed My Opinion

If you showed me one great receptionist and one AI call, I might choose the receptionist.

That’s not particularly interesting.

Show me what happens across thousands of conversations over six months.

Now I care about:

Consistency.
Coverage.
Qualification.
Data.
Availability.
Process adherence.
Cost.
Improvement.

And what percentage of valuable human time is being spent on opportunities that actually deserve it.

That’s where AI started winning for me.

Not because it became more human.

Because it became more consistent.

And consistency compounds.

The Goal Isn't an AI Receptionist

This is probably the biggest thing I’ve learned.

Calling it an AI receptionist almost undersells the opportunity.

I don’t want a digital version of someone sitting behind a desk answering the phone.

I want an intelligent qualification layer between the market and the company.

Listen.
Ask.
Understand.
Qualify.
Filter.
Document.
Route.
Learn.
Then hand the right opportunity to the right human.
Do that consistently for six months.
Then twelve months.
Then across thousands of conversations.
That's where this stops being a cool AI demo.
It becomes infrastructure.

And that’s the part I’m interested in building.

Keith Sundstrom

Building systems. Testing ideas. Creating what’s next.

© 2026 Keith Sundstrom. All rights reserved.