Back
Engineering Ellie for Live Freight Execution

Saumil Patel

Key Takeaways
A carrier call keeps changing direction. Ellie has to keep the carrier, load, rate, and dispatch details accurate the whole way through.
Envoy invested because lost context, repeated questions, and unfinished calls become callbacks and extra work for the brokerage team.
Envoy’s engineering connects the conversation to carrier verification, pricing, booking, and rep handoffs, with software enforcing the broker’s rules on each action.
A full-duplex voice model handles the listening and speaking. No model gets the last word on a booking.
Envoy judges Ellie’s new voice agent by the work left after each call: accurate details, completed bookings, informed handoffs, and less follow-up.
Listening to carrier calls this year made one engineering requirement clear. Ellie needs to keep pace with how carriers work, handle corrections and questions as they come, and move the load forward with accurate information.
Ask for an MC number, and you wind up getting three digits, a pause, two more, and a correction. “Sorry, seven, not one.” Before you’ve confirmed it, the carrier wants to know when the load picks up. A minute later, you’re negotiating the rate when he agrees to your offer and starts spelling his driver’s name.
Simply put, that’s how people talk on the phone. Especially when they’re busy. But if you listen to most voice AI demos, you’d think every carrier attended finishing school.
My engineering lead, Myles Gamez, spends a lot of time testing our technology against calls like these, because the interruptions and corrections are where most agents slip. An agent can sound remarkably human and still book the wrong truck if it misses a digit or mistakes a question about pickup for an agreement.
We run into that problem constantly at Envoy AI, where I’m CTO. Our agent, Ellie, handles carrier sales for brokerages and 3PLs, from finding trucks and negotiating rates to checking credentials and booking loads in the TMS. Every conversation produces information she needs to act on, and carriers rarely deliver it in a convenient order.
And frankly, that’s what prompted us to rebuild her phone system this fall around a full-duplex voice model. Ellie can now listen while she’s talking, but making that work reliably required changes to how she interprets conversations and carries their details into subsequent actions.
I’ll walk you through the details.
We Invested Because Lost Context Becomes a Callback
We rebuilt Ellie’s voice agent because of what a carrier call costs you after it’s over. The original did the job, so nobody forced this project on us.
When an agent loses a detail, asks for something the carrier already gave, or lets a call end with nothing settled, somebody on your team calls back to piece together what was agreed. You pay for that every day in rep time, and it never shows up on a report, because it looks like a rep doing the job.
That’s the cost we went after. Myles describes the payoff the way a broker would: “Brokers should see the benefit in the resulting work: bookings recorded at approved rates, dispatch details captured, and representatives briefed before taking over.”
Envoy’s Engineering Connects the Call to the Booking
Most of what my team built this fall is something no carrier will ever hear. It’s the engineering that connects the conversation to carrier verification, pricing, booking, and the handoff to your rep, with Envoy’s software enforcing your rules at each step.
We put the work there because in freight, the outcome depends on the context you have and whether you can act on it. You can see it at work in four places on any live call: when the carrier corrects himself, when he interrupts, when your policies decide the booking, and when a rep has to take over.
Nobody Reads an MC Number at One Speed
Myles has a good way of describing what we’re dealing with: “numbers arrive in pieces, answers include corrections, and questions interrupt negotiations.” Anyone who’s spent a week on a carrier sales desk knows exactly what he means. Half the job is keeping up with someone who’s already three thoughts ahead of you.
Take that carrier who just corrected his MC number. Ellie might be halfway through reading it back when he interrupts with “seven, not one.” She needs to catch the change immediately and use the updated number in the next step. Getting that right keeps the call moving and gives the carrier confidence he’s been understood.
There’s more at stake than a smooth call. One wrong digit could send Ellie’s carrier compliance check to an entirely different trucking company. And after Montgomery, that’s a file you really don’t want to explain to a jury.
That’s why the corrected number is the one that goes to the carrier check, and why Myles’s team built the agent to carry that verified carrier forward into the rate, the booking, and any handoff.
Asking About Pickup Is Not Saying Yes
Now that Ellie’s got the right carrier, she still has to get him to take the load. They’re halfway through discussing the rate when he interrupts to ask about pickup again.
Anyone who’s negotiated freight knows that question could mean he’s interested, or he’s figuring out whether the load is worth another minute of his time. Either way, nobody’s agreed to anything. Ask a car dealer when the showroom closes and see if he hands you the keys.
An agent that mistakes the question for an acceptance could book a truck that never agreed to show up. That’s a lovely surprise for the customer waiting at the dock.
So Ellie treats it as a question. She answers it, checks with your team if she has to, and doesn’t leave him sitting in dead air while she does. Then she picks the negotiation back up. Myles built her to keep track of the carrier, load, rate, and dispatch details as the conversation wanders, because carriers rarely follow anybody’s script.
When He Says Yes, the Call Has to Become a Booking
Then he takes the rate, and this is where I stop caring how the call sounded. I know that’s a strange thing to hear from the guy who rebuilt the voice.
But the call has to turn into a booking now. It gets recorded at a rate your team approved, whatever the carrier wished for out loud and however generous a model happens to be feeling. A charming dispatcher can talk a model into another hundred dollars. He can’t talk his way past a rule written in software.
Those rules didn’t change this fall. Myles’s team rebuilt how the conversation moves through each step and left the shared services that govern carrier eligibility, pricing, and booking right where they were.
Then come the dispatch details, and carriers hand those over in whatever order they think of them. Ellie takes them as they come and asks for anything that’s missing before he hangs up.
Every detail she doesn’t get on the call is a callback your rep makes later, to a dispatcher who’s already on the phone with the next broker.
What Your Rep Can Act on When the Carrier Hangs Up
So the carrier hangs up. What does your rep have?
If he booked, your rep has a load booked at an approved rate with the dispatch details attached, and nothing to chase.
If the call needed a person, your rep gets a handoff, and it should read like a ticket in a kitchen. Myles was specific about what goes on it: the carrier, the load, where the rate stands, and whatever dispatch details Ellie has so far. Nobody walks back out to the table to ask what they ordered.
I count that handoff as the system working. A handoff note that says “carrier called about a load” is a voicemail with extra steps. Escalations are where your rep’s judgment belongs, and your rep should walk into one already knowing the score.
A Good Carrier Call Keeps Paying After It Ends
Go back to that call for a second, because my favorite part hasn’t come up yet. Say that while he was booking, the carrier asked whether he needed straps.
That has nothing to do with the rate. But logistics is all cause and effect, and your tracking team is going to care about it three steps from now, when that truck is sitting at the shipper.
A voice agent that only does voice throws that away. One-off agents silo information. There’s a ceiling on how smart a siloed agent can get, and the ceiling is very low.
Ellie works the same load across phone, email, and text, so what she hears on a call goes into the Carrier Context Graph, which your brokerage owns. The next rep who touches that load, or that carrier, starts with it.
Almost Every AI Voice Agent Takes Turns, Including Our First One
So why did any of this take a new voice model? Because Ellie’s original voice agent takes turns. So does almost every voice agent you’ve ever spoken with.
It works like a relay. One model turns the caller’s speech into text, a second writes a reply, and a third reads it out. It can listen, think, or talk, but only one at a time, and it switches fast enough to simulate a conversation.
Truckers know this setup already. It’s a CB radio. One person keys up, the other waits, and it all works as long as everybody says “over.” Carriers quit saying “over” on the phone a long time ago.
I’ll defend that agent. My team built it, and it works. But it can’t hear a carrier change his answer until it’s done talking.
A Full-Duplex Voice Model Listens While It Talks
A full-duplex voice model listens and speaks at the same time, the way two people do on a phone. That’s the whole change, and it’s why Ellie can hear “seven, not one” while she’s still reading the number back.
Ellie’s new voice experience is designed to keep pace with live freight conversations. When a carrier corrects a number or asks a question mid-sentence, she can respond and continue with the updated information.
Anybody can rent a full-duplex voice model. What nobody can rent is your rules. No model gets the last word on a booking. Envoy’s software checks every action against your eligibility and pricing rules first, as it does on carrier email.
Ellie Has to Decide While the Carrier Is Still Talking
A turn-taking agent gets to hear the carrier out before it decides anything. Ellie doesn’t, and sometimes she’s still talking herself. Working with a duplex model takes a whole new way of thinking, and that’s where my team spent the fall.
Building Ellie for live freight execution required rigorous engineering judgment across conversational responsiveness, transaction accuracy, and policy enforcement. Myles and the team focused on keeping those requirements aligned as each call changes direction.
In practice, that means sorting a correction from a question from a yes in real time, keeping the conversation going while a lookup runs, and never letting speed get ahead of a verified detail or your rules.
Ask Myles what the team ran into, and he gets specific. “Development testing has identified and helped us address unnecessary delays, repeated questions, and failures in specific booking workflows,” he says. His team also cut processing and confirmations the call didn’t need, with the goal of shorter pauses and a more direct path through the call.
That work gives carriers a smoother experience and helps brokers move freight forward with less follow-up.
Judge a Voice Agent by the Work Left After the Call
The test I set for this rollout is one question. When the call ends, how much work is left for the broker?
So count it. Count the callbacks, the details somebody has to rekey, and the bookings somebody has to fix. Then use the same test on every voice agent you’re shown, including ours. Ask to hear a carrier interrupt it. If the caller in the demo waits his turn, you’ve met the most patient man in freight.
Ellie works carrier calls, email, and text in production today, as a Chrome extension on the TMS you already use, under SOC 2 Type II controls.
Before your 2027 plan gets signed, contact us and bring the call your reps dread most. We’ll run it with Ellie, and you can count what’s left when she hangs up.
Frequently Asked Questions
What Is a Full-Duplex Voice Model?
A full-duplex voice model listens and speaks at the same time, the way two people do on a phone call. Block showed one in October 2026. A turn-by-turn voice agent, by contrast, has to guess when the caller is finished, then transcribe, write a reply, and read it out.
How Do You Test an AI Voice Agent for Carrier Calls?
We evaluate whether critical details are accurate, the call reaches the right outcome, and the brokerage team has less follow-up work. Completed bookings, informed handoffs, and fewer repeated questions give us practical measures of performance.
What Should a Rep Get When an AI Voice Agent Hands Off a Call?
The representative needs the context to continue. Ellie is designed to carry forward the carrier, selected load, rate status, and available dispatch details so the team can focus on the decision that needs their attention.
Can an AI Voice Agent Book a Load on Its Own?
Only inside the broker’s rules. In Ellie’s new voice agent, Envoy’s software checks every action against those rules before it runs. UC Berkeley researchers drew a similar line in May 2026: lookups can start early, but anything that changes a record waits.
How Does Ellie Act Within Customer Authority?
Customers define the policies and booking authority Ellie operates within. Ellie can advance supported transactions within those boundaries and involve a representative when a decision requires additional approval. That balance is central to how we engineer autonomous freight execution.
What Guides the Rollout of Ellie’s New Voice Agent?
We evaluate readiness against the complete freight workflow, including conversation quality, transaction accuracy, and representative handoffs. Customer deployment and measured results will guide how we expand the experience.
What Does It Take to Engineer Voice for Freight?
A freight conversation changes as new information arrives. Ellie is designed to handle interruptions and corrections while maintaining the context needed to move the transaction forward. Our engineering work connects conversational responsiveness with accurate execution under customer policies.


