Přejít k obsahu
Global sound
Tech Talks Daily

Tech Talks Daily

Measuring the True Cost of AI With Front

· 23 min · Epizoda 3791

Poznámky k epizodě

What does AI really cost when a cheap model fails, retries the task, hands the work to a person, and leaves the customer returning with the same problem?
In this episode of Tech Talks Daily, I welcome back Dan O'Connell, CEO of Front, to discuss AI tokenomics and why token consumption is a poor substitute for business value. Our previous conversation focused on Bring Your Own Agent and the need for companies to choose the agents that fit their customer experience. This time, we turn to the economics behind those decisions.
Dan describes tokens as the new cloud bill. As businesses deploy agents across a growing number of customer interactions, usage-based charges can rise quickly. That number may show activity, but it does not explain whether the work created a useful result. A high token count can represent productive automation, repeated attempts, unnecessary complexity, or a task that eventually required human intervention.
His preferred measure is the total cost per successful outcome. In customer support, that means looking beyond the model's headline price and accounting for every part of the journey. Model retries, agentic retries, human review, handoffs, coordination, response time, and the final customer result all affect the true cost to serve.
The idea matters because lower model prices can be misleading. A cheaper model may save money on the first attempt while increasing the number of retries or transfers. A larger model may cost extra per request while completing a difficult task with fewer steps. Leaders therefore need to compare operating results rather than price lists.
Dan explains how model routing can help. Simpler tasks may be directed to smaller models, while difficult work can be sent to models with greater capability. The choice depends on the task and the tradeoffs the business is willing to accept. Dan frames those tradeoffs through three dimensions: quality, speed, and cost. In many cases, a company can optimize two while accepting a compromise on the third.
That does not mean every basic task should automatically use the cheapest option. A slower response may be acceptable for internal analysis but frustrating during a live customer conversation. A small reduction in accuracy may carry little risk in one workflow and create expensive repeat contacts in another. The orchestration layer needs rules informed by the customer experience, the complexity of the request, and the cost of failure.
Customer service gives companies a useful environment for measuring those results because many of the existing measurements already connect work with outcomes. Cost to serve, time to resolution, deflection, accuracy, customer satisfaction, and repeat contact rates can all reveal whether AI is helping. Dan argues that agent performance should be evaluated alongside human performance using comparable standards.
Resolution is particularly important. If an AI system provides an answer and the customer returns an hour, a day, or a week…

Web: techtalksnetwork.com

Živě, poslední hodina: 13 057 skladeb na 5 061 stanicích v 120 zemích

Objevte svět prostřednictvím rádia

Další způsoby objevování (7)

Slyšeli jste něco pěkného? Uložte si to, nebo to otevřete rovnou ve Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Hard Rock Radio BaliPokračovat v poslechu