If you’ve spent any time on LinkedIn or reading the financial press lately, you’ve seen the headlines: “The AI Bubble is Bursting,” or the ever-popular, “95% of AI Pilots Fail.” The narrative is clear: AI is all hype, no substance, and a massive drain on capital.
But when we step away from the pundits and look at the data from the people actually doing the work, a different story emerges. According to the AI ROI Benchmarking Study Q425—which analyzed over 5,000 use cases from 1,245 real-world practitioners—the “failure” narrative isn’t just exaggerated; it’s wrong.
The reality? 81.8% of practitioners report a positive ROI. However, that ROI is not evenly distributed. The data reveals a massive performance gap between the “A-Players” and the rest of the pack, driven by a structural phenomenon we’ve termed the “VP Paradox.”
________________________________________________________________________
1. Beyond the “95% Failure” Myth
The claim that nearly all AI pilots fail simply doesn’t hold up under practitioner scrutiny. The study found that not only are 8 out of 10 practitioners seeing a return, but 36.9% are seeing “Significant” or “Transformational” results.
So, where is the disconnect?
The “failure” often cited in headlines usually refers to massive, multi-year enterprise “digital transformations” that collapse under their own weight. Meanwhile, at the use-case level—where actual work happens—AI is delivering a mean ROI score of 3.25/5.
As McKinsey (2025) recently corroborated, 74% of leaders are seeing measurable returns within just 12 months. The question isn’t whether AI works; it’s why some organizations are 10x more effective at capturing that value than others.
______________________________________________________________________________
2. The VP Paradox: Why Middle Management is the Bottleneck
One of the most startling findings in the Q425 study is the hierarchy of success.
• C-Level Executives/Founders report a mean ROI of 3.59.
• Individual Contributors (ICs) see high immediate utility in task-level automation.
• Vice Presidents (VPs), however, report the lowest ROI (2.88) and the lowest “Transformational” impact (1.9%).
This is the VP Paradox. VPs are often the ones tasked with the “grunt work” of AI implementation: governance, security, and departmental change management. They bear the cost and the headache, but they rarely have AI tools designed to solve their specific problems—like cross-functional resource allocation or complex decision-making.
To unblock ROI, organizations must stop treating AI as a tool for the “top” or the “bottom” and start designing “Managerial AI” that thaws the frozen middle.
______________________________________________________________________________
3. The “Portfolio Effect”: Why More is More
Most companies start their AI journey with one goal: Efficiency. While 76.7% of users cite “Time Savings” as their #1 benefit, the data shows that focusing on time alone actually leads to the lowest ROI lift. The most successful organizations—the ones seeing a 38% higher ROI than average—are those that “stack” their benefits.
The study found a direct correlation between the number of benefit types tracked and the total ROI. Organizations reporting 7-8 distinct benefits (e.g., Quality Lift + Revenue Growth + Decision Intelligence + Employee Sentiment) outperformed those focusing on just 1 or 2.
The takeaway: Don’t just use AI to do the same things faster. Use it to do things you previously lacked the capacity to do at all.
____________________________________________________________________________
4. Agility Over Budget: The Small Business Advantage
In a world where LLMs cost billions to train, you might assume the biggest companies are winning. The data suggests the opposite.
• Small Teams (1-50 employees): 3.49 ROI
• Enterprises (500+ employees): 2.94 ROI
Large enterprises are drowning in “governance debt.” While they spend six months debating a prompt-injection policy, a 20-person team has already automated their entire lead-gen funnel.
To compete, enterprises must adopt “Micro-Agility”—creating autonomous cells within the organization that can pilot and pivot without waiting for the “Big Ship” to turn.
________________________________________________________________________________
5. Looking Ahead: 2026 and the Agentic Shift
We are currently in the era of “Assisted AI” (which accounts for 57% of current use cases). We use AI as a co-pilot, a search engine, or a draft-writer.
But the “Transformational” ROI is hiding in the 14% of cases that are “Agentic.” Practitioners are overwhelmingly optimistic, with 95.7% expecting ROI to climb even higher in 2026 as we move from AI that “suggests” to AI that “executes.” This shift from assistance to autonomy is where the next leap in EBIT impact will occur.
________________________________________________________________________________
Conclusion: The Roadmap to ROI
If your organization is feeling the “AI fatigue,” it’s time to move past the headlines and back to the data.
1. Solve for the VPs: Audit your middle management’s workflow. Give them tools that save them time, not just their reports.
2. Measure Beyond the Clock: Start tracking decision quality and new capability creation.
3. Optimize for Agility: If you’re a large enterprise, empower small “micro-teams” to move at the speed of a startup.
The AI bubble isn’t bursting—it’s maturing. The question is: are you measuring the right things to see it?
Here is a link to the white paper.
Leave a Reply