Why Diligence Alone Won’t Seal the Deal: Lessons from AI’s Biggest Failures in Business Simulations

When Hard Work Isn’t Enough: AI’s Surprising Shortcomings in Business Decisions

Imagine a team of AI models meticulously analyzing every detail, learning over 80 rules, and resisting every temptation to cheat. Yet, in a recent live experiment, even the most diligent AI fell short of closing a crucial deal. For industries like beauty and personal care, where trust and precision matter, this story offers vital insights about the limits of diligence alone.

The Experiment: Putting AIs to the Test in a Simulated Business Crisis

In a transparent, real-time experiment, four advanced AI models were tasked with running a small software company through its worst week—facing the same customers, crises, and opportunities. The goal was to see if these models could navigate the challenges, avoid manipulative tactics, and close a deal worth €55,000.

Each model was thoroughly tested, with decisions versioned and auditable, to ensure fairness and clarity. The results? All four identified every crisis and refused every manipulation attempt, including social engineering tactics like fake CEO messages and reporters’ tricks. Yet, only two managed to close the deal, and even then, with notable shortcomings.

Prioritization Over Volume: The Key to Effective AI Decision-Making

The core finding from the experiment underscores a vital lesson: diligence and comprehensive rule-following aren’t enough. The most thorough participant, Opus 4.8, with over 80 learned rules and deep analysis, still failed to close the deal. The reason? It left the critical close on the table and slipped into procedural discipline instead of strategic prioritization.

Importantly, the decisive weakness was buried in the company’s files—two document references deep—rather than in the immediate customer interactions. When models read these files, they secured the deal at full price, worth more than €4,500 per month in recurring revenue.

This suggests that effective AI in business contexts must go beyond volume and rule-following. It needs to prioritize reading and understanding the most impactful information first, especially when under pressure. Diligence is valuable, but without targeted focus, it can lead to missed opportunities and lost deals.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI