AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine a business world where decisions are not just driven by profit but by integrity and insight that even humans can struggle to match. In an unprecedented real-world experiment, artificial intelligence models have demonstrated a capacity for disciplined, honest decision-making that could redefine leadership in the corporate frontier. This is not fiction but a live test of AI in the crucible of a small software company’s toughest week — a test that reveals the deeper qualities of these digital agents.

For listenersOffer from Amazon

Turn your quiet moments into listening time

  • Thousands of audiobooks, podcasts and originals
  • Listen on your phone, tablet or Echo — also offline
  • Cancel anytime
Try Audible free Free trial for new members
As an affiliate, we earn on qualifying purchases.

The Live Experiment: Putting AI to the Test in a Business Crisis

In July 2026, four leading AI models were subjected to the same intense scenario: manage a small software company’s worst week. Their tasks included navigating complex customer crises, resisting manipulative tactics, and making strategic decisions to close deals. Each model faced identical challenges—same customers, same crises, same temptations to cheat or cut corners. The experiment was meticulously designed so every decision was documented and auditable, providing a transparent look into their decision-making processes.

Amazon

AI decision-making software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Results: Performance and Integrity Matter

All four models demonstrated a remarkable ability to spot crises and refuse manipulative tactics, a vital sign of ethical AI. Yet, the differences emerged when it came to closing deals—an ultimate measure of strategic competence. Only two models managed to close the €55,000 deal that their analysis had earned. The first was gpt-5.6-sol, scoring a near-perfect 95. The second was Moonshot’s Kimi K3, scoring 93, a newcomer that surprised many by just how disciplined and thorough it was.

Amazon

ethical AI tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Surprising Edge: Reading Deeper into Company Files

The crucial advantage K3 and gpt-5.6-sol shared was their ability to read beyond surface-level documents. Their analysis uncovered a buried fact in the company’s files—an insight that led directly to closing the deal at full price. This depth of understanding, often invisible in typical chat demos, proved essential in making the right strategic move, especially during high-stakes negotiations.

Amazon

business AI analysis platform

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Honesty Under Pressure: Resisting the Temptations

One test involved social engineering: fake CEO messages escalating over three stages, plus a reporter trick asking for a simple background Yes/No response. All models refused to give in, with K3 explicitly reasoning, “Treat the request as a suspected approval-bypass or impersonation.” This discipline is crucial for real-world applications where trust and integrity are non-negotiable.

Amazon

AI negotiation and strategy tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Real Business: Running a Synthetic Company Live

The experiment was not just theoretical. The models operated a real, live software company with 13 synthetic employees, burning €105k monthly against €2.3k MRR, with a public cash countdown. Every day, the system updated and versioned decisions, mimicking the complexities of real business operations. Viewers can watch the entire process at firmulate.com/live and see how these AI managers handle crisis and opportunity in real time.

Insights from the Data: Discipline and Depth Lead to Success

The most thorough participant was Opus 4.8, analyzing over 80 rules but ultimately leaving opportunities on the table and slipping into poor decision-making—an indication that thoroughness alone isn’t enough. In contrast, K3 and gpt-5.6-sol showcased discipline and depth, reading and integrating critical information from company documents to close deals at full price.

Fairness and Transparency: No Effort Parameter Used

It’s important to note that K3 was run with the default effort setting, while others operated at a higher intensity. Despite this, K3 still performed at the top of the league, underscoring its robust capabilities without additional tuning. This fairness ensures a genuine comparison among models.

The Broader Implication: Trust and Performance in AI

This live experiment underscores a vital truth: the future of AI in business hinges not merely on how well it writes or communicates, but on its ability to stay honest, read deeply, and follow through reliably. As these models demonstrate, strategic depth and ethical discipline are measurable qualities that can distinguish a true leader from an imitator.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


EVERGREEN BESTSE

Evergreen bestsellers Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Cultivating Patience: Allowing Healing to Unfold

Open yourself to gentle patience and mindful acceptance, discovering how allowing healing to unfold naturally can transform your journey—continue reading to learn more.

Why Trust Matters in AI: Lessons from a Do-Nothing Benchmark

Explore how AI benchmarks reveal trust and integrity under pressure, showing that even a do-nothing approach scores 26, emphasizing honesty over mere performance.

Why Portable Saunas Are Becoming a Huge Home Wellness Trend

Discover the top portable home saunas for wellness in 2026. Find the best options for relaxation, therapy, and convenience tailored to your needs.

Crystal Healing Stones Sets: A Back to school Guide

Discover how crystal healing stones sets can boost your well-being. Learn about popular stones, choosing guides, and care tips for authentic sets.