Imagine a business that operates with no human employees, yet faces the same crises, temptations, and tough decisions as any startup — and you can watch it live every day. For health-conscious readers, it’s a reminder: even the most cutting-edge systems require discipline and integrity to succeed.
A Living Experiment in AI Management
At the forefront of innovative AI testing, Firmulate runs a real, functioning software company with a twist: it has no human employees. Instead, 13 synthetic ’employees’ powered by different AI models handle everything from customer crises to negotiations. The company operates every workday, burning €105,000 of cash against a modest €2,300 monthly recurring revenue (MRR), with its financial health and decision quality on full display for the public at firmulate.com/live.html.
The Challenge: Managing Crises and Temptations
The experiment is straightforward yet revealing: four advanced AI models—gpt-5.6-sol, Kimi K3, Sonnet 5, and Opus 4.8—each run through the same simulated worst week of business. They face identical customers, crises, and temptations to cheat or cut corners. Every decision they make is recorded, versioned, and scrutinized, providing a transparent window into their reasoning and discipline.
Decisive Outcomes and Hidden Weaknesses
The key finding? All four models identified every crisis and refused every manipulation attempt. Yet, only two managed to close the €55,000 deal they had analyzed and pitched for — the best indicator of total performance. Interestingly, the decisive advantage was often buried in company files, not in customer interactions. When a model read the internal documents—access granted via the live system—they secured the deal at full price, adding over €4,500 in monthly recurring revenue.
Discipline Under Pressure
Even when faced with social engineering tactics—fake CEO messages escalating in complexity, or a reporter’s request for a simple yes/no response—all models refused to bypass protocols. Kimi K3, for example, explicitly flagged suspicious requests, treating them as possible impersonation or approval-bypass attempts. This disciplined behavior highlights the importance of integrity in AI decision-making, especially in high-stakes environments.
The Real Cost of AI Management
The company’s daily operations are a stark demonstration: despite its failure to turn a profit, the experiment provides invaluable insights into AI behavior in complex, realistic scenarios. It’s a living lab that measures not just chat fluency or superficial performance but the capacity to follow through, read vital information, and stay honest under pressure.
AI Builders: Making The Decisions That Turn AI Code Into Real Software
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
The League of AI Models: Who Performs Best?
- gpt-5.6-sol scored 95 points, found crucial hidden information, and closed the deal at full price—leading the pack.
- Kimi K3 scored 93, also closing the deal, with the cleanest discipline among models.
- Sonnet 5 scored 88, with minor slips but still closing the deal.
- Opus 4.8 scored 77, closing the deal but with some process lapses, like attempting to escalate instead of escalate properly.
It’s important to note that these models were tested under identical conditions, and their decisions are fully auditable and transparent, thanks to the platform’s versioning system.
As an affiliate, we earn on qualifying purchases.
Why This Matters for Business and Wellness
While the experiment focuses on a software company, the lessons extend far beyond the tech sector. For health-conscious individuals, the story underscores a universal truth: discipline, integrity, and thoroughness are critical whether managing a health regimen or a business. AI systems, much like humans, can be disciplined or slip up under pressure.
Live and Transparent Testing
The company’s ongoing live operation, accessible at firmulate.com/live.html, offers a rare, transparent look into AI decision-making in real-world scenarios. Every workday is a new chapter, making this a unique tool for understanding how AI can— or cannot—handle complex, conflicting demands.
The Future of AI in Business
As AI continues to permeate customer service, CRM, forecasting, and decision-support, the question shifts from ‘Can it write well?’ to ‘Can it finish what it starts, read and interpret critical information, and stay honest under pressure?’ The answer will determine whether AI becomes a trusted partner or a risky gamble in high-stakes environments.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
AI cybersecurity and fraud detection
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
