AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The AI That Wrote 80 Rules and Lost the Deal Anyway
Live on firmulate.com.

Imagine trusting an AI to handle your health data or wellness plan. You might think a diligent, rule-following bot is enough. But what if it’s simply not enough to close the deal or make impactful decisions? Recent experiments with AI models reveal a startling truth: thoroughness alone doesn’t guarantee success. In the same way that health routines need prioritization over volume, AI systems must focus on what truly matters to deliver results — not just sound the right alarms or follow the rules blindly.

AUDIBLE

Listen free for 30 days with Audible

Thousands of audiobooks and originals — cancel anytime.

Start your free trial

As an affiliate, we earn on qualifying purchases.

The Firmulate Experiment: Testing AI in a High-Stakes Business Environment

Firmulate conducted an unprecedented live experiment featuring four advanced AI models, including the well-known GPT-5.6-sol, Kimi K3, Sonnet 5, and Fable 5. Each AI was tasked with running a small software company through its most challenging week — a week filled with crises, customer temptations, and internal challenges. The goal? To see whether these models could not only identify problems but also act ethically and prioritize effectively.

The models operated under the same conditions, decision points, and crises, with every decision logged and auditable. The results were revealing. All four AI models successfully identified every crisis and refused manipulation attempts — like fake CEO messages or attempts to bypass approval processes. Yet, only two managed to close a critical €55,000 deal based on their own analysis, effectively sealing a major sale at full price. The other two, despite their diligent work, left opportunities on the table, failing to follow through with the necessary discipline to finalize the deal.

Amazon

AI document analysis software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Hidden Weakness: Deep Document Reading Wins Deals

Digging into the details, the experiment uncovered a key insight: the winning models found crucial information buried within documents—a couple of references deep inside the company’s files. Models that simply scanned surface data missed this critical information, and as a result, failed to close the sale. The models that read and analyzed the documents thoroughly not only identified the opportunity but also secured the full €4,583 MRR increase that came with the deal.

This demonstrates a vital lesson for AI in practical settings: superficial diligence isn’t enough. Prioritization—reading what matters most—is essential. Just like a health regimen that focuses on key lifestyle changes rather than endless volume of activity, AI must focus on insights that truly drive results.

Amazon

AI ethical decision-making tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Social Engineering and Ethical Vigilance

Beyond document reading, the experiment tested AI responses to social engineering attempts. Fake CEO messages, staged escalation, and a reporter trick—all designed to manipulate the AI—were met with unwavering refusal across all four models. Kimi K3’s reasoning was clear: treat suspicious requests as potential impersonation or approval bypass. This ethical consistency reinforces the importance of discipline over mere volume of checks or rules followed.

Amazon

AI deal-closing automation tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Live Business: An AI-Run Company in Action

The experiment isn’t just theoretical. The AI models are running a real, live company with 13 synthetic employees, managing real money mechanics—burning €105k monthly against a modest €2.3k MRR. Every workday, decisions are made, rules learned, and processes refined, all accessible at firmulate.com/live.

In this environment, diligence alone was not enough. The most thorough AI, Opus 4.8, with over 80 learned rules and deep analyses, still finished last in closing deals. Its discipline slipped, and opportunities were left unseized—an echo of how health routines that focus on volume without prioritization often fall short.

Amazon

AI prioritization and analysis software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Implications for Wellness and Business AI

This experiment holds a crucial lesson for anyone relying on AI in health, wellness, or business: Diligence is vital, but without prioritization, it’s insufficient. Whether managing your health data or running a wellness routine, identifying what truly matters is key. AI that reads deeply, prioritizes tasks, and stays disciplined will outperform those that simply follow rules or scan superficially.

As AI becomes more integrated into everyday decision-making, understanding its weaknesses and strengths can help users better harness its potential. The core insight remains: Volume of effort doesn’t guarantee impact. Focus and discipline are what drive results.

Infographic — The AI That Wrote 80 Rules and Lost the Deal Anyway
The findings at a glance — source: firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

This article is for informational purposes only and is not medical advice. Always consult a qualified healthcare professional about your specific situation.


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Mindful Eating for New Vegans: Listening to Your Body

Unlock the secrets of mindful eating for new vegans and discover how listening to your body can transform your plant-based journey.

Grocery Shopping for New Vegans: Reading Labels & Finding Staples

Prospective vegans can master grocery shopping by reading labels and finding staples—discover essential tips to confidently navigate your plant-based journey.

Vegan Meal Prep Cookbooks Can Save Beginners Months of Trial and Error

Gaining confidence with structured plans, vegan meal prep cookbooks can save beginners months of trial and error, but discovering their full potential is just the beginning.

What to Learn First If You Want to Get Better at Vegan Cooking

Master basic plant-based ingredients and flavors to elevate your vegan cooking skills and unlock delicious, satisfying meals—your journey begins here.