BlogAI Economics
AI Economics8 min read read

The Rise of the AI Economist: Why Product Managers Must Evolve or Perish

Traditional software has zero marginal cost. AI features carry massive, compounding variable costs. If product managers don't learn to engineer margins, they will bankrupt their companies.

By Richard Ewing·
Share:

The End of Zero Marginal Cost Software

For the last twenty years, product managers have operated under a financial delusion disguised as a business model: zero marginal cost. When you build a traditional SaaS feature - say, a new analytics dashboard or a better export tool - it costs money to build (R&D) and money to maintain (Technical Debt). But once it's deployed, the cost to serve that feature to the next user is functionally zero. Whether 10 users click "Export to CSV" or 10,000 users click it, your AWS bill barely registers the change. Because the marginal cost was zero, product managers were trained to optimize for one thing above all else: **Engagement**. Get the user to click more. Get them to stay longer. Get them to use the product every single day. If you drive engagement, you drive retention. If you drive retention, you drive LTV. It was a beautiful, elegant formula that built trillion-dollar companies. But generative AI just broke the formula. When you build an AI feature - say, an LLM-powered "Chat with your Data" bot - the economics fundamentally flip. Every time a user interacts with that feature, your application makes an API call to a foundation model. That call costs money. It might be a fraction of a cent, or it might be ten cents depending on the context window and the model. Suddenly, the marginal cost is not zero. It is highly variable, entirely unpredictable, and dangerously scalable. This is the era of **Synthetic COGS** (Cost of Goods Sold). And if you are still building products using the engagement-first playbook of 2021, you are driving your company toward insolvency at the speed of compute. ---

The Generative Margin Squeeze

Imagine you sell a B2B SaaS product for $50 per user per month. In the old world, your gross margins were probably 85%. You spent maybe $7 a month on hosting, database reads, and CDN delivery per user. The rest was gross profit to fund R&D, sales, and marketing. Now, to keep up with the competition, you launch an "AI Copilot" inside your app. It's brilliant. Your users love it. In fact, they love it so much that your Power Users start using it 50 times a day. Every time they use it, they pass 8,000 tokens of context to GPT-4o. At current pricing, that costs you roughly $0.04 per query. 50 queries a day × 20 working days = 1,000 queries a month. 1,000 queries × $0.04 = $40.00 in API costs. Your user is paying you $50 a month. Your AI API bill for that user is $40. Your traditional AWS bill is $7. Your gross margin just plummeted from 85% to 6%. This is what I call **Power User Liability**. In the AI era, your most engaged customers are your most expensive liabilities. They are actively destroying your unit economics. And because you likely sold them a flat-rate subscription, you have no mechanism to capture the value they are extracting. If you scale this feature successfully - if you actually achieve the "high engagement" you were trained to seek - you will bankrupt the company. You have built a machine that converts venture capital directly into Nvidia revenue, with your SaaS company acting as a low-margin compute reseller in the middle. ---

Enter the AI Economist

The traditional Product Manager is obsolete. The role was designed for an era where building was the constraint and distribution was free. Today, building is free (thanks to AI code generation), but execution is expensive. To survive this shift, the Product Manager must evolve into an **AI Economist**. An AI Economist doesn't just ask, "Will the user value this feature?" They ask, "Can we serve this feature at a profitable unit margin at scale?" They don't just optimize for engagement; they optimize for **ROAI (Return on Artificial Intelligence)**. Here is the mandate of the AI Economist:

1. Stop Building 'Happy Path' Generative Features

Traditional PMs see an OpenAI API key and immediately try to build a monolithic chat interface. "Just send the whole database schema to the LLM and let it figure it out!" The AI Economist looks at the same problem and builds a **Deterministic Control Layer**. They don't send every query to the most expensive foundation model. They build a classification layer (often using a cheap, local Small Language Model) that asks: "Does this query actually require deep reasoning?" If the user is just asking for a password reset, the system routes it to a traditional deterministic script for $0.00. If they ask a complex analytical question, it routes to the expensive model.

2. Master Margin Engineering

Margin Engineering is the architectural practice of designing systems specifically to protect gross profitability. The AI Economist works directly with engineering to implement: - **Semantic Caching**: If User B asks a question that User A asked an hour ago, don't run the inference again. Serve the cached answer. - **The Evergreen Ratio**: Measure the percentage of AI requests served from cache versus live inference. A healthy AI product needs an Evergreen Ratio of at least 40% to maintain SaaS-like margins. - **Dynamic Routing**: Automatically downgrading to cheaper models when the system detects low-complexity tasks or when usage quotas are approaching.

3. Price the Compute, Not Just the Software

The flat-rate SaaS subscription is dead for heavy AI products. The AI Economist understands that you cannot sell variable-cost compute wrapped in fixed-price subscriptions. They are reinventing pricing architecture: hybrid models with base platform fees plus token-based credits, outcome-based pricing where the customer pays for successful resolutions, and hard usage caps that degrade gracefully.

4. Audit Shadow AI

The most dangerous AI costs aren't the ones you plan for; they are the ones you don't see. Developers hardcoding API keys into local scripts. Support teams using unsanctioned AI tools that leak proprietary data. The AI Economist leads the **Shadow AI Audit**, hunting down unmanaged compute costs and bringing them under a centralized, deterministic governance layer. ---

The Turing Tax and the Boardroom Mandate

Every company building AI is currently paying what I call the **Turing Tax**. It is the premium you pay for using frontier, general-purpose intelligence to solve narrow, specific business problems. Right now, boards of directors and CFOs are looking at their cloud bills in sheer panic. The AI hype cycle of 2024 got the budget approved. The AI reality of 2026 is that the CFO is demanding to see the ROI. When the CFO walks into the product review meeting and asks why AWS costs are up 300% but revenue is only up 12%, the traditional Product Manager will talk about "monthly active users" and "customer delight." They will be fired. The AI Economist will walk into that same meeting, open their **AUEB (AI Unit Economics Benchmark)** dashboard, and say: "Our blended Cost of Predictivity is $0.02 per query. We have isolated our Power User Liability through tiered rate-limiting, and our Semantic Cache is currently deflecting 42% of inference costs. We project gross margins will stabilize at 71% next quarter." They will be promoted to Chief Product Officer. ---

The Masterclass: Your Transition Plan

If you are a Product Manager, Engineering Leader, or startup Founder, you are standing at a career crossroads. The skills that got you here - agile methodology, story mapping, A/B testing - are commodities. They are table stakes. The scarce skill in the market today is the ability to architect, govern, and monetize probabilistic software without destroying unit economics. This is why I have launched **Track 28: The AI Economist Masterclass** within the Synthetic Enterprise Cognition curriculum. We are not teaching prompt engineering. We are teaching capital allocation. You will learn: - How to calculate your specific **Synthetic COGS** and build pricing models that guarantee margin preservation. - How to architect **Deterministic Control Layers** that govern rogue AI and prevent hallucination cascades. - How to execute a **Shadow AI Audit** and present the findings to your board of directors. - How to calculate the **Evergreen Ratio** and work with your engineering team to implement semantic caching. The era of the "Happy Builder" is over. We are entering the era of the AI Economist. You can either learn to engineer the margins, or you can watch your product collapse under the weight of its own compute bill. The choice is yours. [Explore The AI Economist Masterclass Curriculum Here](/vault/curriculum)

Like this analysis?

Get the weekly engineering economics briefing - one email, every Monday.

Subscribe Free →

More in AI Economics

Canonical Frameworks

Innovation Tax

The Innovation Tax is the hidden cost of maintenance work that gets reported as innovation investment. It is OpEx masquerading as R&D investment, causing organizations to dramatically overestimate their effective engineering velocity and R&D productivity. Here's how it works: A VP of Engineering reports to the CEO that "65% of engineering time is spent on new features." The actual breakdown, when forensically audited, reveals that only 23% of engineering time produces genuine new capabilities. The remaining 42% is maintenance work embedded within feature sprints - bug fixes bundled into feature stories, infrastructure upgrades coded as dependencies, and refactoring disguised as feature prerequisites. This 42-point gap between reported and actual innovation investment is the Innovation Tax. It's not fraud - it's systematic self-deception enabled by the way agile teams organize work. When a sprint contains 10 stories and 4 of them are technical debt cleanup dressed as "tech stories" within a feature epic, the team genuinely believes they're spending 100% on features. The Innovation Tax is insidious because it compounds. As the maintenance burden grows quarter-over-quarter, the tax increases. But because teams don't measure it, CFOs and boards continue to believe R&D spending is generating proportional innovation output. By the time the gap becomes visible (missed deadlines, slow feature delivery, competitive lag), the organization is often approaching the Technical Insolvency Date. Benchmarks from Richard Ewing's audits show that most engineering organizations have an Innovation Tax between 30-50%. Organizations with Innovation Tax above 40% are in dangerous territory. Above 70% is terminal - the organization is approaching technical insolvency within 4-6 quarters.

Read Definition →

Kill Switch Protocol

The Kill Switch Protocol is a structured framework for identifying and deprecating "Zombie Features" - code that requires ongoing maintenance but generates zero incremental business value. Most software organizations have a dangerous bias: they add features but never remove them. Product teams celebrate launches. Nobody celebrates deletions. Over time, this creates what Richard Ewing calls "feature gravity" - a constantly growing codebase where 40-60% of the code serves no active users and generates no measurable revenue, yet still consumes engineering maintenance hours. Zombie features come in several varieties: - **Ghost Features**: features that were built, launched, and never adopted. They sit in the codebase, requiring maintenance, but have near-zero usage. - **Legacy Bridges**: compatibility layers, deprecated API versions, and backward-compatible code paths that serve a tiny percentage of users but add complexity to every future change. - **Vanity Features**: features built because a senior stakeholder wanted them, not because users needed them. Often protected by organizational politics rather than business merit. - **Abandoned Experiments**: A/B test variants that were never cleaned up, prototypes that became permanent, and "temporary" solutions that became load-bearing. The Kill Switch Protocol provides a systematic approach to identification, evaluation, and deprecation: 1. **Identify**: Flag features with less than 5% of peak usage, zero revenue attribution, or maintenance cost exceeding 10% of the feature's value contribution. 2. **Quantify**: Calculate the total cost of keeping each zombie alive (maintenance hours × fully-loaded engineer cost × opportunity cost multiplier). 3. **Assess Risk**: Evaluate deprecation risk - what breaks if this feature is removed? What customers are affected? 4. **Sunset Timeline**: Create a communication plan and graduated deprecation (warning → deprecation notice → feature flag → removal). 5. **Execute**: Remove the code with rollback capability. Monitor for unexpected breakage. The typical Kill Switch audit reveals that 30-50% of maintenance burden comes from zombie features. Removing them frees up 15-25% of engineering capacity for actual innovation.

Read Definition →
📊

Richard Ewing

The AI Economist - Quantifying engineering economics for technology leaders, PE firms, and boards.

Want to apply this to your organization?

Run a free diagnostic first. If the numbers concern you, book a session to build a remediation plan.

Richard Ewing: AI Economist & Capital Auditor