Margin Engineering
The architectural discipline of designing and structuring software systems where gross profitability is treated as a first-class engineering constraint, alongside performance, security, and scalability. In AI-native products, because every feature relies on variable compute COGS (like LLM tokens), engineers must model, monitor, and cap the financial cost of inference at the feature level. Margin Engineering requires developers to actively design caching layers, model routing, and fallback mechanisms specifically to protect the company’s gross margin from unpredictable user behavior.
“If your architecture cannot guarantee a positive gross margin, it is a broken architecture.”
In the SaaS era, software had high fixed costs but negligible variable costs, meaning margin took care of itself once the software was built. Generative AI fundamentally breaks this model; high usage can bankrupt a company if inference costs are not strictly controlled. Margin Engineering forces technical teams to take ownership of the P&L. If an engineer designs a feature that destroys unit economics, it is considered an architectural failure, not just a finance problem. It is the only way to build sustainable AI businesses.
Richard Ewing’s Research Thesis
We must elevate financial viability to the same level of architectural importance as security and uptime.
Why This Specification Exists
Generative AI applications with high variable costs are destroying gross margins.
Relying on after-the-fact FinOps to cut cloud costs.
No practice for proactively designing systems specifically to protect unit economics.
An architectural discipline that forces gross margin constraints directly into code.
What Changes If You Believe This?
Architectural reviews now require a signed-off economic model before code is written.
P&L becomes highly predictable despite variable usage patterns.
Features must be designed with cost ceilings built-in.
Rate limiting becomes a primary defense against margin destruction.
Recommended Action by Role
Implement semantic caching immediately to reduce redundant LLM calls and protect margin.
Latest Publications & Research Activity
How to Reduce LLM API Token Costs in Production
How to Reduce LLM Costs in Production: The Inference Dividend Model
Growth Is Not Your Cost Problem - Your Architecture Is
Frequently Asked Questions
Q:What is an example of Margin Engineering?
Using a small, cheap open-source model to classify an intent, and only routing the query to an expensive frontier model if the intent requires complex reasoning.
Q:Is this just FinOps?
No. FinOps typically optimizes cloud infrastructure retrospectively. Margin Engineering designs the application architecture proactively to guarantee profitability.
Inspectable Evidence Ledger
Classified evidence items supporting, extending, or refining this canonical research specification.
| Evidence Item | Publisher | Evidence Type | Strength | Role | Action |
|---|---|---|---|---|---|
| Architecting for Profitability | Internal | Observation | ★★★★★ | Origin | Inspect ↗ |
Recommended Citation
Ewing, R. (2026). "Margin Engineering." Richard Ewing Research Canon. Available at: https://www.richardewing.io/concepts/margin-engineering
@article{ewing_margin_engineering,
author = {Ewing, Richard},
title = {Margin Engineering},
journal = {Richard Ewing Research Canon},
year = {2026},
url = {https://www.richardewing.io/concepts/margin-engineering}
}