Definition
The Audit Interview is a hiring protocol that tests verification skills instead of code generation skills. In the AI age, the scarce human skill is not writing code — it's catching what AI gets wrong. Traditional coding interviews ask candidates to write algorithms on a whiteboard or in a shared editor. This was a reasonable proxy for engineering skill when humans wrote all the code. But in 2026, AI tools like GitHub Copilot, Cursor, and Claude generate code faster and often more correctly than human candidates under interview pressure. When Anthropic discovered that candidates were using Claude to pass their own coding interviews, it proved that traditional interviews are testing the wrong thing. They're testing a skill that AI performs better than humans under artificial conditions. The Audit Interview flips the model. Instead of asking candidates to generate code, it presents them with AI-generated code that contains hidden flaws — security vulnerabilities, logic errors, performance anti-patterns, edge case failures, and architectural problems. The candidate's job is to find the bugs, rank them by severity, and make a ship/no-ship recommendation. The protocol works like this: candidates receive a realistic code review scenario (500-1000 lines of AI-generated code with 3-5 hidden flaws). They have 10 minutes to review the code, identify issues, and present their findings. The evaluation scores 4 dimensions of engineering judgment: 1. Verification: How many bugs did they find? Did they catch the security vulnerability? 2. Prioritization: Did they correctly rank issues by severity? 3. Communication: Can they explain the risk to a non-technical stakeholder? 4. Judgment: Would they ship this code? Under what conditions? With what caveats? The free Audit Interview tool at richardewing.io/tools/audit-interview generates realistic AI-written code with calibrated flaws for interviewers to use immediately.
Why It Matters
When AI writes the code, employers need to hire for judgment, not syntax. The Audit Interview tests the skills that actually matter in AI-age engineering: finding problems, assessing risk, and making informed ship decisions. For hiring managers, the Audit Interview provides a more realistic assessment of how candidates will perform on the job. Modern engineers spend more time reviewing AI-generated code than writing code from scratch. For engineering leaders building interview processes, the Audit Interview is resistant to AI cheating — you can't use AI to find problems in AI-generated code as effectively as an experienced engineer can. The nuanced judgment calls (Is this a P0 security issue or a P3 style issue?) require human experience. For candidates, the Audit Interview is actually more humane than traditional coding interviews. It reduces anxiety (you're not writing code under pressure) and it tests practical skills that candidates use daily.
How to Calculate
- 1Present AI-generated code with 3-5 hidden bugs of varying severity
- 2Give candidate 10 minutes to review and identify issues
- 3Score Verification: bugs found ÷ total bugs (weighted by severity)
- 4Score Prioritization: correct severity ranking (P0/P1/P2/P3)
- 5Score Communication: clarity of risk explanation
- 6Score Judgment: quality of ship/no-ship recommendation and reasoning
- 7Try it free at richardewing.io/tools/audit-interview
Related Articles
- "When AI Writes the Code, What Are Employers Hiring For?" — Built In, Feb 2026
- "Reimagining the Coding Interview for the AI Generation" — Built In, Feb 2026
Deep Dive on the Blog
Explore the latest analysis and practical applications of this framework on the engineering economics blog.
Search the Blog Archive →Calculate Yours
Use the interactive tool to calculate your Audit Interview.
Use the Audit Interview Tool →Citation
To cite this definition:
Ewing, R. (2026). "Audit Interview." richardewing.io.
https://www.richardewing.io/articles/frameworks/audit-interview
Want to apply this to your organization?
Run a free diagnostic first. If the numbers concern you, book a session to build a remediation plan.
Richard Ewing — AI Economist & Capital Auditor