How Tilt’s Review Bot transformed its code reviews

James and his team at Tilt were struggling with inconsistent code reviews that slowed down development velocity. Their previous tool was overly noisy, commenting on every PR regardless of risk level, and provided corrections without explaining the “why” behind feedback.

By systematically documenting their engineering knowledge, staff engineers created detailed guidelines covering everything from background tasks to error handling. By integrating Augment with their Notion MCP for core concepts and Linear MCP for QA notes, Tilt built a comprehensive knowledge base alongside a rigorous testing process requiring before/after PR comparisons for any rule changes.

What you’ll learn:

• How Tilt improved first-time PR approval rates
• How to build a knowledge base using AI
• Testing strategies for AI development