Duolingo Brock Janikowski

How Duolingo reduced manual regression tests by 70% using AI tools

Original post How we reduced manual regression tests by 70% using AI tools

Testing AI
iOS Android

Article Summary

Duolingo's QA team cut manual regression testing by 70% using AI. Here's how they made it work at scale.

Our full summary of this post is not ready yet. The links below cover the same topic.

Continue reading

More on Testing Vision-Based Mobile App Testing CLI for Claude Code Posts on X Feb 26, 2026 More from Duolingo How We Automated iOS Unit Test Generation with AI Duolingo Jun 24, 2026 Also on iOS How the Xcode 27 MCP can lead to higher token costs when navigating the Simulator SwiftLee Oct 26, 2026

This page summarizes “How we reduced manual regression tests by 70% using AI tools” by Duolingo, published Feb 7, 2025. All credit for the original work goes to the authors.

Read the original on blog.duolingo.com (opens in new tab)

More on Testing

Scaling Mobile UI Testing with AI

Trendyol scaled from 4,869 to 10,400 UI tests in under a year — while keeping execution under one hour. Here's how AI became their test generation engine.

Trendyol Nov 5, 2025

DragonCrawl: Generative AI for High-Quality Mobile Testing

Uber's mobile testing was broken. Engineers spent 30-40% of their time maintaining test scripts that broke with every UI change. So they built an AI that tests apps like a human would.

Uber Apr 23, 2024

Record, generate, run: AI-powered UI test generation for iOS

Grab Engineering just turned a days-long iOS testing nightmare into a 10-minute workflow. Their AI-powered system records your app interactions and auto-generates complete UI tests, including mocks, f

Grab Apr 22, 2026

Swift Testing Agent Skill: Write high quality tests with AI

Antoine van der Lee from SwiftLee just open-sourced an Agent Skill that teaches AI to write Swift tests the right way. No more serialized tags killing your test performance.

SwiftLee Feb 17, 2026

Agent Device: AI-Native Mobile Automation for iOS and Android

Callstack just released a CLI tool that finally lets AI agents actually test mobile apps. No more agents that can write code but can't click a button.

Callstack Feb 17, 2026

Performing Due Diligence As Android Engineers

Ishan Khanna from Tinder shares a hard-earned lesson: that shiny third-party SDK could be a ticking time bomb for your app. Here's the framework his team uses to avoid disaster.

Tinder Sep 19, 2022
See all 172 Testing articles

More from Duolingo

How we used Macros to Promote MVVM architecture adoption

Duolingo's iOS team turned a boilerplate problem into a Swift Macros showcase. Their codebase grew, but developer friction didn't have to.

Duolingo Jul 10, 2025

Duolingo + KMP: A Case Study in Developer Productivity

Duolingo ships weekly to 40M+ daily active users across 176 countries. Their secret weapon for speed? Kotlin Multiplatform.

Duolingo Jul 3, 2025

Duolingo's Android Performance Case Study and DAU Growth

Chenglai Huang and Michael Huang from Duolingo reveal how 39% of entry-level Android users were abandoning their app before it even loaded. Their fix? A masterclass in performance optimization that sa

Duolingo Jun 11, 2025

How We Slashed Android Startup Time by 30% with Baseline Profiles

Duolingo's Android team cut startup time by 30% with baseline profiles. But the path from 'easy setup' to production was anything but smooth.

Duolingo May 4, 2025

How we sped up Android and iOS builds by 68% on CI

Duolingo's engineers were stuck waiting 50 minutes for every CI build. That's hundreds of hours wasted every week across the team.

Duolingo Dec 18, 2024

How server-driven UI keeps our shop fresh

Duolingo ships UI changes in minutes, not weeks. Their server-driven UI system bypasses app store releases entirely.

Duolingo Nov 8, 2024
All 11 Duolingo articles

AI tools for iOS

App Store Connect CLI (asc) A command-line tool for managing App Store Connect — TestFlight, builds, certificates, and metadata without a browser. App Store Rejections MCP An MCP server that gives AI agents access to App Store rejection data, real-world cases, and Apple's Review Guidelines. Claude Swift Engineering A Claude Code plugin with 12 specialized agents and 18 knowledge skills for Swift 6.2, TCA, and SwiftUI development.
Browse all AI tools →