Thumbtack Emily Fujimoto

Thumbtack's Using Android Screenshot Tests To Verify View Correctness

Original post Using Android Screenshot Tests To Verify View Correctness

Testing UI Performance
Android

Article Summary

Emily Fujimoto from Thumbtack reveals how her team caught critical layout bugs that traditional testing completely missed. The solution? Screenshot tests that verify what your UI actually looks like, not just what elements exist.

Thumbtack's Android team struggled with UI testing for years. Robolectric tests required tons of boilerplate and couldn't verify if views actually looked correct—just whether elements were visible. They needed a better way to catch visual regressions before shipping.

Key Takeaways

Critical Insight

Screenshot testing using Facebook's Android library fills critical gaps in UI verification by comparing rendered images against reference screenshots, catching visual regressions that traditional assertion-based tests cannot detect.

Continue reading

More on Testing Orchestrating our UI test suite with Maestro Doist Nov 20, 2025 More from Thumbtack How we moved 1,500 Android screenshot tests to Roborazzi Thumbtack Aug 8, 2026 Also on Android Bring 3D to Life in Flutter with flutter_scene and Flutter GPU Kasikornbank Oct 14, 2026

What This Article Covers

Problem

Thumbtack's Android team used Robolectric tests to verify UI views, but these tests couldn't catch visual problems. They required at least one assertion per UI element and missed issues like text wrapping and overlapping views.

Solution

Emily Fujimoto's team adopted Facebook's Screenshot Tests for Android library and built a custom Python script. The script rendered views on devices, generated reference images, and compared them against new screenshots to identify visual differences.

Impact

Screenshot tests found layout problems during Constraint Layout library upgrades and tinting changes that Robolectric tests had missed. The team also eliminated the need for extensive assertion lists in their test code.

The team discovered unexpected benefits beyond bug catching that changed how they review code and share progress with designers.

This page summarizes “Using Android Screenshot Tests To Verify View Correctness” by Thumbtack, published Dec 18, 2020. All credit for the original work goes to the authors.

Read the original on medium.com (opens in new tab)

More on Testing

Testing Android UI Performance Part 2

You found the jank in your Android app. Now what? Most teams stop at identifying the problem—but that's only half the battle.

Glance Jun 1, 2023

Testing Android UI Performance

Glance's engineering team serves 100M+ users where visual experience is everything. When UI performance drops, users notice immediately—and they leave.

Glance May 18, 2023

How We Reduced Our ANR by Three Times

OkCredit slashed their ANR rate by 67% and cold startup time by 70%. Here's how they debugged one of Android's most frustrating problems.

OkCredit Oct 18, 2022

Android UI Testing with Firebase

Turo's Android team hit a wall: their single-device test setup couldn't keep up with their growing UI test suite. Hours of wait time for a single test run wasn't going to cut it.

Turo Jul 19, 2022

Rendering Performance Monitoring on Android

Booking.com's Android team built their own rendering performance monitoring system. Here's why Google Play Console metrics weren't enough.

Booking Jun 30, 2022

Pre-submit UI Tests at Pinterest

Pinterest's UI test suite was failing more than 50% of the time. Engineers were drowning in false positives, and tests had lost all credibility.

Pinterest Oct 20, 2020
See all 172 Testing articles

More from Thumbtack

Leveraging AI to build a faster iOS CI system

Muhieddine EL Kaissi from Thumbtack cut iOS CI time in half using runtime coverage instead of running every test. His Smart Test Selection system proves you don't need faster tests—you need fewer test

Thumbtack Apr 21, 2026

Headless Screenshot Testing in Thumbtack's Android Apps

Brian Terczynski from Thumbtack reveals how they ditched emulators entirely for their 1,500+ screenshot tests. The result? Tests that run at unit test speed and actually gate code merges.

Thumbtack Mar 31, 2026

Thumbtack's Journey to Swift 6

Scott Southerland from Thumbtack just shared what most iOS teams won't tell you: migrating to Swift 6 took 16+ months and broke their entire test suite. Here's the battle-tested playbook they wish the

Thumbtack Aug 12, 2025

Debugging OOMs: SQLite Query Optimization

Brian Terczynski from Thumbtack tracked down a brutal Android OOM bug that was crashing apps at startup—and the culprit wasn't a memory leak. It was hiding in plain sight: their SQLite queries.

Thumbtack Jul 17, 2025

Swift Actor in Unit Tests

Abdul Moiz from Thumbtack reveals how Swift 6's concurrency checks broke their entire test suite. Their solution? A clever protocol-based pattern that makes actors mockable without sacrificing thread

Thumbtack Jul 3, 2024

Java Is Dead Long Live Kotlin Part 2

Emily Fujimoto from Thumbtack just closed the book on a 6-year migration journey. The final push to eliminate Java from their Android codebase revealed lessons every mobile team needs to hear.

Thumbtack May 16, 2024
All 21 Thumbtack articles

AI tools for Android

Android MCP Server An MCP server that connects AI agents to Android devices via ADB for screenshots, UI inspection, and package management. Android Reverse Engineering Skill A skill that gives AI agents the ability to decompile Android binaries and map out API endpoints and authentication flows. Jetpack Compose Agent Skill AI coding guidance for Jetpack Compose with 13 reference guides and actual androidx source code receipts.
Browse all AI tools →