TestMu AI adds run-by-run comparison to mobile app profiling
TestMu AI, the quality engineering platform formerly known as LambdaTest, has launched a Comparison view within its App Profiling Insights product. The feature allows engineering teams to select multiple runs of the same mobile test and plot them side by side on a shared elapsed-time axis, rather than collapsing sessions into an aggregate trend line.
The tool supports overlaying up to five runs simultaneously across six metrics: CPU usage, memory, frame rate, disk, network throughput and startup time. One run is designated as the baseline, and every other run displays colour-coded deltas against it, with green indicating improvement and red indicating regression. Because each run retains the same colour across all charts, a spike visible in the memory panel can be traced directly to the concurrent frame-rate and startup-time readings without switching views.
What the feature does
Teams can filter and group runs by device model, OS version, app build and pass/fail status, allowing a comparison to be narrowed to the variables most likely to explain a regression. Aggregate statistics (average, minimum, maximum and 90th-percentile values) are presented side by side for every selected run, which the company says surfaces builds that appear healthy on mean performance but still breach acceptable bounds on their worst executions.
A shared timeline zoom means dragging a slice in one chart reframes every other chart to the same window. Comparisons are auto-saved per test, restoring the selected runs, baseline designation and active filters without a manual save step. Organisation-level SLA bands are drawn on every chart for at-a-glance compliance checking.
Mudit Singh, co-founder of TestMu AI, framed the problem the feature addresses: "Averages are how performance regressions hide. A build can look green on the dashboard and still be the one your users complain about, because the problem lives in one device or one OS version, and the mean smooths it away. Comparison puts the individual runs next to each other with the delta already computed."
The Comparison view is available now for Appium tests on both iOS and Android, sitting alongside the existing Trends view.
Market context
Mobile performance testing is a crowded sub-category within the broader quality engineering market, which encompasses continuous testing platforms, device farms and AI-assisted test generation. Competitors in the device-farm and profiling space include BrowserStack, Sauce Labs and Perfecto, all of which offer aggregate performance dashboards with varying degrees of run-level granularity. The emphasis on isolating individual-run variance rather than statistical averages reflects a wider industry shift: as mobile applications are shipped more frequently through CI/CD pipelines, the diagnostic value of mean metrics has decreased relative to percentile and per-run analysis.
The rebrand from LambdaTest to TestMu AI signals a deliberate repositioning around agentic AI capabilities, a term that has gained traction across the testing and DevOps toolchain since 2025. The company describes its platform as the first agentic AI-powered quality engineering offering, though several well-funded competitors are pursuing similar AI-assisted test automation approaches and independently claim comparable positioning.
TestMu AI did not disclose customer numbers, revenue figures or pricing for the new feature in its announcement. The Comparison view's practical value will become clearer as the company publishes case studies showing measurable reductions in regression investigation time, which is the metric most likely to drive procurement decisions in enterprise mobile development teams.