Oh Dear
Oh Dear's weekly changelogs have carried a security section five weeks running.
Comparison · Infra & APIs
TestingBot vs Umbrel
A side-by-side editorial comparison of TestingBot and Umbrel — release velocity, themes, recent moves, and the top alternatives to consider.
TestingBot vs Umbrel: at a glance
What is TestingBot?
TestingBot's autumn work is plumbing: a rebuilt tunnel and another bug-tracker link.
TestingBot runs a cross-browser and real-device cloud. October brought Tunnel v5, a rewrite of its local-testing tunnel with host allowlists, SSH host key checks, SOCKS5, Kerberos and PAC proxy support, self-contained builds without Java, and health endpoints with JSON logs. A Linear integration files bugs from manual sessions, and an iPhone Duo simulator lets teams test a foldable iPhone before Apple ships it. Vibium's agent-driven automation joined the grid in August and Mobilewright tests in October.
What is Umbrel?
umbrelOS 2.0 went final in September; 2.0.1 is a kernel patch with a Raspberry Pi stopgap.
umbrelOS 2.0 shipped on September 22 after two betas, bringing Photos, iPhone and Mac apps, Machines, multiple users, an MCP server, Storage Manager with FailSafe RAID, cloud downloads, GPU acceleration and automatic HTTPS. Beta 2 added agents that can create and use Machines while the owner watches. 2.0.1 on November 1 fixes CVE-2026-98432 with a patched kernel on x86 devices; Raspberry Pi has no fixed kernel yet, so umbrelOS blocks the traffic needed to trigger it.
TestingBot vs Umbrel: editorial side-by-side
TestingBot
5.0INFRA · APIS
TestingBot's autumn work is plumbing: a rebuilt tunnel and another bug-tracker link.
◆ Current state
TestingBot runs a cross-browser and real-device cloud. October brought Tunnel v5, a rewrite of its local-testing tunnel with host allowlists, SSH host key checks, SOCKS5, Kerberos and PAC proxy support, self-contained builds without Java, and health endpoints with JSON logs. A Linear integration files bugs from manual sessions, and an iPhone Duo simulator lets teams test a foldable iPhone before Apple ships it. Vibium's agent-driven automation joined the grid in August and Mobilewright tests in October.
◆ Where it's heading
The summer made the platform fit for teams; the autumn makes it fit for corporate networks and CI. Tunnel v5 targets the place enterprise trials usually stall, behind proxies and security reviews, and its config-file and environment-variable setup suits pipelines and Docker. The integration list keeps growing one tracker at a time, while the device catalogue continues its usual rotation.
◆ Prediction
Expect further CI-oriented tunnel and reporting work, and more automation frameworks on the grid alongside Mobilewright and Vibium. The Vibium MCP path has had no follow-up in these entries.
Umbrel
2.5INFRA · APIS
umbrelOS 2.0 went final in September; 2.0.1 is a kernel patch with a Raspberry Pi stopgap.
◆ Current state
umbrelOS 2.0 shipped on September 22 after two betas, bringing Photos, iPhone and Mac apps, Machines, multiple users, an MCP server, Storage Manager with FailSafe RAID, cloud downloads, GPU acceleration and automatic HTTPS. Beta 2 added agents that can create and use Machines while the owner watches. 2.0.1 on November 1 fixes CVE-2026-98432 with a patched kernel on x86 devices; Raspberry Pi has no fixed kernel yet, so umbrelOS blocks the traffic needed to trigger it.
◆ Where it's heading
Umbrel has moved from a server you visit to one that agents and phones use directly: per-agent tokens, background camera-roll backup and Finder integration all reduce the need to open the web interface. The first release after 2.0 is security maintenance, and that maintenance now covers a wider surface, from HEIC thumbnails to trusted certificate authorities.
◆ Prediction
Google Drive download, flagged as coming soon in the 2.0 notes, is the clearest next feature. A proper kernel fix for Raspberry Pi should replace the traffic block in a following update.
Alternatives to TestingBot and Umbrel
Other Infra & APIs products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either TestingBot or Umbrel.
Apache ShenYu
ShenYu's AI gateway plugins are back in motion, with 2.7.2 candidate tags in October.
KubeArmor
KubeArmor ships fixes as release-candidate tags, and its feed misses the finals.
All Quiet
All Quiet moves from enterprise integrations to the on-call engineer's own day.
Robusta
Robusta's recent releases patch its runner image rather than add features.
Uptrends
Uptrends spent October on account plumbing: vault credentials, bulk edits and a free trial path.
See all TestingBot alternatives → · See all Umbrel alternatives →
Recent activity from TestingBot and Umbrel
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 23h agoUmbrel2.0.1 patches a kernel network CVE, with a block on Raspberry Pi
- 11d agoTestingBotLinear Integration
- 19d agoTestingBotNew TestingBot Tunnel 5.0
- 26d agoTestingBotMobilewright tests on the TestingBot device cloud
- 1mo agoTestingBotTest on the iPhone Duo simulator before it ships
- 1mo agoUmbrelumbrelOS 2.0 goes final with Photos, Machines and an MCP server
- 1mo agoUmbrelBeta 2: agents can drive Machines, search is redesigned
- 2mo agoUmbrelumbrelOS 2.0 Beta 1 ⚡
- 2mo agoTestingBotVibium browser automation
- 2mo agoTestingBotSamsung Galaxy Tab S11 in the real device cloud
- 3mo agoUmbrelumbrelOS 1.7.4
- 5mo agoUmbrelumbrelOS 1.7.3
Frequently asked questions
What is the difference between TestingBot and Umbrel?
They serve adjacent needs but don't currently overlap on shipped themes. TestingBot is currently shipping more aggressively (velocity 5.0 vs 2.5), with 0 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is TestingBot better than Umbrel?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. TestingBot is currently shipping more aggressively (velocity 5.0 vs 2.5), with 0 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Infra & APIs products to evaluate alongside.
What are the best alternatives to TestingBot?
Top TestingBot alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "TestingBot alternatives" section above for the current picks, or visit /alternatives/testingbot for the full list with editorial commentary on each.
What are the best alternatives to Umbrel?
Top Umbrel alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "Umbrel alternatives" section above for the current picks, or visit /alternatives/umbrel for the full list with editorial commentary on each.