← Back to home
Comparison · Infra & APIs

Depot vs evaluate

A side-by-side editorial comparison of Depot and evaluate — release velocity, themes, recent moves, and the top alternatives to consider.

Depot vs evaluate: at a glance

FeatureDepotevaluate
SectorInfra & APIsInfra & APIs
Velocity score6.30.0
Sparks · 30d10
Top themesci-cd, build-acceleration, test-intelligence, git-hostingr-lib, code-evaluation, knitr, graphics-capture
Last editorial update14h ago1h ago
WebsiteVisit →

What is Depot?

Depot keeps absorbing the CI stack — tests, networking, runners, now its own git host.

Depot has moved well past build caching. Test results reached general availability in July with org-wide flaky, slow, and recurring failure analytics plus timing-based shard splitting; Sherlock's AI analysis became available on any run rather than only failed ones; and CI jobs can join a Tailscale tailnet to reach private services. The runner fleet now defaults to macOS 26 on M4 hardware, Depot CI understands GitHub stacked pull requests, and Depot Code — a diskless git server backed by blob storage — entered private beta.

Read the full Depot trajectory →

What is evaluate?

The engine under every knitted R document reached 1.0 by making evaluation behave like the console.

evaluate captures the output, plots, messages and conditions produced by running R code, and it is the layer knitr and R Markdown sit on. The 1.0.0 release changed core semantics — multi-expression input now stops at the first error — and gave results a real class. Since then, releases have been graphics-focused: ragg-based capture when available, grid plot fixes, and a patch for ggplot2 4.0.0.

Read the full evaluate trajectory →

Depot vs evaluate: editorial side-by-side

D
Depot
INFRA · APIS
6.3

Depot keeps absorbing the CI stack — tests, networking, runners, now its own git host.

◆ Current state

Depot has moved well past build caching. Test results reached general availability in July with org-wide flaky, slow, and recurring failure analytics plus timing-based shard splitting; Sherlock's AI analysis became available on any run rather than only failed ones; and CI jobs can join a Tailscale tailnet to reach private services. The runner fleet now defaults to macOS 26 on M4 hardware, Depot CI understands GitHub stacked pull requests, and Depot Code — a diskless git server backed by blob storage — entered private beta.

◆ Where it's heading

The pattern is absorbing each adjacent piece of the pipeline that Depot's position already gives it data about. It runs the builds, so it owns test timing, so it can balance shards; it runs the jobs, so it can diagnose them; it hosts the runners, so it can wire private networking into them. Depot Code extends the same logic upstream to source hosting, which would close the loop between repository and runner. A quieter parallel thread keeps moving SDK- and dashboard-only settings into the CLI, stated explicitly as making projects configurable by agents and scripts.

◆ Prediction

Depot Code widening past private beta and binding more tightly to CI is the move the rest of the window sets up. The test work is also positioned to go from reporting to selection — skipping tests a change cannot affect — since Depot now holds the timing and failure history that would require, though the entries stop short of saying so.

E
evaluate
INFRA · APIS
0.0

The engine under every knitted R document reached 1.0 by making evaluation behave like the console.

◆ Current state

evaluate captures the output, plots, messages and conditions produced by running R code, and it is the layer knitr and R Markdown sit on. The 1.0.0 release changed core semantics — multi-expression input now stops at the first error — and gave results a real class. Since then, releases have been graphics-focused: ragg-based capture when available, grid plot fixes, and a patch for ggplot2 4.0.0.

◆ Where it's heading

The package is being tightened rather than expanded. 1.0.0 removed complexity it could not justify, deprecated include_timing, dropped a function testing for an object it never created, and aligned error behaviour with the console; 1.0.4 then moved plot capture toward a faster, more capable device. The recurring theme is reliability of output capture across environments, which is exactly what a document-rendering substrate needs and what local_reproducible_output() exists to enforce.

◆ Prediction

Expect continued fast-follow patches keyed to graphics-stack releases — ggplot2 and ragg in particular — rather than new API surface.

Alternatives to Depot and evaluate

Other Infra & APIs products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either Depot or evaluate.

See all Depot alternatives → · See all evaluate alternatives →

Recent activity from Depot and evaluate

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 4d agoDepotmacOS 26 is now the default macOS version for GitHub Actions runners
  2. 11d agoDepotDepot CI now supports native GitHub stacked pull requests
  3. 14d agoDepotSet cache retention when creating a project with --cache-policy-keep-days
  4. 15d agoDepotView and edit project details from the Depot CLI
  5. 16d agoDepotTest results are now generally available
  6. 24d agoDepotAI analysis available for all Depot CI workflows and jobs
  7. 11mo agoevaluatePatch for ggplot2 4.0.0 support
  8. 1y agoevaluatePlot capture moves to ragg when available
  9. 1y agoevaluateFix for rlang::abort() inside evaluate()
  10. 1y agoevaluate1.0 stops at the first error and gives results a class
  11. 2y agoevaluateSource handler gains access to the parsed call

Frequently asked questions

What is the difference between Depot and evaluate?

They serve adjacent needs but don't currently overlap on shipped themes. Depot is currently shipping more aggressively (velocity 6.3 vs 0.0), with 1 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is Depot better than evaluate?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. Depot is currently shipping more aggressively (velocity 6.3 vs 0.0), with 1 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Infra & APIs products to evaluate alongside.

What are the best alternatives to Depot?

Top Depot alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "Depot alternatives" section above for the current picks, or visit /alternatives/depot for the full list with editorial commentary on each.

What are the best alternatives to evaluate?

Top evaluate alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "evaluate alternatives" section above for the current picks, or visit /alternatives/evaluate for the full list with editorial commentary on each.