HydroPortailStats
France's national flood statistics, ported out of Fortran and into R.
Comparison · Infra & APIs
estimatr vs MachineShop
A side-by-side editorial comparison of estimatr and MachineShop — release velocity, themes, recent moves, and the top alternatives to consider.
Shared themes:r-package
estimatr vs MachineShop: at a glance
What is estimatr?
Fast design-based estimators for experiments, coasting on CRAN patches.
estimatr provides the design-based regression estimators the DeclareDesign ecosystem is built on — robust and cluster-robust standard errors, blocked and clustered randomization inference — implemented for speed rather than generality. The last three releases carry no substantive notes: each is a merge commit for a CRAN patch, one of them accompanied by a typo fix.
What is MachineShop?
A mature R modelling framework refining variable importance and resampling controls
MachineShop provides a unified interface over a wide set of R model packages, handling fitting, resampling, performance metrics and variable importance behind one API. Recent releases are narrow and mostly corrective: 3.9.2 removed dead documentation links and fixed a Java parameter in a BART example, 3.9.1 ensured global settings reach compute nodes when varimp() runs in parallel and patched XGBoost model compatibility. The last release with real surface change was 3.9.0, which added offset support to XGBModel and a pool argument to calibration() controlling whether calibration curves are computed on pooled predictions or averaged across resampling iterations.
estimatr vs MachineShop: editorial side-by-side
estimatr
0.0INFRA · APIS
Fast design-based estimators for experiments, coasting on CRAN patches.
◆ Current state
estimatr provides the design-based regression estimators the DeclareDesign ecosystem is built on — robust and cluster-robust standard errors, blocked and clustered randomization inference — implemented for speed rather than generality. The last three releases carry no substantive notes: each is a merge commit for a CRAN patch, one of them accompanied by a typo fix.
◆ Where it's heading
Direction cannot be read from this feed. The release notes are unedited merge-commit messages, so the only signal is cadence — roughly annual, each release framed as a CRAN patch rather than as feature work. That pattern is consistent with a package whose estimators are considered finished and which now moves only when CRAN policy requires it.
◆ Prediction
On the evidence here the next release is another CRAN compliance patch, but the notes are too thin to support a confident read of what the maintainers are actually working on.
MachineShop
0.0INFRA · APIS
A mature R modelling framework refining variable importance and resampling controls
◆ Current state
MachineShop provides a unified interface over a wide set of R model packages, handling fitting, resampling, performance metrics and variable importance behind one API. Recent releases are narrow and mostly corrective: 3.9.2 removed dead documentation links and fixed a Java parameter in a BART example, 3.9.1 ensured global settings reach compute nodes when varimp() runs in parallel and patched XGBoost model compatibility. The last release with real surface change was 3.9.0, which added offset support to XGBModel and a pool argument to calibration() controlling whether calibration curves are computed on pooled predictions or averaged across resampling iterations.
◆ Where it's heading
Development has concentrated on variable importance and resampling rather than on adding models. 3.8.0 restructured the VariableImportance class to record which method and metric produced it, with an update() method to migrate objects from earlier versions, and extended term-specific p-values to Cox, POLR and survival regression models. 3.7.0 added grouped and stratified resampling to the control objects. The pace has slowed markedly - four releases in the last two years against six in the two before - and the recent content is compatibility work against XGBoost, parsnip, ggplot2 and recipes.
◆ Prediction
Expect the deprecated calibration pooling behaviour to be removed in a future release as the notes state, with the intervening versions continuing to track upstream model package changes.
Alternatives to estimatr and MachineShop
Other Infra & APIs products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either estimatr or MachineShop.
bsvarSIGNs
Sign, zero and narrative restrictions brought into the bsvars ecosystem.
ggdist
The grammar of uncertainty visualization, now drawing the uncertainty in its own estimates.
ipaddress
IP address vectors for R that hit 1.0 and then went quiet.
ltertools
A column-key toolkit for stitching decades of ecological field data into one table.
finnts
Microsoft's automated forecasting framework, still mostly a one-maintainer effort.
See all estimatr alternatives → · See all MachineShop alternatives →
Recent activity from estimatr and MachineShop
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 5mo agoMachineShopDocumentation link cleanup and a BART example fix
- 8mo agoMachineShopGlobal settings now reach compute nodes during parallel varimp
- 1y agoMachineShopOffset support for XGBoost and per-iteration calibration curves
- 1y agoestimatrCRAN version 1.0.4
- 1y agoMachineShopVariable importance objects record their own method and metric
- 2y agoestimatrCRAN version 1.0.2
- 2y agoMachineShopGrouped and stratified resampling in the control objects
- 3y agoestimatrCRAN version 1.0.0
- 3y agoMachineShopBackward compatibility for older model objects
Frequently asked questions
What is the difference between estimatr and MachineShop?
Both compete on the same themes — r-package — within Infra & APIs. estimatr and MachineShop are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is estimatr better than MachineShop?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. estimatr and MachineShop are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). For your specific use case, the alternatives sections above list other Infra & APIs products to evaluate alongside.
What are the best alternatives to estimatr?
Top estimatr alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "estimatr alternatives" section above for the current picks, or visit /alternatives/estimatr for the full list with editorial commentary on each.
What are the best alternatives to MachineShop?
Top MachineShop alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "MachineShop alternatives" section above for the current picks, or visit /alternatives/machineshop for the full list with editorial commentary on each.