exametrika
A test-theory package that grew into a graphical-model toolkit, now spending its releases paying down the API debt that growth created.
Comparison · Infra & APIs
EDAForge vs MachineShop
A side-by-side editorial comparison of EDAForge and MachineShop — release velocity, themes, recent moves, and the top alternatives to consider.
Shared themes:r-package
EDAForge vs MachineShop: at a glance
What is EDAForge?
EDAForge is a data-quality auditor renamed mid-flight, still finding its CRAN footing.
EDAForge's release feed shows a package changing identity between its first two tags. The v0.1.0 notes describe DataAudit, a data-quality auditing package built around audit_data(), reusable audit_rules() and audit_score(), with install instructions still pointing at vinodhpmd/DataAudit, while the repository now serves EDAForge. Only three tags exist, one of which is a bare compare link with no notes, and the most recent is a CRAN-policy cleanup rather than feature work.
What is MachineShop?
A mature R modelling framework refining variable importance and resampling controls
MachineShop provides a unified interface over a wide set of R model packages, handling fitting, resampling, performance metrics and variable importance behind one API. Recent releases are narrow and mostly corrective: 3.9.2 removed dead documentation links and fixed a Java parameter in a BART example, 3.9.1 ensured global settings reach compute nodes when varimp() runs in parallel and patched XGBoost model compatibility. The last release with real surface change was 3.9.0, which added offset support to XGBModel and a pool argument to calibration() controlling whether calibration curves are computed on pooled predictions or averaged across resampling iterations.
EDAForge vs MachineShop: editorial side-by-side
EDAForge
5.0INFRA · APIS
EDAForge is a data-quality auditor renamed mid-flight, still finding its CRAN footing.
◆ Current state
EDAForge's release feed shows a package changing identity between its first two tags. The v0.1.0 notes describe DataAudit, a data-quality auditing package built around audit_data(), reusable audit_rules() and audit_score(), with install instructions still pointing at vinodhpmd/DataAudit, while the repository now serves EDAForge. Only three tags exist, one of which is a bare compare link with no notes, and the most recent is a CRAN-policy cleanup rather than feature work.
◆ Where it's heading
The substance so far is all in the DataAudit-named 0.1.0: more than a dozen check families spanning missing values, duplicates, ranges, patterns, dependencies and grouped sequences, wrapped in a structured report object with print and summary methods. The 0.1.1 that follows removes a default output path, moves examples to tempdir() and adds an introductory vignette, which is the standard shape of a package being made acceptable to CRAN. The public identity is currently ahead of the release notes, so a reader arriving at the feed cannot tell from it what EDAForge does.
◆ Prediction
Expect the next tag to align the notes with the EDAForge name and add exploratory-analysis functions alongside the auditing core; the compliance pass in 0.1.1 points at a CRAN submission as the near-term goal.
MachineShop
0.0INFRA · APIS
A mature R modelling framework refining variable importance and resampling controls
◆ Current state
MachineShop provides a unified interface over a wide set of R model packages, handling fitting, resampling, performance metrics and variable importance behind one API. Recent releases are narrow and mostly corrective: 3.9.2 removed dead documentation links and fixed a Java parameter in a BART example, 3.9.1 ensured global settings reach compute nodes when varimp() runs in parallel and patched XGBoost model compatibility. The last release with real surface change was 3.9.0, which added offset support to XGBModel and a pool argument to calibration() controlling whether calibration curves are computed on pooled predictions or averaged across resampling iterations.
◆ Where it's heading
Development has concentrated on variable importance and resampling rather than on adding models. 3.8.0 restructured the VariableImportance class to record which method and metric produced it, with an update() method to migrate objects from earlier versions, and extended term-specific p-values to Cox, POLR and survival regression models. 3.7.0 added grouped and stratified resampling to the control objects. The pace has slowed markedly - four releases in the last two years against six in the two before - and the recent content is compatibility work against XGBoost, parsnip, ggplot2 and recipes.
◆ Prediction
Expect the deprecated calibration pooling behaviour to be removed in a future release as the notes state, with the intervening versions continuing to track upstream model package changes.
Alternatives to EDAForge and MachineShop
Other Infra & APIs products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either EDAForge or MachineShop.
nuggets
nuggets keeps compounding on the 2.0 rewrite — more pattern families, lighter install.
projoint
projoint spent a year on CRAN paperwork, then shipped a correctness fix it flagged itself.
eratosthenes
eratosthenes spends 0.1.0 hardening inputs rather than adding chronology methods.
dqcheckr
dqcheckr adds drift analysis, then removes the YAML a user had to hand-write.
lifecontingencies
An actuarial mainstay spends its releases on CI plumbing, not on new mathematics.
See all EDAForge alternatives → · See all MachineShop alternatives →
Recent activity from EDAForge and MachineShop
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 18d agoEDAForgeCRAN-policy pass: no default write path, intro vignette
- 22d agoEDAForgeInitial release under the package's former name, DataAudit
- 27d agoEDAForgeEDAForge v0.1.0
- 5mo agoMachineShopDocumentation link cleanup and a BART example fix
- 8mo agoMachineShopGlobal settings now reach compute nodes during parallel varimp
- 1y agoMachineShopOffset support for XGBoost and per-iteration calibration curves
- 1y agoMachineShopVariable importance objects record their own method and metric
- 2y agoMachineShopGrouped and stratified resampling in the control objects
- 3y agoMachineShopBackward compatibility for older model objects
Frequently asked questions
What is the difference between EDAForge and MachineShop?
Both compete on the same themes — r-package — within Infra & APIs. EDAForge is currently shipping more aggressively (velocity 5.0 vs 0.0), with 0 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is EDAForge better than MachineShop?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. EDAForge is currently shipping more aggressively (velocity 5.0 vs 0.0), with 0 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Infra & APIs products to evaluate alongside.
What are the best alternatives to EDAForge?
Top EDAForge alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "EDAForge alternatives" section above for the current picks, or visit /alternatives/edaforge for the full list with editorial commentary on each.
What are the best alternatives to MachineShop?
Top MachineShop alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "MachineShop alternatives" section above for the current picks, or visit /alternatives/machineshop for the full list with editorial commentary on each.