← Back to home
Comparison · Infra & APIs

exametrika vs MachineShop

A side-by-side editorial comparison of exametrika and MachineShop — release velocity, themes, recent moves, and the top alternatives to consider.

Shared themes:r-package

exametrika vs MachineShop: at a glance

FeatureexametrikaMachineShop
SectorInfra & APIsInfra & APIs
Velocity score0.00.0
Sparks · 30d00
Top themespsychometrics, irt, biclustering, api-consistencymachine-learning, r-package, model-framework, variable-importance
Last editorial update55m ago1d ago
WebsiteVisit →Visit →

What is exametrika?

A test-theory package that grew into a graphical-model toolkit, now spending its releases paying down the API debt that growth created.

exametrika is an R psychometrics package covering IRT, latent class/rank analysis, and biclustering, and it has been shipping features at an unusual clip for a CRAN package. The last two releases stopped adding capability and turned inward: 1.14.0 fixed a documented-but-never-implemented graphical-parameter passthrough, and 1.15.0 landed a full-codebase audit that corrected bugs which silently produced wrong results on missing data and 0-indexed polytomous codes. Argument names, orders, and defaults are now unified across the model functions, with every old name kept working behind a deprecation warning.

Read the full exametrika trajectory →

What is MachineShop?

A mature R modelling framework refining variable importance and resampling controls

MachineShop provides a unified interface over a wide set of R model packages, handling fitting, resampling, performance metrics and variable importance behind one API. Recent releases are narrow and mostly corrective: 3.9.2 removed dead documentation links and fixed a Java parameter in a BART example, 3.9.1 ensured global settings reach compute nodes when varimp() runs in parallel and patched XGBoost model compatibility. The last release with real surface change was 3.9.0, which added offset support to XGBModel and a pool argument to calibration() controlling whether calibration curves are computed on pooled predictions or averaged across resampling iterations.

Read the full MachineShop trajectory →

exametrika vs MachineShop: editorial side-by-side

E
exametrika
INFRA · APIS
0.0

A test-theory package that grew into a graphical-model toolkit, now spending its releases paying down the API debt that growth created.

◆ Current state

exametrika is an R psychometrics package covering IRT, latent class/rank analysis, and biclustering, and it has been shipping features at an unusual clip for a CRAN package. The last two releases stopped adding capability and turned inward: 1.14.0 fixed a documented-but-never-implemented graphical-parameter passthrough, and 1.15.0 landed a full-codebase audit that corrected bugs which silently produced wrong results on missing data and 0-indexed polytomous codes. Argument names, orders, and defaults are now unified across the model functions, with every old name kept working behind a deprecation warning.

◆ Where it's heading

The arc runs from feature sprawl to consolidation. Through 1.9.0-1.13.0 the package added polytomous biclustering plots, nominal and ordinal IRM samplers, a C++ Gibbs core, and Graphical Lasso; the cost was inconsistent interfaces and correctness bugs that only surfaced under audit. The maintainer is also visibly optimizing for two external gatekeepers — CRAN's 10-minute check budget in 1.13.1, an R Journal reviewer in 1.14.0 — which suggests the package is being groomed for formal publication rather than just iterated on.

◆ Prediction

Expect the next release to continue the deprecation cleanup started in 1.15.0, likely retiring some of the old function names that have carried warnings since 1.7.0, with new modelling work paused until the R Journal submission clears.

M
MachineShop
INFRA · APIS
0.0

A mature R modelling framework refining variable importance and resampling controls

◆ Current state

MachineShop provides a unified interface over a wide set of R model packages, handling fitting, resampling, performance metrics and variable importance behind one API. Recent releases are narrow and mostly corrective: 3.9.2 removed dead documentation links and fixed a Java parameter in a BART example, 3.9.1 ensured global settings reach compute nodes when varimp() runs in parallel and patched XGBoost model compatibility. The last release with real surface change was 3.9.0, which added offset support to XGBModel and a pool argument to calibration() controlling whether calibration curves are computed on pooled predictions or averaged across resampling iterations.

◆ Where it's heading

Development has concentrated on variable importance and resampling rather than on adding models. 3.8.0 restructured the VariableImportance class to record which method and metric produced it, with an update() method to migrate objects from earlier versions, and extended term-specific p-values to Cox, POLR and survival regression models. 3.7.0 added grouped and stratified resampling to the control objects. The pace has slowed markedly - four releases in the last two years against six in the two before - and the recent content is compatibility work against XGBoost, parsnip, ggplot2 and recipes.

◆ Prediction

Expect the deprecated calibration pooling behaviour to be removed in a future release as the notes state, with the intervening versions continuing to track upstream model package changes.

Alternatives to exametrika and MachineShop

Other Infra & APIs products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either exametrika or MachineShop.

See all exametrika alternatives → · See all MachineShop alternatives →

Recent activity from exametrika and MachineShop

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 1mo agoexametrikaFull-codebase audit fixes silent result corruption, unifies arguments
  2. 2mo agoexametrikaPlot methods finally forward the graphical parameters they documented
  3. 3mo agoexametrikaCRAN resubmission: slow tests skipped to fit the check budget
  4. 3mo agoexametrikaGraphical Lasso and Chatterjee's xi extend the package into network estimation
  5. 3mo agoexametrikaFrozen research baseline, never released to CRAN
  6. 5mo agoexametrikaNominal and ordinal IRM samplers, with generic dispatch by data type
  7. 5mo agoMachineShopDocumentation link cleanup and a BART example fix
  8. 8mo agoMachineShopGlobal settings now reach compute nodes during parallel varimp
  9. 1y agoMachineShopOffset support for XGBoost and per-iteration calibration curves
  10. 1y agoMachineShopVariable importance objects record their own method and metric
  11. 2y agoMachineShopGrouped and stratified resampling in the control objects
  12. 3y agoMachineShopBackward compatibility for older model objects

Frequently asked questions

What is the difference between exametrika and MachineShop?

Both compete on the same themes — r-package — within Infra & APIs. exametrika and MachineShop are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is exametrika better than MachineShop?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. exametrika and MachineShop are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). For your specific use case, the alternatives sections above list other Infra & APIs products to evaluate alongside.

What are the best alternatives to exametrika?

Top exametrika alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "exametrika alternatives" section above for the current picks, or visit /alternatives/exametrika for the full list with editorial commentary on each.

What are the best alternatives to MachineShop?

Top MachineShop alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "MachineShop alternatives" section above for the current picks, or visit /alternatives/machineshop for the full list with editorial commentary on each.