tidytext
Finished, widely taught, and shipping roxygen fixes.
Comparison · Analytics
mlr3mbo vs mlr3measures
A side-by-side editorial comparison of mlr3mbo and mlr3measures — release velocity, themes, recent moves, and the top alternatives to consider.
Shared themes:mlr3r-stats
mlr3mbo vs mlr3measures: at a glance
What is mlr3mbo?
mlr3mbo picked its defaults from a benchmark study, not from taste
mlr3mbo does model-based and Bayesian optimisation for mlr3. Its 1.0.0 release added a dictionary of pre-built acquisition-function optimisers and, more consequentially, replaced the default surrogate, acquisition function and optimiser settings with values derived from a large-scale benchmark study. The releases since are corrections to the acquisition-optimiser path exposed by that new default configuration.
What is mlr3measures?
mlr3measures is systematically retrofitting sample weights across every metric
mlr3measures is the metric library behind mlr3. Recent releases follow two threads: adding measures — linex, pinball, Mu AUC, gmean, gpr, mcc — and retrofitting sample_weights support across the existing ones, reaching AUC and the confusion-matrix family in 1.3.0. Along the way 1.1.0 deprecated four regression measures and corrected the bias definitions.
mlr3mbo vs mlr3measures: editorial side-by-side
mlr3mbo
2.5ANALYTICS
mlr3mbo picked its defaults from a benchmark study, not from taste
◆ Current state
mlr3mbo does model-based and Bayesian optimisation for mlr3. Its 1.0.0 release added a dictionary of pre-built acquisition-function optimisers and, more consequentially, replaced the default surrogate, acquisition function and optimiser settings with values derived from a large-scale benchmark study. The releases since are corrections to the acquisition-optimiser path exposed by that new default configuration.
◆ Where it's heading
The package has moved from a toolkit that expected users to assemble a Bayesian optimisation loop into one with a defensible default loop, and the recent fixes — warm-start sizing on multi-objective archives, silently discarded terminators, stale x_domain values — are the consequences of more people running the default path.
◆ Prediction
Expect continued hardening of the acquisition-optimiser classes rather than new acquisition functions.
mlr3measures
0.0ANALYTICS
mlr3measures is systematically retrofitting sample weights across every metric
◆ Current state
mlr3measures is the metric library behind mlr3. Recent releases follow two threads: adding measures — linex, pinball, Mu AUC, gmean, gpr, mcc — and retrofitting sample_weights support across the existing ones, reaching AUC and the confusion-matrix family in 1.3.0. Along the way 1.1.0 deprecated four regression measures and corrected the bias definitions.
◆ Where it's heading
The library is maturing rather than growing: weighted evaluation and observation-wise loss functions are being brought to metrics that already existed, which is what downstream weighted-resampling and per-observation analysis need. The deprecations suggest the maintainers are willing to remove measures they consider ill-defined rather than keep them for compatibility.
◆ Prediction
Expect sample_weights and observation-wise variants to reach the remaining measures that lack them.
Alternatives to mlr3mbo and mlr3measures
Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either mlr3mbo or mlr3measures.
textrecipes
Text features finally stay sparse all the way to the model.
probably
The package that made calibration a step instead of an afterthought.
workflowsets
workflowsets keeps widening what counts as a model worth comparing.
workflows
The tidymodels pipeline grew a third stage, and it happens after the model runs.
vetiver
Posit's MLOps package went quiet for two years, then came back to keep up with recipes.
See all mlr3mbo alternatives → · See all mlr3measures alternatives →
Recent activity from mlr3mbo and mlr3measures
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 23d agomlr3mboAcquisition optimiser fixes for warm starts and archives
- 3mo agomlr3mboDictionary lookup and restart-limit fixes
- 3mo agomlr3measuresWeighted AUC and weighted confusion-matrix measures
- 4mo agomlr3mborush 1.0.0 compatibility and Surrogate$check()
- 5mo agomlr3mbomlr3mbo 1.0.0 ships benchmark-derived default settings ⚡
- 8mo agomlr3measuresObservation-wise loss for bbrier and logloss
- 10mo agomlr3mbomlr3learners 0.13.0 compatibility
- 11mo agomlr3measuresrse, rsq, rrse and rae deprecated; bias measures corrected
- 11mo agomlr3mboMaintainer change and mlr3pipelines 0.9.0 upkeep
- 1y agomlr3measureslinex, pinball and Mu AUC measures added
- 2y agomlr3measuresgmean, gpr and multiclass MCC added
- 4y agomlr3measuresObservation-wise loss functions introduced
Frequently asked questions
What is the difference between mlr3mbo and mlr3measures?
Both compete on the same themes — mlr3, r-stats — within Analytics. mlr3mbo is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is mlr3mbo better than mlr3measures?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. mlr3mbo is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.
What are the best alternatives to mlr3mbo?
Top mlr3mbo alternatives in Analytics are ranked by recent ship velocity. Browse the "mlr3mbo alternatives" section above for the current picks, or visit /alternatives/mlr3mbo for the full list with editorial commentary on each.
What are the best alternatives to mlr3measures?
Top mlr3measures alternatives in Analytics are ranked by recent ship velocity. Browse the "mlr3measures alternatives" section above for the current picks, or visit /alternatives/mlr3measures for the full list with editorial commentary on each.