mlr3mbo
mlr3mbo picked its defaults from a benchmark study, not from taste
Comparison · Analytics
bbotk vs desirability2
A side-by-side editorial comparison of bbotk and desirability2 — release velocity, themes, recent moves, and the top alternatives to consider.
bbotk vs desirability2: at a glance
What is bbotk?
bbotk is generalizing from an optimizer toolkit into an evaluation framework.
bbotk is the black-box optimization backend behind mlr3 tuning: search spaces, terminators, archives, and an async layer built on rush. Recent releases pair steady async-API buildout with removal of the deprecated arguments that preceded it. The 1.9.0 release introduced EvalInstance as a base class for OptimInstance, separating evaluating an objective from optimizing one.
What is desirability2?
desirability2 is making multi-metric model selection a first-class tidymodels step.
desirability2 implements desirability functions, which map several metrics onto a common 0-1 scale so they can be combined into a single objective. The package is young: three releases, the first of which only added a NEWS file. Its substance arrived in 0.1.0 with hooks into tidymodels' tune package.
bbotk vs desirability2: editorial side-by-side
bbotk
2.5ANALYTICS
bbotk is generalizing from an optimizer toolkit into an evaluation framework.
◆ Current state
bbotk is the black-box optimization backend behind mlr3 tuning: search spaces, terminators, archives, and an async layer built on rush. Recent releases pair steady async-API buildout with removal of the deprecated arguments that preceded it. The 1.9.0 release introduced EvalInstance as a base class for OptimInstance, separating evaluating an objective from optimizing one.
◆ Where it's heading
Two threads run through the visible history. The first is async optimization maturing: ArchiveAsync gained a full push/finish/fail vocabulary over rush tasks in 1.11.0, and 1.12.0 deleted the deprecated extra arguments it replaced. The second is dependency consolidation, with custom C hypervolume code handed to moocore and rush pinned to 1.0.0, trimming maintenance surface as the async path becomes the default.
◆ Prediction
The deprecation removals in 1.12.0 suggest the async archive API is now treated as settled; the next releases most likely build on EvalInstance rather than continuing to churn ArchiveAsync.
desirability2
0.0ANALYTICS
desirability2 is making multi-metric model selection a first-class tidymodels step.
◆ Current state
desirability2 implements desirability functions, which map several metrics onto a common 0-1 scale so they can be combined into a single objective. The package is young: three releases, the first of which only added a NEWS file. Its substance arrived in 0.1.0 with hooks into tidymodels' tune package.
◆ Where it's heading
The direction is integration rather than standalone use. Version 0.1.0 added select_best_desirability() and show_best_desirability() to resolve a tuning run against several metrics at once; 0.2.0 exported make_desirability_cols() so other packages can build on it and made data-driven limits the default, removing the need to state ranges by hand. Both releases move work from the user into the package.
◆ Prediction
The exported helper and the developer-facing desirability() API point to adoption by other tidymodels packages as the next step rather than new functionality here.
Alternatives to bbotk and desirability2
Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either bbotk or desirability2.
loo
loo keeps rewriting the diagnostics Bayesian modellers read off model comparison
mlr3fselect
mlr3fselect turned feature selection into an asynchronous, distributable job
lime
lime survives on compatibility patches years after its research moment
mlr3measures
mlr3measures is systematically retrofitting sample weights across every metric
mlr3cluster
mlr3cluster went from a handful of clusterers to covering the field
See all bbotk alternatives → · See all desirability2 alternatives →
Recent activity from bbotk and desirability2
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 24d agobbotkDeprecated extra argument removed from ArchiveAsync methods
- 1mo agobbotkArchiveAsync gains full push/finish/fail task API over rush
- 2mo agobbotkDominance and hypervolume computation moved to moocore
- 4mo agobbotkmlr_test_functions adds standard optimization benchmarks
- 5mo agobbotkEvalInstance base class separates evaluation from optimization ⚡
- 8mo agobbotkFix: conditions now work with OptimizerLocalSearch
- 11mo agodesirability2make_desirability_cols() exported; data-driven limits on by default
- 1y agodesirability2Desirability-based model selection added for tune ⚡
- 3y agodesirability2NEWS.md added to track package changes
Frequently asked questions
What is the difference between bbotk and desirability2?
They serve adjacent needs but don't currently overlap on shipped themes. bbotk is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is bbotk better than desirability2?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. bbotk is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.
What are the best alternatives to bbotk?
Top bbotk alternatives in Analytics are ranked by recent ship velocity. Browse the "bbotk alternatives" section above for the current picks, or visit /alternatives/bbotk for the full list with editorial commentary on each.
What are the best alternatives to desirability2?
Top desirability2 alternatives in Analytics are ranked by recent ship velocity. Browse the "desirability2 alternatives" section above for the current picks, or visit /alternatives/desirability2 for the full list with editorial commentary on each.