tidytext
Finished, widely taught, and shipping roxygen fixes.
Comparison · Analytics
finetune vs loo
A side-by-side editorial comparison of finetune and loo — release velocity, themes, recent moves, and the top alternatives to consider.
finetune vs loo: at a glance
What is finetune?
finetune tracks tune's evolving contracts more than it advances racing itself
finetune provides the racing and simulated-annealing alternatives to grid search in tidymodels. The core algorithms have been stable since 1.0.x; what has changed is everything around them — censored regression support arriving with a tune release, weighted resampling estimates preserved through racing, and a breaking move to named-only optional arguments.
What is loo?
loo keeps rewriting the diagnostics Bayesian modellers read off model comparison
loo computes leave-one-out cross-validation and model comparison for Bayesian models in the Stan ecosystem. Two releases in this window changed what users actually read: 2.7.0 replaced the fixed Pareto-k thresholds with sample-size-dependent ones and dropped the middle category, and 2.10.0 reshaped loo_compare's output into a data.frame with new uncertainty columns. The releases between are diagnostic robustness fixes and moment-matching corrections.
finetune vs loo: editorial side-by-side
finetune
0.0ANALYTICS
finetune tracks tune's evolving contracts more than it advances racing itself
◆ Current state
finetune provides the racing and simulated-annealing alternatives to grid search in tidymodels. The core algorithms have been stable since 1.0.x; what has changed is everything around them — censored regression support arriving with a tune release, weighted resampling estimates preserved through racing, and a breaking move to named-only optional arguments.
◆ Where it's heading
This is a package operating downstream of tune, adopting whatever the shared resampling machinery grows next rather than proposing new search strategies. The 1.3.0 weighting work is a clear example: tune changed how resampling estimates are computed, and finetune's job was to not lose the weights during racing. Error messages and input checks are the steady internal theme.
◆ Prediction
Expect the next release to absorb whatever tune changes about metric collection or resampling weights; nothing in the entries points to a new search algorithm.
loo
2.5ANALYTICS
loo keeps rewriting the diagnostics Bayesian modellers read off model comparison
◆ Current state
loo computes leave-one-out cross-validation and model comparison for Bayesian models in the Stan ecosystem. Two releases in this window changed what users actually read: 2.7.0 replaced the fixed Pareto-k thresholds with sample-size-dependent ones and dropped the middle category, and 2.10.0 reshaped loo_compare's output into a data.frame with new uncertainty columns. The releases between are diagnostic robustness fixes and moment-matching corrections.
◆ Where it's heading
The package is being brought in line with the current PSIS literature rather than extended with new features, and the practical effect is that the numbers practitioners quote in papers keep changing meaning. Work is increasingly delegated to posterior for shared computations, and the project has added contributor process, benchmarks and a published AI contribution policy.
◆ Prediction
Expect further work on comparison diagnostics — the p_worse and diag_* columns are new enough that their defaults and documentation will likely be revised next.
Alternatives to finetune and loo
Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either finetune or loo.
textrecipes
Text features finally stay sparse all the way to the model.
probably
The package that made calibration a step instead of an afterthought.
workflowsets
workflowsets keeps widening what counts as a model worth comparing.
workflows
The tidymodels pipeline grew a third stage, and it happens after the model runs.
vetiver
Posit's MLOps package went quiet for two years, then came back to keep up with recipes.
See all finetune alternatives → · See all loo alternatives →
Recent activity from finetune and loo
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 20d agoloopsis_smooth_tail revert and simplify arg restored
- 1mo agolooloo_compare returns a data.frame with new uncertainty columns ⚡
- 3mo agofinetuneRacing preserves tune's assessment-set weighting
- 7mo agolooStacking overflow fixes and posterior-based ESS
- 1y agofinetuneMaintenance release; magrittr pipe replaced with base pipe
- 2y agolooMore robust Pareto-k diagnostics and moment matching
- 2y agofinetuneCensored regression models can be raced and annealed
- 2y agolooPareto-k thresholds now depend on sample size ⚡
- 3y agofinetuneKeep-up release for tune and dplyr; .config alignment fixed
- 3y agolooLOO predictive metrics and CRPS scoring functions
- 3y agofinetuneRacing results filter to fully resampled configurations
- 3y agofinetuneInformative error when resamples are too few for racing
Frequently asked questions
What is the difference between finetune and loo?
They serve adjacent needs but don't currently overlap on shipped themes. loo is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is finetune better than loo?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. loo is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.
What are the best alternatives to finetune?
Top finetune alternatives in Analytics are ranked by recent ship velocity. Browse the "finetune alternatives" section above for the current picks, or visit /alternatives/finetune for the full list with editorial commentary on each.
What are the best alternatives to loo?
Top loo alternatives in Analytics are ranked by recent ship velocity. Browse the "loo alternatives" section above for the current picks, or visit /alternatives/loo for the full list with editorial commentary on each.