discrim
discrim settled into a thin engine shim after handing its model definitions to parsnip.
Comparison · Analytics
bonsai vs sparklyr
A side-by-side editorial comparison of bonsai and sparklyr — release velocity, themes, recent moves, and the top alternatives to consider.
bonsai vs sparklyr: at a glance
What is bonsai?
bonsai keeps widening tidymodels' boosted-tree engine bench, catboost most recently
bonsai exists to attach non-core tree engines to parsnip's boost_tree() and rand_forest(), and the release history reads as a steady accumulation of them: partykit, aorsf, lightgbm, and now catboost. The 0.4.x line is spent making catboost behave like a full tidymodels citizen rather than adding anything new.
What is sparklyr?
sparklyr now spends its releases absorbing dbplyr changes and feeding pysparklyr
sparklyr connects R to Spark, and almost nothing in this window originates inside the package. Releases restore compatibility after dbplyr changes its SQL generation, adapt to Spark 4.0 and to R 4.4's version-comparison changes, and convert functions into S3 methods so pysparklyr can supply its own implementations.
bonsai vs sparklyr: editorial side-by-side
bonsai
0.0ANALYTICS
bonsai keeps widening tidymodels' boosted-tree engine bench, catboost most recently
◆ Current state
bonsai exists to attach non-core tree engines to parsnip's boost_tree() and rand_forest(), and the release history reads as a steady accumulation of them: partykit, aorsf, lightgbm, and now catboost. The 0.4.x line is spent making catboost behave like a full tidymodels citizen rather than adding anything new.
◆ Where it's heading
Each engine follows the same arc — land it, then close the gaps that keep it from tuning cleanly (parameter naming, multi_predict, threading, case weights). Recent work is squarely in that second phase for catboost, with dials supplying the matching parameter objects on its own release schedule. Bug-fix density is high relative to new surface.
◆ Prediction
Expect the catboost integration to keep filling in tuning and GPU-related arguments before any further engine is added; the entries give no signal about which engine would come next.
sparklyr
0.0ANALYTICS
sparklyr now spends its releases absorbing dbplyr changes and feeding pysparklyr
◆ Current state
sparklyr connects R to Spark, and almost nothing in this window originates inside the package. Releases restore compatibility after dbplyr changes its SQL generation, adapt to Spark 4.0 and to R 4.4's version-comparison changes, and convert functions into S3 methods so pysparklyr can supply its own implementations.
◆ Where it's heading
Two dependencies set the agenda. dbplyr repeatedly changes identifier quoting and lazy-table internals, and each change costs sparklyr a release. Meanwhile the package is being hollowed into a backend: ml_fit(), spark_apply(), spark_write_delta() and now tune_grid_spark() exist as methods so that pysparklyr, the Databricks Connect path, can override them. Dependency removal - tibble, rappdirs, digest - runs alongside as the package slims down.
◆ Prediction
Expect the next releases to continue tracking dbplyr and Spark versions, and more functions to be converted to methods as functionality shifts toward pysparklyr; new capability arriving in sparklyr itself looks unlikely.
Alternatives to bonsai and sparklyr
Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either bonsai or sparklyr.
dbparser
dbparser shed its database and CSV writers to become just a DrugBank parser.
desirability2
desirability2 is making multi-metric model selection a first-class tidymodels step.
crosstalk
crosstalk is frozen infrastructure: four releases in five years, mostly CRAN upkeep.
cmdstanr
cmdstanr keeps adding fast approximations beside full HMC, and fighting Windows toolchains.
comtradr
comtradr's 1.0 line is a long tail of patches against a brittle UN trade API.
See all bonsai alternatives → · See all sparklyr alternatives →
Recent activity from bonsai and sparklyr
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 1mo agosparklyrRestores compatibility after dbplyr changed Hive quoting
- 2mo agobonsaicatboost gains multi_predict() and corrected tuning parameters
- 3mo agosparklyrAdds tune_grid_spark() for pysparklyr to implement
- 10mo agosparklyrFixes lazy-table field lookup and a name collision
- 1y agosparklyrCatches up with released Spark 4.0; ml_load() reads via Spark
- 1y agobonsaicatboost engine added to boost_tree()
- 1y agobonsailightgbm accepts sparse matrices for fit and predict
- 2y agobonsaiaorsf fit failure in multisession workers fixed
- 2y agobonsaiaorsf engine added; lightgbm gains dataset params and case weights
- 2y agosparklyrDatabricks autoloader streaming ingestion; R 4.4 fixes
- 2y agosparklyrDrops tibble and rappdirs; retires Spark 2.3 JARs
- 3y agobonsailightgbm num_leaves becomes tunable; alias arguments disallowed
Frequently asked questions
What is the difference between bonsai and sparklyr?
They serve adjacent needs but don't currently overlap on shipped themes. bonsai and sparklyr are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is bonsai better than sparklyr?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. bonsai and sparklyr are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.
What are the best alternatives to bonsai?
Top bonsai alternatives in Analytics are ranked by recent ship velocity. Browse the "bonsai alternatives" section above for the current picks, or visit /alternatives/bonsai-r for the full list with editorial commentary on each.
What are the best alternatives to sparklyr?
Top sparklyr alternatives in Analytics are ranked by recent ship velocity. Browse the "sparklyr alternatives" section above for the current picks, or visit /alternatives/sparklyr for the full list with editorial commentary on each.