mlr3proba
mlr3proba is shedding weight as its survival work moves into sibling packages
A side-by-side editorial comparison of textrecipes and tidytext — release velocity, themes, recent moves, and the top alternatives to consider.
Text features finally stay sparse all the way to the model.
textrecipes supplies the recipes steps for turning text into model-ready columns: tokenizing, hashing, term frequency, TF-IDF, and word embeddings. Version 1.1.0 added a sparse argument to step_dummy_hash(), step_texthash(), step_tf() and step_tfidf() so they emit sparse vectors. The releases before it are a long consistency pass — keep_original_cols on every step that creates columns, informative errors on name collisions, tunable arguments documented, integer rather than double output where integers are what is meant.
Finished, widely taught, and shipping roxygen fixes.
tidytext is the package that made unnest_tokens() and the tidy-data approach to text analysis standard, and it has reached the point where its releases contain nothing to announce. The last three are roxygen package anchors, alt text on vignette figures, and a single bug fix in one stm tidier. The most recent substantive changes were in 0.4.0 and 0.3.3 — stm tidiers for high FREX and lift words, a labels function for scale_x_reordered(), and support for tidying STM models that use content covariates.
textrecipes supplies the recipes steps for turning text into model-ready columns: tokenizing, hashing, term frequency, TF-IDF, and word embeddings. Version 1.1.0 added a sparse argument to step_dummy_hash(), step_texthash(), step_tf() and step_tfidf() so they emit sparse vectors. The releases before it are a long consistency pass — keep_original_cols on every step that creates columns, informative errors on name collisions, tunable arguments documented, integer rather than double output where integers are what is meant.
Two forces drive this package. One is memory: text produces wide, mostly-zero matrices, and the sparse work is the direct answer, landing in the same period that workflows learned to fit and predict on dgCMatrix input. The other is upstream churn — the tweets tokenizer was deprecated because tokenizers deprecated it, the politeness feature disappeared when textfeatures left Suggests. The package's own agenda is consistency; its release timing belongs to its dependencies.
Expect the sparse argument to spread to the remaining column-producing steps, since only four of them have it, and expect more steps to be reworked as recipes' own sparse-data support matures.
tidytext is the package that made unnest_tokens() and the tidy-data approach to text analysis standard, and it has reached the point where its releases contain nothing to announce. The last three are roxygen package anchors, alt text on vignette figures, and a single bug fix in one stm tidier. The most recent substantive changes were in 0.4.0 and 0.3.3 — stm tidiers for high FREX and lift words, a labels function for scale_x_reordered(), and support for tidying STM models that use content covariates.
The direction is stability, and the release triggers are external. quanteda releases force updates to the dfm tidiers, a Matrix release forces another, tokenizers deprecating its tweet tokenizer forces removal of the tweet-specific functions here, and CRAN's Rd anchor requirement produces a release of its own. Nothing in the recent stream suggests new capability is planned, and for a package this embedded in teaching material that is a defensible position rather than a problem.
The entries do not support predicting new features. The likely next release is another compatibility update prompted by quanteda, stm, or a CRAN documentation requirement.
Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either textrecipes or tidytext.
mlr3proba is shedding weight as its survival work moves into sibling packages
mlr3viz keeps the ecosystem's plots working while the plots themselves move out
mlr3tuning is rebuilding its async machinery under a stable public surface
timetk swallowed anomalize whole, then went quiet for two years
modelbased is turning marginal effects into a full contrast grammar
easystats' parameters package absorbs one more model class every few weeks
See all textrecipes alternatives → · See all tidytext alternatives →
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
They serve adjacent needs but don't currently overlap on shipped themes. textrecipes and tidytext are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. textrecipes and tidytext are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.
Top textrecipes alternatives in Analytics are ranked by recent ship velocity. Browse the "textrecipes alternatives" section above for the current picks, or visit /alternatives/textrecipes for the full list with editorial commentary on each.
Top tidytext alternatives in Analytics are ranked by recent ship velocity. Browse the "tidytext alternatives" section above for the current picks, or visit /alternatives/tidytext for the full list with editorial commentary on each.