silx vs textrecipes

textrecipes supplies the recipes steps for turning text into model-ready columns: tokenizing, hashing, term frequency, TF-IDF, and word embeddings. Version 1.1.0 added a sparse argument to step_dummy_hash(), step_texthash(), step_tf() and step_tfidf() so they emit sparse vectors. The releases before it are a long consistency pass — keep_original_cols on every step that creates columns, informative errors on name collisions, tunable arguments documented, integer rather than double output where integers are what is meant.

Two forces drive this package. One is memory: text produces wide, mostly-zero matrices, and the sparse work is the direct answer, landing in the same period that workflows learned to fit and predict on dgCMatrix input. The other is upstream churn — the tweets tokenizer was deprecated because tokenizers deprecated it, the politeness feature disappeared when textfeatures left Suggests. The package's own agenda is consistency; its release timing belongs to its dependencies.

Expect the sparse argument to spread to the remaining column-producing steps, since only four of them have it, and expect more steps to be reworked as recipes' own sparse-data support matures.