PurpleAir
The R client for PurpleAir sensors keeps finding its time-averaging was wrong.
Comparison · Analytics
quanteda vs vecvec
A side-by-side editorial comparison of quanteda and vecvec — release velocity, themes, recent moves, and the top alternatives to consider.
Shared themes:r-packageperformance
quanteda vs vecvec: at a glance
What is quanteda?
Text analysis in R keeps optimising its token internals — and builds a path out to torch
quanteda is a mature framework for quantitative text analysis in R. Since the 4.0 rewrite around external-pointer tokens objects, releases have concentrated on the internals: recompilation control, memory reduction on concatenation, type-table consistency between tokens and dfm objects. The newest release adds tokens_recompile() for explicit ID reassignment, stops query functions from recompiling implicitly, and returns dense rather than sparse tensors from as.tensor() with arguments passed through to torch.
What is vecvec?
A vector-of-vectors class swapped its object system mid-flight and came out faster.
vecvec provides an R class that holds multiple vectors as a single logical vector without copying them together, aimed at cases where concatenating would be wasteful. The 1.0.0 rewrite moved the class off vctrs onto S7 while keeping user-facing code working, and added matrix and array behaviour. Recent releases have concentrated on the details that decide whether the abstraction actually saves work: ALTREP vectors surviving intact, subassignment edge cases, and printing that does not materialise what it is describing.
quanteda vs vecvec: editorial side-by-side
quanteda
2.5ANALYTICS
Text analysis in R keeps optimising its token internals — and builds a path out to torch
◆ Current state
quanteda is a mature framework for quantitative text analysis in R. Since the 4.0 rewrite around external-pointer tokens objects, releases have concentrated on the internals: recompilation control, memory reduction on concatenation, type-table consistency between tokens and dfm objects. The newest release adds tokens_recompile() for explicit ID reassignment, stops query functions from recompiling implicitly, and returns dense rather than sparse tensors from as.tensor() with arguments passed through to torch.
◆ Where it's heading
Two threads run in parallel. The dominant one is performance and correctness housekeeping on the tokens_xptr representation introduced in 4.0 — each release closes another case where the external-pointer path diverged from the plain tokens path. The quieter thread points outward: as.matrix() returning a document-by-position integer matrix and as.tensor() handing off to torch::torch_tensor() make the tokenised corpus directly consumable by neural models rather than only by quanteda's own bag-of-words machinery.
◆ Prediction
The tensor and matrix export path is the least mature part of the surface and gained arguments in this release rather than settling, so expect further work there before the token internals change again.
vecvec
0.0ANALYTICS
A vector-of-vectors class swapped its object system mid-flight and came out faster.
◆ Current state
vecvec provides an R class that holds multiple vectors as a single logical vector without copying them together, aimed at cases where concatenating would be wasteful. The 1.0.0 rewrite moved the class off vctrs onto S7 while keeping user-facing code working, and added matrix and array behaviour. Recent releases have concentrated on the details that decide whether the abstraction actually saves work: ALTREP vectors surviving intact, subassignment edge cases, and printing that does not materialise what it is describing.
◆ Where it's heading
The arc runs from proving the idea to making it cheap. Early releases established constructors and vctrs dispatch; 1.0.0 rebuilt the internals on S7 with a smaller, faster representation and automatic flattening of adjacent compatible vectors; the two releases since have been about not defeating the point — an ALTREP vector flattened on construction or materialised by a print method gives back exactly the memory the class exists to save. Extensibility is the other visible thread, with custom ptype2 and cast methods now registrable and extension packages expected to subclass class_vecvec. The internal index structure is explicitly reserved for future change, so faster special-case representations look planned rather than incidental.
◆ Prediction
The reserved internal structure and the stated intent to accommodate faster variants point at specialised representations for particular vector types next; the entries do not indicate which cases are queued first.
Alternatives to quanteda and vecvec
Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either quanteda or vecvec.
piecepackr
A board game graphics package runs one of the most disciplined deprecation cycles in R.
e2tree
The explainable-ensemble-tree package now measures whether its own explanations are faithful.
discretefdr
The discrete-data FDR package is being pared into one piece of a larger multiple-testing suite.
contentanalysis
A scientific-text analysis package moved from counting citations to classifying argument structure.
relialearnr
The teaching arm of an R reliability suite keeps pace with whatever its analysis siblings ship.
See all quanteda alternatives → · See all vecvec alternatives →
Recent activity from quanteda and vecvec
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 12d agoquantedaExplicit token recompilation and a denser path out to torch
- 1mo agovecvecExtension packages can register their own ptype and cast methods
- 1mo agovecvecALTREP vectors survive construction and printing intact
- 3mo agovecvecThe class is rebuilt on S7, with a new internal representation ⚡
- 4mo agovecvecMissing value handling fixed for is.na()
- 11mo agovecvecArithmetic and per-vector apply arrive
- 11mo agovecvecFirst release: constructors and vctrs dispatch
- 1y agoquantedaCorpus chunking and cheaper token concatenation
- 1y agoquantedaFaster concatenation and a dfm_lookup naming fix
- 2y agoquantedaMinor test and documentation fixes
- 2y agoquantedaPlatform-specific test and installation fixes
- 2y agoquantedaCRAN v4.0 ⚡
Frequently asked questions
What is the difference between quanteda and vecvec?
Both compete on the same themes — r-package, performance — within Analytics. quanteda is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is quanteda better than vecvec?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. quanteda is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.
What are the best alternatives to quanteda?
Top quanteda alternatives in Analytics are ranked by recent ship velocity. Browse the "quanteda alternatives" section above for the current picks, or visit /alternatives/quanteda for the full list with editorial commentary on each.
What are the best alternatives to vecvec?
Top vecvec alternatives in Analytics are ranked by recent ship velocity. Browse the "vecvec alternatives" section above for the current picks, or visit /alternatives/vecvec for the full list with editorial commentary on each.