tidytext
Finished, widely taught, and shipping roxygen fixes.
Comparison · Analytics
Countly vs mlr3measures
A side-by-side editorial comparison of Countly and mlr3measures — release velocity, themes, recent moves, and the top alternatives to consider.
Countly vs mlr3measures: at a glance
What is Countly?
Countly's LTS line is spending its releases on hardening the surfaces customers extend.
The 25.03 LTS and 24.05 branches are moving together, and the recent content is dominated by security and scoping work rather than features. The latest LTS rebuilds the api and frontend Docker images as multi-stage builds on Debian 13 with Node 24 so compilers and build tooling no longer ship, overrides fourteen vulnerable transitive dependencies, and replaces the unmaintained v8-sandbox behind custom code with isolated-vm. Earlier releases scoped internal event hooks to their own apps, fixed the consents table returning fields beyond the consent columns, and stopped dashboard widgets being copied by users without access to the referenced apps.
What is mlr3measures?
mlr3measures is systematically retrofitting sample weights across every metric
mlr3measures is the metric library behind mlr3. Recent releases follow two threads: adding measures — linex, pinball, Mu AUC, gmean, gpr, mcc — and retrofitting sample_weights support across the existing ones, reaching AUC and the confusion-matrix family in 1.3.0. Along the way 1.1.0 deprecated four regression measures and corrected the bias definitions.
Countly vs mlr3measures: editorial side-by-side
Countly
5.0ANALYTICS
Countly's LTS line is spending its releases on hardening the surfaces customers extend.
◆ Current state
The 25.03 LTS and 24.05 branches are moving together, and the recent content is dominated by security and scoping work rather than features. The latest LTS rebuilds the api and frontend Docker images as multi-stage builds on Debian 13 with Node 24 so compilers and build tooling no longer ship, overrides fourteen vulnerable transitive dependencies, and replaces the unmaintained v8-sandbox behind custom code with isolated-vm. Earlier releases scoped internal event hooks to their own apps, fixed the consents table returning fields beyond the consent columns, and stopped dashboard widgets being copied by users without access to the referenced apps.
◆ Where it's heading
The pattern across these releases is closing the gaps where a customer-supplied artefact — custom hook code, a copied widget, a projection on a request — could reach further than intended. That work is now touching the runtime itself, and the isolated-vm swap is a breaking change: custom code relying on setTimeout, setInterval or async completion fails with a logged error instead of running. The journey engine is the only place shipping genuinely new capability, and it is enterprise-only.
◆ Prediction
Expect follow-up releases to soften the custom-code migration, since the isolated-vm switch silently breaks any hook that awaited a timer, and further ab-testing work now that pystan has been replaced with compiled Stan executables.
mlr3measures
0.0ANALYTICS
mlr3measures is systematically retrofitting sample weights across every metric
◆ Current state
mlr3measures is the metric library behind mlr3. Recent releases follow two threads: adding measures — linex, pinball, Mu AUC, gmean, gpr, mcc — and retrofitting sample_weights support across the existing ones, reaching AUC and the confusion-matrix family in 1.3.0. Along the way 1.1.0 deprecated four regression measures and corrected the bias definitions.
◆ Where it's heading
The library is maturing rather than growing: weighted evaluation and observation-wise loss functions are being brought to metrics that already existed, which is what downstream weighted-resampling and per-observation analysis need. The deprecations suggest the maintainers are willing to remove measures they consider ill-defined rather than keep them for compatibility.
◆ Prediction
Expect sample_weights and observation-wise variants to reach the remaining measures that lack them.
Alternatives to Countly and mlr3measures
Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either Countly or mlr3measures.
textrecipes
Text features finally stay sparse all the way to the model.
probably
The package that made calibration a step instead of an afterthought.
workflowsets
workflowsets keeps widening what counts as a model worth comparing.
workflows
The tidymodels pipeline grew a third stage, and it happens after the model runs.
vetiver
Posit's MLOps package went quiet for two years, then came back to keep up with recipes.
See all Countly alternatives → · See all mlr3measures alternatives →
Recent activity from Countly and mlr3measures
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 1d agoCountlyCustom-code sandbox swapped to isolated-vm; images rebuilt on Node 24
- 10d agoCountlyFixes for event keys containing special characters
- 10d agoCountlyJourney deeplinks take dynamic parameters; hooks validated on save
- 20d agoCountlyStar-rating logo path and data-manager transformation fixes
- 22d agoCountlyLTS backport: data-manager transformation fix
- 1mo agoCountlyJourneys survive user merges; SDK-provided asset paths
- 3mo agomlr3measuresWeighted AUC and weighted confusion-matrix measures
- 8mo agomlr3measuresObservation-wise loss for bbrier and logloss
- 11mo agomlr3measuresrse, rsq, rrse and rae deprecated; bias measures corrected
- 1y agomlr3measureslinex, pinball and Mu AUC measures added
- 2y agomlr3measuresgmean, gpr and multiclass MCC added
- 4y agomlr3measuresObservation-wise loss functions introduced
Frequently asked questions
What is the difference between Countly and mlr3measures?
They serve adjacent needs but don't currently overlap on shipped themes. Countly is currently shipping more aggressively (velocity 5.0 vs 0.0), with 0 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is Countly better than mlr3measures?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. Countly is currently shipping more aggressively (velocity 5.0 vs 0.0), with 0 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.
What are the best alternatives to Countly?
Top Countly alternatives in Analytics are ranked by recent ship velocity. Browse the "Countly alternatives" section above for the current picks, or visit /alternatives/countly for the full list with editorial commentary on each.
What are the best alternatives to mlr3measures?
Top mlr3measures alternatives in Analytics are ranked by recent ship velocity. Browse the "mlr3measures alternatives" section above for the current picks, or visit /alternatives/mlr3measures for the full list with editorial commentary on each.