← Back to home
Comparison · Analytics

bbotk vs Countly

A side-by-side editorial comparison of bbotk and Countly — release velocity, themes, recent moves, and the top alternatives to consider.

bbotk vs Countly: at a glance

FeaturebbotkCountly
SectorAnalyticsAnalytics
Velocity score2.55.0
Sparks · 30d00
Top themesblack-box optimization, mlr3, async execution, api deprecationproduct-analytics, self-hosted, security-hardening, sandboxing
Last editorial update59m ago9h ago
WebsiteVisit →Visit →

What is bbotk?

bbotk is generalizing from an optimizer toolkit into an evaluation framework.

bbotk is the black-box optimization backend behind mlr3 tuning: search spaces, terminators, archives, and an async layer built on rush. Recent releases pair steady async-API buildout with removal of the deprecated arguments that preceded it. The 1.9.0 release introduced EvalInstance as a base class for OptimInstance, separating evaluating an objective from optimizing one.

Read the full bbotk trajectory →

What is Countly?

Countly's LTS line is spending its releases on hardening the surfaces customers extend.

The 25.03 LTS and 24.05 branches are moving together, and the recent content is dominated by security and scoping work rather than features. The latest LTS rebuilds the api and frontend Docker images as multi-stage builds on Debian 13 with Node 24 so compilers and build tooling no longer ship, overrides fourteen vulnerable transitive dependencies, and replaces the unmaintained v8-sandbox behind custom code with isolated-vm. Earlier releases scoped internal event hooks to their own apps, fixed the consents table returning fields beyond the consent columns, and stopped dashboard widgets being copied by users without access to the referenced apps.

Read the full Countly trajectory →

bbotk vs Countly: editorial side-by-side

B
bbotk
ANALYTICS
2.5

bbotk is generalizing from an optimizer toolkit into an evaluation framework.

◆ Current state

bbotk is the black-box optimization backend behind mlr3 tuning: search spaces, terminators, archives, and an async layer built on rush. Recent releases pair steady async-API buildout with removal of the deprecated arguments that preceded it. The 1.9.0 release introduced EvalInstance as a base class for OptimInstance, separating evaluating an objective from optimizing one.

◆ Where it's heading

Two threads run through the visible history. The first is async optimization maturing: ArchiveAsync gained a full push/finish/fail vocabulary over rush tasks in 1.11.0, and 1.12.0 deleted the deprecated extra arguments it replaced. The second is dependency consolidation, with custom C hypervolume code handed to moocore and rush pinned to 1.0.0, trimming maintenance surface as the async path becomes the default.

◆ Prediction

The deprecation removals in 1.12.0 suggest the async archive API is now treated as settled; the next releases most likely build on EvalInstance rather than continuing to churn ArchiveAsync.

C
Countly
ANALYTICS
5.0

Countly's LTS line is spending its releases on hardening the surfaces customers extend.

◆ Current state

The 25.03 LTS and 24.05 branches are moving together, and the recent content is dominated by security and scoping work rather than features. The latest LTS rebuilds the api and frontend Docker images as multi-stage builds on Debian 13 with Node 24 so compilers and build tooling no longer ship, overrides fourteen vulnerable transitive dependencies, and replaces the unmaintained v8-sandbox behind custom code with isolated-vm. Earlier releases scoped internal event hooks to their own apps, fixed the consents table returning fields beyond the consent columns, and stopped dashboard widgets being copied by users without access to the referenced apps.

◆ Where it's heading

The pattern across these releases is closing the gaps where a customer-supplied artefact — custom hook code, a copied widget, a projection on a request — could reach further than intended. That work is now touching the runtime itself, and the isolated-vm swap is a breaking change: custom code relying on setTimeout, setInterval or async completion fails with a logged error instead of running. The journey engine is the only place shipping genuinely new capability, and it is enterprise-only.

◆ Prediction

Expect follow-up releases to soften the custom-code migration, since the isolated-vm switch silently breaks any hook that awaited a timer, and further ab-testing work now that pystan has been replaced with compiled Stan executables.

Alternatives to bbotk and Countly

Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either bbotk or Countly.

See all bbotk alternatives → · See all Countly alternatives →

Recent activity from bbotk and Countly

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 1d agoCountlyCustom-code sandbox swapped to isolated-vm; images rebuilt on Node 24
  2. 10d agoCountlyFixes for event keys containing special characters
  3. 10d agoCountlyJourney deeplinks take dynamic parameters; hooks validated on save
  4. 20d agoCountlyStar-rating logo path and data-manager transformation fixes
  5. 21d agoCountlyLTS backport: data-manager transformation fix
  6. 24d agobbotkDeprecated extra argument removed from ArchiveAsync methods
  7. 1mo agoCountlyJourneys survive user merges; SDK-provided asset paths
  8. 1mo agobbotkArchiveAsync gains full push/finish/fail task API over rush
  9. 2mo agobbotkDominance and hypervolume computation moved to moocore
  10. 4mo agobbotkmlr_test_functions adds standard optimization benchmarks
  11. 5mo agobbotkEvalInstance base class separates evaluation from optimization
  12. 8mo agobbotkFix: conditions now work with OptimizerLocalSearch

Frequently asked questions

What is the difference between bbotk and Countly?

They serve adjacent needs but don't currently overlap on shipped themes. Countly is currently shipping more aggressively (velocity 5.0 vs 2.5), with 0 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is bbotk better than Countly?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. Countly is currently shipping more aggressively (velocity 5.0 vs 2.5), with 0 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.

What are the best alternatives to bbotk?

Top bbotk alternatives in Analytics are ranked by recent ship velocity. Browse the "bbotk alternatives" section above for the current picks, or visit /alternatives/bbotk for the full list with editorial commentary on each.

What are the best alternatives to Countly?

Top Countly alternatives in Analytics are ranked by recent ship velocity. Browse the "Countly alternatives" section above for the current picks, or visit /alternatives/countly for the full list with editorial commentary on each.