← Back to home
Comparison · Infra & APIs

CBTF vs SLmetrics

A side-by-side editorial comparison of CBTF and SLmetrics — release velocity, themes, recent moves, and the top alternatives to consider.

Shared themes:r-package

CBTF vs SLmetrics: at a glance

FeatureCBTFSLmetrics
SectorInfra & APIsInfra & APIs
Velocity score0.00.0
Sparks · 30d00
Top themestesting, fuzzing, r-package, developer-toolsmachine-learning, model-evaluation, performance, cpp-backend
Last editorial update1h ago2d ago
WebsiteVisit →Visit →

What is CBTF?

A fuzzer for R packages that grew from one argument at a time to parallel runs across whole namespaces.

CBTF throws deliberately problematic inputs at exported functions and reports which ones error, warn, or survive. It now covers 85 input classes, fuzzes multiple named arguments per call, runs in parallel with a per-function timeout, and reports results as a classed object with print, summary, length, and whitelist methods for pruning false positives. Output control has been refined repeatedly — the latest release adds grouping by input or by function and a summary-only mode.

Read the full CBTF trajectory →

What is SLmetrics?

A young ML metrics package rewrote its own backend twice in six months chasing speed.

SLmetrics provides supervised learning evaluation metrics for R — confusion matrices, classification and regression measures, ROC and precision-recall curves — with the computation pushed into C++. After a series of pre-releases it now runs on an Armadillo backend, supports OpenMP parallelism and LAPACK/BLAS, and reports 5-20x speedups over its earlier implementations. The API has been reshaped for extensibility, with an estimator argument replacing the fixed aggregation options.

Read the full SLmetrics trajectory →

CBTF vs SLmetrics: editorial side-by-side

C
CBTF
INFRA · APIS
0.0

A fuzzer for R packages that grew from one argument at a time to parallel runs across whole namespaces.

◆ Current state

CBTF throws deliberately problematic inputs at exported functions and reports which ones error, warn, or survive. It now covers 85 input classes, fuzzes multiple named arguments per call, runs in parallel with a per-function timeout, and reports results as a classed object with print, summary, length, and whitelist methods for pruning false positives. Output control has been refined repeatedly — the latest release adds grouping by input or by function and a summary-only mode.

◆ Where it's heading

The package has moved from a script-shaped tool to a test-suite component. The single-argument, sequential fuzz() of the early releases could not finish a large namespace or survive a function that simply hangs; the mirai rewrite fixed both, and multi-argument support widened what a run can actually reach. Nearly everything since has gone into making results triageable rather than merely produced: whitelisting, result classes, grouping, and terminal output that fits real function signatures. Note that the 0.1.0 through 0.3.0 entries carry backfilled timestamps recorded in reverse order within under a minute, so their published dates do not reflect release order.

◆ Prediction

The steady expansion of the input catalogue from 70 to 85 with a new time class suggests more input classes are the cheapest next win; the reporting surface is now detailed enough that machine-readable output for CI would be the natural follow-on.

S
SLmetrics
INFRA · APIS
0.0

A young ML metrics package rewrote its own backend twice in six months chasing speed.

◆ Current state

SLmetrics provides supervised learning evaluation metrics for R — confusion matrices, classification and regression measures, ROC and precision-recall curves — with the computation pushed into C++. After a series of pre-releases it now runs on an Armadillo backend, supports OpenMP parallelism and LAPACK/BLAS, and reports 5-20x speedups over its earlier implementations. The API has been reshaped for extensibility, with an estimator argument replacing the fixed aggregation options.

◆ Where it's heading

Every release in this timeline is about making the same metrics compute faster or compose better. The backend moved from Rcpp to plain C++, gained OpenMP, then was ported wholesale from Eigen to Armadillo with heavy templating. In parallel the author has been widening the API's joints: generic S3 signatures, an extensible estimator argument, and function signatures loose enough that wrapping packages can rename arguments. Bundled datasets and embedded formulas in the docs point at teaching and benchmarking use. The package still labels itself pre-release, which is consistent with how freely it has broken argument names along the way.

◆ Prediction

A stable non-pre-release version is the natural next step now that the backend has settled on Armadillo, though the repeated willingness to rename arguments suggests more API churn may come first.

Alternatives to CBTF and SLmetrics

Other Infra & APIs products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either CBTF or SLmetrics.

See all CBTF alternatives → · See all SLmetrics alternatives →

Recent activity from CBTF and SLmetrics

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 1mo agoCBTFTime inputs added; results groupable by input or function
  2. 6mo agoCBTFParallel fuzzing with timeouts, and multi-argument support
  3. 0y agoCBTFWhitelisting for false positives, plus clearer result semantics
  4. 1y agoCBTFFunction discovery skips unfuzzable functions; failures no longer crash
  5. 1y agoCBTFFirst release; notes carry only a website link
  6. 1y agoCBTFRaw results returned as an object with summary and print methods
  7. 1y agoSLmetricsArmadillo backend brings 5-20x speedups and an extensible metrics API
  8. 1y agoSLmetricsConsistent S3 signatures and three bundled datasets
  9. 1y agoSLmetricsRegression metrics 2-10x faster with reworked OpenMP controls
  10. 1y agoSLmetricsOpenMP parallelism and a soft-label entropy family
  11. 1y agoSLmetricsCross-entropy loss and relative RMSE with three normalisations
  12. 1y agoSLmetricsSample weights flow through the confusion matrix

Frequently asked questions

What is the difference between CBTF and SLmetrics?

Both compete on the same themes — r-package — within Infra & APIs. CBTF and SLmetrics are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is CBTF better than SLmetrics?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. CBTF and SLmetrics are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). For your specific use case, the alternatives sections above list other Infra & APIs products to evaluate alongside.

What are the best alternatives to CBTF?

Top CBTF alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "CBTF alternatives" section above for the current picks, or visit /alternatives/caught-by-the-fuzz for the full list with editorial commentary on each.

What are the best alternatives to SLmetrics?

Top SLmetrics alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "SLmetrics alternatives" section above for the current picks, or visit /alternatives/slmetrics for the full list with editorial commentary on each.