← Back to home
Comparison · Analytics

icesSAG vs scoringutils

A side-by-side editorial comparison of icesSAG and scoringutils — release velocity, themes, recent moves, and the top alternatives to consider.

icesSAG vs scoringutils: at a glance

FeatureicesSAGscoringutils
SectorAnalyticsAnalytics
Velocity score0.00.0
Sparks · 30d00
Top themesfisheries-science, api-client, ices, data-validationforecast evaluation, probabilistic scoring, multivariate forecasts, s3 classes
Last editorial update43m ago2h ago
WebsiteVisit →Visit →

What is icesSAG?

The ICES stock assessment client took upload away in 2024 and spent two years giving it back.

icesSAG is the R client for the ICES Stock Assessment Graphs database, used by fisheries scientists to retrieve and publish stock assessment summaries and figures. The 1.5.0 release repointed every function at a new API, replaced token authentication with JWT via icesConnect, and dropped file upload entirely. Upload returned in 1.6.2, now routing through icesDatsu to check file format and validate data before submission.

Read the full icesSAG trajectory →

What is scoringutils?

scoringutils pushes forecast scoring past univariate outcomes into multivariate and ordinal ones.

scoringutils evaluates probabilistic forecasts in R. Since the 2.0.0 rewrite it is organised around typed forecast objects — quantile, sample, binary, point, nominal — built by as_forecast_<type>() constructors and scored through S3 methods. Version 2.2.0 adds multivariate sample and point types with the variogram score, and 2.1.0 added ordinal forecasts.

Read the full scoringutils trajectory →

icesSAG vs scoringutils: editorial side-by-side

I
icesSAG
ANALYTICS
0.0

The ICES stock assessment client took upload away in 2024 and spent two years giving it back.

◆ Current state

icesSAG is the R client for the ICES Stock Assessment Graphs database, used by fisheries scientists to retrieve and publish stock assessment summaries and figures. The 1.5.0 release repointed every function at a new API, replaced token authentication with JWT via icesConnect, and dropped file upload entirely. Upload returned in 1.6.2, now routing through icesDatsu to check file format and validate data before submission.

◆ Where it's heading

The package is consolidating onto the shared ices-tools stack rather than carrying its own machinery — authentication moved to icesConnect, validation to icesDatsu, and the icesVocab dependency was dropped once it was no longer needed. Alongside that, redundant graph functions were deprecated and caching was added to reduce load on the server. Releases are infrequent and driven by upstream API changes.

◆ Prediction

Expect the next release to follow whatever the ICES service or the sibling ices-tools packages change next, rather than introducing new analysis capability of its own.

S
scoringutils
ANALYTICS
0.0

scoringutils pushes forecast scoring past univariate outcomes into multivariate and ordinal ones.

◆ Current state

scoringutils evaluates probabilistic forecasts in R. Since the 2.0.0 rewrite it is organised around typed forecast objects — quantile, sample, binary, point, nominal — built by as_forecast_<type>() constructors and scored through S3 methods. Version 2.2.0 adds multivariate sample and point types with the variogram score, and 2.1.0 added ordinal forecasts.

◆ Where it's heading

The forecast-type system introduced in 2.0.0 is the engine of everything since: each release fits another outcome shape into it rather than reworking the scoring interface. Multivariate support is the largest of those additions because it scores the dependence structure between variables, not just marginal accuracy. Type and constructor names are still being reconciled — forecast_sample_multivariate was renamed to forecast_multivariate_sample with a deprecation window.

◆ Prediction

Expect further forecast types and metrics slotted into the same constructor pattern, and the deprecated forecast_sample_multivariate alias and is_forecast_sample_multivariate() to be removed once that window closes.

Alternatives to icesSAG and scoringutils

Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either icesSAG or scoringutils.

See all icesSAG alternatives → · See all scoringutils alternatives →

Recent activity from icesSAG and scoringutils

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 3mo agoicesSAGStock upload restored with pre-submission validation
  2. 4mo agoscoringutilsMultivariate forecast scoring and the variogram score
  3. 11mo agoscoringutilsQuantile levels rounded to avoid float duplicates
  4. 1y agoscoringutilsOptional p-values in pairwise comparisons; PIT fix
  5. 1y agoscoringutilsOrdinal forecasts get their own class and metrics
  6. 1y agoscoringutilsRewrite: typed forecast objects and pluggable metrics
  7. 1y agoicesSAGEvery function repointed at a new API, with JWT auth
  8. 2y agoscoringutilsTwo bug fixes and package-site infrastructure
  9. 6y agoicesSAGlocal release 1.3-5

Frequently asked questions

What is the difference between icesSAG and scoringutils?

They serve adjacent needs but don't currently overlap on shipped themes. icesSAG and scoringutils are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is icesSAG better than scoringutils?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. icesSAG and scoringutils are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.

What are the best alternatives to icesSAG?

Top icesSAG alternatives in Analytics are ranked by recent ship velocity. Browse the "icesSAG alternatives" section above for the current picks, or visit /alternatives/icessag for the full list with editorial commentary on each.

What are the best alternatives to scoringutils?

Top scoringutils alternatives in Analytics are ranked by recent ship velocity. Browse the "scoringutils alternatives" section above for the current picks, or visit /alternatives/scoringutils for the full list with editorial commentary on each.