← Back to home
Comparison · Infra & APIs

cvms vs profoc

A side-by-side editorial comparison of cvms and profoc — release velocity, themes, recent moves, and the top alternatives to consider.

Shared themes:r-package

cvms vs profoc: at a glance

Featurecvmsprofoc
SectorInfra & APIsInfra & APIs
Velocity score0.00.0
Sparks · 30d00
Top themescross-validation, r-package, model-evaluation, visualizationforecasting, online-learning, r-package, rcpp
Last editorial update59m ago52m ago
WebsiteVisit →Visit →

What is cvms?

A cross-validation package whose real development has moved to its plotting function

cvms runs repeated cross-validation over model formulas and reports comparable metrics. The 2.0.0 release was a breaking correctness fix: every function accepting fold_cols mismatched training and testing data when fold indices were non-sequential, did not start at 1, or were strings, because the iteration index was compared against the raw fold value rather than its factor level index. 2.0.1 restored coefficient extraction for nnet::multinom and mixed models by supplying an environment containing the training data, and followed lme4's move of findbars() into the reformulas package.

Read the full cvms trajectory →

What is profoc?

A forecast combination package that spun its profiler out into its own project

profoc combines probabilistic forecasts online, using the Bernstein online aggregation family with B-spline smoothing over quantiles and time. The recent releases are infrastructure rather than method: 1.3.4 removed a using namespace arma directive for CRAN compliance and closed a timer edge case, 1.3.3 adjusted the integration with rcpptimer against its now-stable 1.2.0 API. The last release to change what users can do was 1.3.0, which exposed the conline C++ class to R and exported init_experts_list(), make_basis_mats(), make_hat_mats() and post_process_model() so the engine can be driven directly.

Read the full profoc trajectory →

cvms vs profoc: editorial side-by-side

C
cvms
INFRA · APIS
0.0

A cross-validation package whose real development has moved to its plotting function

◆ Current state

cvms runs repeated cross-validation over model formulas and reports comparable metrics. The 2.0.0 release was a breaking correctness fix: every function accepting fold_cols mismatched training and testing data when fold indices were non-sequential, did not start at 1, or were strings, because the iteration index was compared against the raw fold value rather than its factor level index. 2.0.1 restored coefficient extraction for nnet::multinom and mixed models by supplying an environment containing the training data, and followed lme4's move of findbars() into the reformulas package.

◆ Where it's heading

Two threads run in parallel and only one is about cross-validation. The plotting function plot_confusion_matrix() has absorbed most feature work since 1.5.0 - custom gradient palettes, intensity limits, per-tile settings, dynamic font colors keyed to value thresholds, and arguments that accept functions rather than constants - to the point where a companion web application exists for using it without code. The cross-validation core, by contrast, sees maintenance: upstream compatibility fixes for pROC, ggnewscale and ggplot2, and the fold-matching correction that finally forced a major version.

◆ Prediction

Expect continued option growth in the confusion matrix plotting surface, since that is where nearly every release since 1.5.0 has spent its changes, with core cross-validation changes arriving only as upstream packages force them.

P
profoc
INFRA · APIS
0.0

A forecast combination package that spun its profiler out into its own project

◆ Current state

profoc combines probabilistic forecasts online, using the Bernstein online aggregation family with B-spline smoothing over quantiles and time. The recent releases are infrastructure rather than method: 1.3.4 removed a using namespace arma directive for CRAN compliance and closed a timer edge case, 1.3.3 adjusted the integration with rcpptimer against its now-stable 1.2.0 API. The last release to change what users can do was 1.3.0, which exposed the conline C++ class to R and exported init_experts_list(), make_basis_mats(), make_hat_mats() and post_process_model() so the engine can be driven directly.

◆ Where it's heading

The direction is toward a reusable C++ core with thin language bindings. The timing code that lived inside profoc was extracted into the standalone rcpptimer package in 1.3.2, deliberately so other R packages and Python projects could use it through cpptimer and cppytimer, and the clock header was reworked in 1.3.1 to maximise the code shared between the R and Python versions. Method work sits earlier in the history - periodic splines and penalties in 1.2.0, the penalty() function in 1.1.0 - while the recent cadence, a single release in the last sixteen months, points at a package the maintainer considers finished.

◆ Prediction

The repeated references to future Python use suggest the next significant work happens outside this package, in the shared C++ components, rather than in profoc's R surface.

Alternatives to cvms and profoc

Other Infra & APIs products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either cvms or profoc.

See all cvms alternatives → · See all profoc alternatives →

Recent activity from cvms and profoc

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 2mo agocvmsCoefficient extraction restored for multinom and mixed models
  2. 6mo agoprofocCRAN compliance fix removing a namespace directive
  3. 9mo agocvmsBreaking fix for mismatched folds with non-sequential fold IDs
  4. 11mo agocvmsTest compatibility with pROC 1.19 and a deprecation warning fix
  5. 1y agocvmsConfusion matrix fonts and colors can now be computed from the values
  6. 1y agocvmsTile intensity by row or column percentages
  7. 1y agocvmsMultinom coefficient extraction fix after a parameters update
  8. 1y agoprofocTimer integration updated to the stable rcpptimer API
  9. 2y agoprofocTiming code extracted into the standalone rcpptimer package
  10. 2y agoprofocInteger overflow fix and Welford timing statistics
  11. 2y agoprofocThe conline C++ class opens up to R users
  12. 2y agoprofocQuantile crossing flagged and tidy methods added

Frequently asked questions

What is the difference between cvms and profoc?

Both compete on the same themes — r-package — within Infra & APIs. cvms and profoc are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is cvms better than profoc?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. cvms and profoc are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). For your specific use case, the alternatives sections above list other Infra & APIs products to evaluate alongside.

What are the best alternatives to cvms?

Top cvms alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "cvms alternatives" section above for the current picks, or visit /alternatives/cvms for the full list with editorial commentary on each.

What are the best alternatives to profoc?

Top profoc alternatives in Infra & APIs are ranked by recent ship velocity. Browse the "profoc alternatives" section above for the current picks, or visit /alternatives/profoc for the full list with editorial commentary on each.