← Back to home
Comparison · Analytics

DoseFinding vs pysparklyr

A side-by-side editorial comparison of DoseFinding and pysparklyr — release velocity, themes, recent moves, and the top alternatives to consider.

DoseFinding vs pysparklyr: at a glance

FeatureDoseFindingpysparklyr
SectorAnalyticsAnalytics
Velocity score0.03.8
Sparks · 30d01
Top themesdose-response, mcp-mod, clinical-trials, model-averagingspark, databricks, snowflake, tidymodels
Last editorial update44m ago2h ago
WebsiteVisit →Visit →

What is DoseFinding?

New stewardship at openpharma, then two releases adding the methods MCP-Mod was missing

DoseFinding implements MCP-Mod and related dose-response methodology for clinical trial design and analysis. In 2024 it changed hands — Marius Thomas took over as maintainer, Novartis was recorded as copyright holder and funder, and the package moved to the openpharma GitHub organisation with roxygen documentation and a proper NEWS file. The two releases since have added substantive methodology: model averaging for dose-response fitting in 1.3-1, and conditional and predictive power for interim analyses in 1.4-1.

Read the full DoseFinding trajectory →

What is pysparklyr?

Posit's Spark Connect bridge keeps adding backends — and now runs tidymodels tuning on the cluster.

pysparklyr is the Python-backed backend that lets sparklyr talk to Spark Connect, Databricks Connect, and now Snowflake, handling the reticulate environment, authentication, and Arrow configuration so R users mostly do not have to. The 0.2.x line has widened it well past a connectivity shim: 0.2.0 brought the Spark 4.0 ML function family and Snowpark Connect, and 0.2.2 added tune_grid_spark() so a tidymodels tuning grid executes inside a Spark Connect cluster. Authentication has become a first-class concern, with Snowflake's native authenticators, connections.toml discovery, and Posit Connect viewer credentials all supported.

Read the full pysparklyr trajectory →

DoseFinding vs pysparklyr: editorial side-by-side

D
DoseFinding
ANALYTICS
0.0

New stewardship at openpharma, then two releases adding the methods MCP-Mod was missing

◆ Current state

DoseFinding implements MCP-Mod and related dose-response methodology for clinical trial design and analysis. In 2024 it changed hands — Marius Thomas took over as maintainer, Novartis was recorded as copyright holder and funder, and the package moved to the openpharma GitHub organisation with roxygen documentation and a proper NEWS file. The two releases since have added substantive methodology: model averaging for dose-response fitting in 1.3-1, and conditional and predictive power for interim analyses in 1.4-1.

◆ Where it's heading

The pattern before the handover was maintenance — R-devel compliance, a bug fix, a link. After it, each release carries a named methodological addition with an acknowledged contributor, plus documentation to match: a longitudinal analysis vignette shipped alongside the interim power work. Housekeeping continues underneath, mostly clearing deprecated ggplot2 interfaces, aes_string in one release and qplot in the next.

◆ Prediction

Given the last two releases each added one method with a supporting vignette, expect the next to follow the same shape. Both additions so far extend the package beyond fixed dose-response fitting, so adaptive and interim methodology is the more likely direction.

P
pysparklyr
ANALYTICS
3.8

Posit's Spark Connect bridge keeps adding backends — and now runs tidymodels tuning on the cluster.

◆ Current state

pysparklyr is the Python-backed backend that lets sparklyr talk to Spark Connect, Databricks Connect, and now Snowflake, handling the reticulate environment, authentication, and Arrow configuration so R users mostly do not have to. The 0.2.x line has widened it well past a connectivity shim: 0.2.0 brought the Spark 4.0 ML function family and Snowpark Connect, and 0.2.2 added tune_grid_spark() so a tidymodels tuning grid executes inside a Spark Connect cluster. Authentication has become a first-class concern, with Snowflake's native authenticators, connections.toml discovery, and Posit Connect viewer credentials all supported.

◆ Where it's heading

Two directions are running at once. Horizontally, the package is becoming backend-plural — what started as Databricks-and-Spark now covers Snowflake through Snowpark Connect, with credential handling generalized per platform rather than special-cased. Vertically, it is climbing from data manipulation toward modeling: distributed ML functions in 0.2.0, distributed tuning in 0.2.2. A persistent third thread is absorbing upstream churn — Pandas 3.0 conversion, sparklyr 1.9.5 and dbplyr 2.6.0 restructuring the tbl source slot, reticulate's changing environment management.

◆ Prediction

With tuning distributed and the Spark 4.0 ML surface in place, the unfinished edge is the rest of the tidymodels workflow — expect fitting and resampling paths to follow tune_grid_spark() onto the cluster.

Alternatives to DoseFinding and pysparklyr

Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either DoseFinding or pysparklyr.

See all DoseFinding alternatives → · See all pysparklyr alternatives →

Recent activity from DoseFinding and pysparklyr

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 28d agopysparklyrtune_grid_spark() runs tidymodels tuning on Spark Connect
  2. 6mo agopysparklyrSpark 4.0 ML functions and Snowpark Connect support
  3. 10mo agopysparklyrDelta writes and a more flexible Python environment picker
  4. 1y agoDoseFindingConditional and predictive power for interim analyses
  5. 1y agopysparklyrrpy2 install deferred to first spark_apply() call
  6. 1y agopysparklyrDatabricks serverless compute and SDK-deferred authentication
  7. 1y agoDoseFindingModel averaging arrives for dose-response fitting
  8. 1y agopysparklyrPositron IDE detection and connection-pane fixes
  9. 1y agoDoseFindingPackage moves to openpharma under new maintainership
  10. 2y agoDoseFindingCompliance update for R-devel
  11. 3y agoDoseFindingpowMCTBinCount bug fix

Frequently asked questions

What is the difference between DoseFinding and pysparklyr?

They serve adjacent needs but don't currently overlap on shipped themes. pysparklyr is currently shipping more aggressively (velocity 3.8 vs 0.0), with 1 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is DoseFinding better than pysparklyr?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. pysparklyr is currently shipping more aggressively (velocity 3.8 vs 0.0), with 1 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.

What are the best alternatives to DoseFinding?

Top DoseFinding alternatives in Analytics are ranked by recent ship velocity. Browse the "DoseFinding alternatives" section above for the current picks, or visit /alternatives/dosefinding for the full list with editorial commentary on each.

What are the best alternatives to pysparklyr?

Top pysparklyr alternatives in Analytics are ranked by recent ship velocity. Browse the "pysparklyr alternatives" section above for the current picks, or visit /alternatives/pysparklyr for the full list with editorial commentary on each.