← Back to home
Comparison · DevOps

distributed vs jwst

A side-by-side editorial comparison of distributed and jwst — release velocity, themes, recent moves, and the top alternatives to consider.

Shared themes:breaking-changes

distributed vs jwst: at a glance

Featuredistributedjwst
SectorDevOpsDevOps
Velocity score5.03.8
Sparks · 30d01
Top themesdistributed-computing, deprecations, breaking-changes, maintenanceastronomy, calibration-pipeline, jwst, spectroscopy
Last editorial update1h ago3h ago
WebsiteVisit →Visit →

What is distributed?

Dask's scheduler spent the year deleting deprecated API, not adding surface.

distributed is cutting frequent tags with little in them. The substantive release in the window is 2026.6.0, which removed deprecations across the scheduler, worker, nanny, CLI, security and deploy modules in roughly twenty separate cleanups and moved CI to pixi. 2026.7.0 follows with a breaking scatter change and a scheduler_info() default change; the two most recent tags are a backport and an empty release with no changes at all.

Read the full distributed trajectory →

What is jwst?

JWST's calibration pipeline extended adaptive trace modelling across its spectrographs

Version 3.0.0, the DMS B13.0 operational build, is the substantive release in this window. It extends the adaptive_trace_model step to NIRSpec MOS, fixed-slit and BOTS modes plus MIRI LRS, adds multiprocessing that cut one NIRSpec IFU case by roughly a factor of seven, and introduces chromaticity correction for NIRSpec IFU data via a new reference file type. It also removes several internal-only step parameters as breaking changes. The four release candidates preceding it contain only dependency pins and changelog freezes.

Read the full jwst trajectory →

distributed vs jwst: editorial side-by-side

D5.0

Dask's scheduler spent the year deleting deprecated API, not adding surface.

◆ Current state

distributed is cutting frequent tags with little in them. The substantive release in the window is 2026.6.0, which removed deprecations across the scheduler, worker, nanny, CLI, security and deploy modules in roughly twenty separate cleanups and moved CI to pixi. 2026.7.0 follows with a breaking scatter change and a scheduler_info() default change; the two most recent tags are a backport and an empty release with no changes at all.

◆ Where it's heading

The direction is consolidation. A single maintainer is systematically retiring API that had been deprecated for years, tightening type annotations and chasing flaky tests, while the feature surface stays flat. Python 3.14 support and a PyArrow floor in 2026.1.2 fit the same pattern of keeping the runtime current rather than extending it.

◆ Prediction

With the deprecation sweep largely done and pixi now driving CI, the next releases most likely continue as small breaking cleanups on top of a stable feature set rather than introducing new scheduler capability.

J
jwst
DEVOPS
3.8

JWST's calibration pipeline extended adaptive trace modelling across its spectrographs

◆ Current state

Version 3.0.0, the DMS B13.0 operational build, is the substantive release in this window. It extends the adaptive_trace_model step to NIRSpec MOS, fixed-slit and BOTS modes plus MIRI LRS, adds multiprocessing that cut one NIRSpec IFU case by roughly a factor of seven, and introduces chromaticity correction for NIRSpec IFU data via a new reference file type. It also removes several internal-only step parameters as breaking changes. The four release candidates preceding it contain only dependency pins and changelog freezes.

◆ Where it's heading

Development is organised around periodic DMS operational builds rather than continuous delivery, with release candidates used purely to freeze dependencies. The direction inside the pipeline is toward per-mode calibration sophistication - trace modelling and chromaticity corrections that were previously unavailable or mode-limited - alongside a steady cleanup of parameters that only ever existed for internal plumbing.

◆ Prediction

Expect adaptive trace modelling to keep expanding across the remaining instrument modes, and the multiprocessing work applied there to spread to other slow steps. Further breaking removals of internal-use parameters are likely while the 3.x major version is open.

Alternatives to distributed and jwst

Other DevOps products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either distributed or jwst.

See all distributed alternatives → · See all jwst alternatives →

Recent activity from distributed and jwst

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 28d agojwstJWST 3.0.0 extends adaptive trace modelling across spectroscopic modes
  2. 29d agodistributedBackport tag extending an earlier fix
  3. 29d agodistributedEmpty release: no changes
  4. 1mo agojwst3.0.0rc4
  5. 1mo agojwst3.0.0rc3
  6. 1mo agodistributedBreaking: scatter stops unpacking custom containers
  7. 1mo agojwststcal bumped to 1.19.1
  8. 1mo agojwstDependencies pinned to latest released versions
  9. 2mo agodistributedDeprecated APIs removed across scheduler, worker and CLI
  10. 3mo agojwstNIRCam DHS stripe crash and multi-integration ramp fix
  11. 4mo agodistributedCI pins, type hints and a dashboard CPU fix
  12. 6mo agodistributedPython 3.14 support and a PyArrow 16 floor

Frequently asked questions

What is the difference between distributed and jwst?

Both compete on the same themes — breaking-changes — within DevOps. distributed is currently shipping more aggressively (velocity 5.0 vs 3.8), with 0 editorial sparks in the last 30 days against 1. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is distributed better than jwst?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. distributed is currently shipping more aggressively (velocity 5.0 vs 3.8), with 0 editorial sparks in the last 30 days against 1. For your specific use case, the alternatives sections above list other DevOps products to evaluate alongside.

What are the best alternatives to distributed?

Top distributed alternatives in DevOps are ranked by recent ship velocity. Browse the "distributed alternatives" section above for the current picks, or visit /alternatives/dask-distributed for the full list with editorial commentary on each.

What are the best alternatives to jwst?

Top jwst alternatives in DevOps are ranked by recent ship velocity. Browse the "jwst alternatives" section above for the current picks, or visit /alternatives/jwst-pipeline for the full list with editorial commentary on each.