← Back to all sparks
J

jwst

DEVOPS
Velocity3.8

Calibration pipeline for the James Webb telescope

JWST's calibration pipeline extended adaptive trace modelling across its spectrographs

astronomycalibration-pipelinejwstspectroscopybreaking-changes
Current state
Version 3.0.0, the DMS B13.0 operational build, is the substantive release in this window. It extends the adaptive_trace_model step to NIRSpec MOS, fixed-slit and BOTS modes plus MIRI LRS, adds multiprocessing that cut one NIRSpec IFU case by roughly a factor of seven, and introduces chromaticity correction for NIRSpec IFU data via a new reference file type. It also removes several internal-only step parameters as breaking changes. The four release candidates preceding it contain only dependency pins and changelog freezes.
Where it's heading
Development is organised around periodic DMS operational builds rather than continuous delivery, with release candidates used purely to freeze dependencies. The direction inside the pipeline is toward per-mode calibration sophistication - trace modelling and chromaticity corrections that were previously unavailable or mode-limited - alongside a steady cleanup of parameters that only ever existed for internal plumbing.
Prediction
Expect adaptive trace modelling to keep expanding across the remaining instrument modes, and the multiprocessing work applied there to spread to other slow steps. Further breaking removals of internal-use parameters are likely while the 3.x major version is open.

Recent moves

  1. 28d ago

    JWST 3.0.0 extends adaptive trace modelling across spectroscopic modes

    ⚡ SPARK

    The DMS B13.0 build, and the release the whole rc train was staging. Adaptive trace modelling reaches most of JWST's spectroscopic modes, NIRSpec IFU data gains chromaticity correction, and a set of internal-only step parameters is removed outright.

    View source ↗
  2. 1mo ago

    3.0.0rc4

    A changelog freeze for the fourth release candidate, with no code changes described. Process bookkeeping ahead of the 3.0.0 build.

    View source ↗
  3. 1mo ago

    3.0.0rc3

    Another changelog freeze plus a build table update. Release-engineering steps in the 3.0.0 candidate sequence rather than pipeline changes.

    View source ↗
  4. 1mo ago

    stcal bumped to 1.19.1

    Bumps the stcal dependency to patch release 1.19.1 and nothing else. Dependency maintenance during the release-candidate freeze.

    View source ↗
  5. 1mo ago

    Dependencies pinned to latest released versions

    Pins dependencies to their latest released versions, the opening step of the 3.0.0 candidate sequence. No pipeline behaviour changes.

    View source ↗
  6. 3mo ago

    NIRCam DHS stripe crash and multi-integration ramp fix

    A two-fix patch on the 2.0 line: a crash generating transforms for NIRCam DHS stripe subarrays, and an array broadcasting error on multi-integration ramps. Narrow corrections to specific observing configurations.

    View source ↗