LoginSign Up
← Back to all sparks
K

kwb.geosalz

ANALYTICS
Velocity0.0

R Package for Documenting Workflow Used in Project "geosalz"

github.com/KWB-R/kwb.geosalz ↗

A research-project workflow package where the interesting work is in the plumbing.

groundwaterresearch-workflowreproducibilitydata-pipelinesr-package
◆Current state
kwb.geosalz documents the data workflows for GeoSalz, a groundwater salinisation project run by Kompetenzzentrum Wasser Berlin, packaging retrieval, checking and plotting steps as reproducible R code. The current release replaces an SFTP dependency with curl and reports listing files on the SFTP server running 50 to 100 times faster. Earlier releases added data-availability workflows against Berlin's open water portal and functions for well-field abstraction figures.
◆Where it's heading
Releases track the project's own data-collection reality rather than a software roadmap: new data source appears, a workflow is added; a transfer library becomes a liability, it is swapped out. The measurement-chain pipeline is the recurring subject, appearing in plotting fixes at 0.7.1 and the transport rewrite at 0.7.2. Cadence is roughly annual and the changelog is written for project members, which makes external readability secondary by design.
◆Prediction
Expect the next release to follow the measurement-chain data as it accumulates, most likely more plotting or availability-checking work rather than new infrastructure.

◆Recent moves

  1. 5mo ago

    SFTP transfers moved to curl, file listing 50-100x faster

    Drops the stenevang/sftp dependency for curl and reports a 50 to 100 times speedup listing files on the SFTP server. For a workflow package, the transport layer is the pipeline, so this is a substantive change despite reading as plumbing.

    View source ↗
  2. 1y ago

    Conductivity outliers filtered from measurement chain plots

    Filters conductivity readings above 20000 microsiemens out of the combined plots and thins the x-axis labelling to quarterly. Data-quality decisions encoded in the workflow, which is what this package exists to document.

    View source ↗
  3. 2y ago

    Release rolling up vignette cleanup and well operation work

    A version bump whose body is an unannotated list of eighteen merged pull requests. The well operation work referenced in it is the only substantive item, and the feed gives no detail on it.

    View source ↗
  4. 4y ago

    Wasserportal Berlin workflow and CRS conversion added

    Adds a data-availability workflow against Berlin's open water portal plus a coordinate reference conversion helper for map overlays. The pattern of a new data source arriving as a new workflow.

    View source ↗
  5. 4y ago

    Annual well-field abstraction figures retrievable

    Adds a function for annual abstraction volumes at the Friedrichshagen waterworks galleries and the first data-availability workflow. Establishes the shape every later release follows.

    View source ↗
  6. 7y ago

    Initial release scaffolded from the in-house package template

    A version bump running the organisation's standard package-setup helpers. No project functionality yet.

    View source ↗