← Back to home
Comparison · DevOps

Artillery vs Libreswan

A side-by-side editorial comparison of Artillery and Libreswan — release velocity, themes, recent moves, and the top alternatives to consider.

Artillery vs Libreswan: at a glance

FeatureArtilleryLibreswan
SectorDevOpsDevOps
Velocity score3.86.3
Sparks · 30d11
Top themesload-testing, esm, typescript, aws-fargateipsec, post-quantum crypto, ikev2, rfc 9370
Last editorial update1h ago20h ago
WebsiteVisit →Visit →

What is Artillery?

Artillery adds a single-request diagnostic command and finally makes ESM a first-class citizen.

Artillery ships a patch release every four to eight weeks, and for most of the last ten that release was a Playwright version bump plus fixes to the distributed runners on Lambda, Fargate and Azure ACI. The recurring failure mode being chased is dependency resolution in worker environments: tests that need external npm modules silently starting with fewer VUs, skipped installs, module-not-found errors at run time. v2.0.34 breaks that pattern with genuine new surface area.

Read the full Artillery trajectory →

What is Libreswan?

Libreswan puts post-quantum key exchange into IKEv2 — ML-KEM 768 ships in v5.4.

Libreswan spent the last two releases on security patches, including a CVE found when the project ran an AI audit over its own codebase. v5.4 breaks that pattern: it implements RFC 9370's multiple-key-exchange machinery end to end — IKE_INTERMEDIATE, IKE_ADDITIONAL_KE and IKE_FOLLOWUP_KE — and uses it to carry ML_KEM_768 in IKE_SA_INIT and IKE_INTERMEDIATE. The rest of the release is a wide maintenance sweep across kernel integration on the BSDs, config parsing and logging.

Read the full Libreswan trajectory →

Artillery vs Libreswan: editorial side-by-side

A
Artillery
DEVOPS
3.8

Artillery adds a single-request diagnostic command and finally makes ESM a first-class citizen.

◆ Current state

Artillery ships a patch release every four to eight weeks, and for most of the last ten that release was a Playwright version bump plus fixes to the distributed runners on Lambda, Fargate and Azure ACI. The recurring failure mode being chased is dependency resolution in worker environments: tests that need external npm modules silently starting with fewer VUs, skipped installs, module-not-found errors at run time. v2.0.34 breaks that pattern with genuine new surface area.

◆ Where it's heading

Two arcs are converging. The first is reliability of the cloud runners, addressed incrementally by bundling more into the worker image rather than fetching at test startup — the fake-data plugin moved in this release, following the pre-packaged Playwright and CLI binaries earlier in the window. The second is modern JavaScript support: full ESM across processors, plugins, engines and reporters, plus TypeScript definitions that now model the entire test script rather than a fragment. Together they point at a team removing the reasons a test fails for reasons unrelated to the system under test.

◆ Prediction

Expect the ping command to grow assertion and output options, and the worker images to keep absorbing commonly-used plugins so that startup installs disappear entirely.

L
Libreswan
DEVOPS
6.3

Libreswan puts post-quantum key exchange into IKEv2 — ML-KEM 768 ships in v5.4.

◆ Current state

Libreswan spent the last two releases on security patches, including a CVE found when the project ran an AI audit over its own codebase. v5.4 breaks that pattern: it implements RFC 9370's multiple-key-exchange machinery end to end — IKE_INTERMEDIATE, IKE_ADDITIONAL_KE and IKE_FOLLOWUP_KE — and uses it to carry ML_KEM_768 in IKE_SA_INIT and IKE_INTERMEDIATE. The rest of the release is a wide maintenance sweep across kernel integration on the BSDs, config parsing and logging.

◆ Where it's heading

The post-quantum work is the spine of this release and it is not experimental framing — it is standards-track RFC 9370 plus a hard dependency on NSS 3.118.1, meaning distributions have to move their crypto library before users can turn it on. Around it, the project keeps grinding on operator experience: better proposal parsing, more specific error messages, traffic selectors and DIGSIG algorithms in logs, and rate-limited logging. Experimental flags for subnet leasing and updown-config suggest the next capability additions are already staged.

◆ Prediction

Expect ML-KEM to move from supported to recommended in default proposals once NSS 3.118.1 is widely packaged, and the experimental leftaddresspool subnet leasing and per-connection debug options to stabilize in a following release.

Alternatives to Artillery and Libreswan

Other DevOps products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either Artillery or Libreswan.

See all Artillery alternatives → · See all Libreswan alternatives →

Recent activity from Artillery and Libreswan

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 1d agoArtilleryartillery ping lands, plus full ESM and complete TypeScript definitions
  2. 1d agoLibreswan5.4: ML-KEM 768 and RFC 9370 multiple key exchanges for IKEv2
  3. 29d agoLibreswan5.3.2: FIPS-mode daemon crash from malformed X.509 certificates
  4. 1mo agoLibreswan5.3.1: three CVEs and a newer-GCC compile fix
  5. 2mo agoArtilleryPlaywright 1.61 and a Faker swap in fake-data
  6. 2mo agoArtilleryhttp.timeout no longer silently capped at 8 seconds
  7. 3mo agoArtilleryW3C trace context propagation and a Got 11 to 14 engine upgrade
  8. 6mo agoArtilleryPlaywright 1.58.1 and a Fargate binary mismatch fix
  9. 6mo agoArtilleryPlaywright 1.58 and a Fargate metrics completeness fix
  10. 2y agoLibreswanIKEv1 cryptosuite defaults tightened; systemd libxz dependency dropped
  11. 2y agoLibreswanCompile error fix carried over from 4.13

Frequently asked questions

What is the difference between Artillery and Libreswan?

They serve adjacent needs but don't currently overlap on shipped themes. Libreswan is currently shipping more aggressively (velocity 6.3 vs 3.8), with 1 editorial sparks in the last 30 days against 1. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is Artillery better than Libreswan?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. Libreswan is currently shipping more aggressively (velocity 6.3 vs 3.8), with 1 editorial sparks in the last 30 days against 1. For your specific use case, the alternatives sections above list other DevOps products to evaluate alongside.

What are the best alternatives to Artillery?

Top Artillery alternatives in DevOps are ranked by recent ship velocity. Browse the "Artillery alternatives" section above for the current picks, or visit /alternatives/artillery for the full list with editorial commentary on each.

What are the best alternatives to Libreswan?

Top Libreswan alternatives in DevOps are ranked by recent ship velocity. Browse the "Libreswan alternatives" section above for the current picks, or visit /alternatives/libreswan for the full list with editorial commentary on each.