Omni
Omni ships weekly, and almost every week the headline item is an AI feature
Comparison · Analytics
Apache Uniffle vs Marquez
A side-by-side editorial comparison of Apache Uniffle and Marquez — release velocity, themes, recent moves, and the top alternatives to consider.
Apache Uniffle vs Marquez: at a glance
What is Apache Uniffle?
Uniffle's remote shuffle service finally makes its fast path the default
Apache Uniffle is a remote shuffle service for Spark, MapReduce and Tez. The 0.10.0 release in September 2025 flipped the Netty-based transport (GRPC_NETTY) from opt-in to the default, promoted partition reassignment to general availability, and added partition splitting for oversized shuffle partitions. Releases before that were largely stabilization work: a dashboard in 0.9.0, log and layout cleanups in 0.9.1, and pure license housekeeping in 0.9.2.
What is Marquez?
Marquez spent 2024 turning a lineage store into a UI, then stopped releasing
Marquez is the reference metadata server for OpenLineage, and this window captures a concentrated push on its web interface: a column-lineage page and redesigned lineage graph in 0.45.0, data quality and job status displays in 0.47.0, and a data observability dashboard in 0.50.0 showing event stats over 24-hour and 7-day windows with per-source, per-dataset and per-job views. The API side moved in step — job tagging, dataset schema versions, paging on jobs and dataset versions, job-to-job lineage, richer metrics labels. One contributor accounts for nearly all the web work in these entries. Note that the 0.45 through 0.49 releases were all stamped within three minutes of each other and in reverse version order, so publication timestamps here do not reflect release order.
Apache Uniffle vs Marquez: editorial side-by-side
Apache Uniffle
0.0ANALYTICS
Uniffle's remote shuffle service finally makes its fast path the default
◆ Current state
Apache Uniffle is a remote shuffle service for Spark, MapReduce and Tez. The 0.10.0 release in September 2025 flipped the Netty-based transport (GRPC_NETTY) from opt-in to the default, promoted partition reassignment to general availability, and added partition splitting for oversized shuffle partitions. Releases before that were largely stabilization work: a dashboard in 0.9.0, log and layout cleanups in 0.9.1, and pure license housekeeping in 0.9.2.
◆ Where it's heading
The arc runs from 'Netty is available' in 0.8.0, to 'Netty is production ready' in 0.9.0, to 'Netty is on by default' in 0.10.0 — a three-release migration off the original gRPC transport, executed conservatively. The parallel theme is huge-partition survival: reassignment and splitting both exist to stop a single skewed partition from taking down a shuffle write. Uniffle is optimizing for the failure modes of very large Spark jobs rather than for breadth of features.
◆ Prediction
The Rust shuffle server introduced experimentally in 0.9.0 is the obvious next promotion candidate, following the same available-then-default path Netty took. The release notes do not indicate a timeline.
Marquez
0.0ANALYTICS
Marquez spent 2024 turning a lineage store into a UI, then stopped releasing
◆ Current state
Marquez is the reference metadata server for OpenLineage, and this window captures a concentrated push on its web interface: a column-lineage page and redesigned lineage graph in 0.45.0, data quality and job status displays in 0.47.0, and a data observability dashboard in 0.50.0 showing event stats over 24-hour and 7-day windows with per-source, per-dataset and per-job views. The API side moved in step — job tagging, dataset schema versions, paging on jobs and dataset versions, job-to-job lineage, richer metrics labels. One contributor accounts for nearly all the web work in these entries. Note that the 0.45 through 0.49 releases were all stamped within three minutes of each other and in reverse version order, so publication timestamps here do not reflect release order.
◆ Where it's heading
The arc is a backend project growing a front end: lineage data that existed in the API was progressively given pages, panels and paging, and by 0.50.0 the framing had shifted from lineage graph to observability dashboard. Tagging deepened in the same period, moving from dataset tags to field-level tags to job tags. That arc stops abruptly — 0.50.0 in October 2024 is the last entry, with nothing published in the roughly two years since.
◆ Prediction
The entries give no roadmap signal past 0.50.0, and the job-to-job lineage change was explicitly framed as a prompt for a wider parent/child hierarchy discussion that no later release picks up, so that hierarchy work is best read as unfinished rather than planned.
Alternatives to Apache Uniffle and Marquez
Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either Apache Uniffle or Marquez.
OpenDataDiscovery
Four ODD Platform releases in two weeks, and not one of them changes the product
Apache Baremaps
Baremaps got geoparquet and hillshading, then went quiet for eighteen months in incubation
Deequ
Deequ ships GitHub tags whose release notes are one commit message long
Amundsen
Amundsen's last release was a config flag, and the feed has been silent for two years
OpenHouse
LinkedIn's Iceberg control plane, shipping one pull request per release.
See all Apache Uniffle alternatives → · See all Marquez alternatives →
Recent activity from Apache Uniffle and Marquez
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 10mo agoApache UniffleNetty transport becomes the default in Uniffle 0.10 ⚡
- 1y agoApache UniffleLicense and NOTICE housekeeping in Uniffle 0.9.2
- 1y agoApache UniffleDashboard and block-ID layout cleanup in Uniffle 0.9.1
- 1y agoApache Unifflev0.9.1: [MINOR] chore: Fix the issue of license loss (#2246)
- 1y agoMarquezMarquez 0.50.0 adds a data observability dashboard
- 1y agoApache Unifflev0.9.1-rc1: Revert "Update create-package.sh (#2019)"
- 2y agoMarquezMarquez 0.45.0 ships a column lineage page and redesigned graph
- 2y agoMarquezMarquez 0.46.0 cleans up the UI and fixes streaming terminal events
- 2y agoMarquezMarquez 0.47.0 adds data quality and job status views, job tagging
- 2y agoMarquezMarquez 0.49.0 adds job-to-job lineage to the API
- 2y agoMarquezMarquez 0.48.0 adds paging and dataset schema versions
- 2y agoApache UniffleUniffle 0.9 adds a dashboard and a Rust shuffle server
Frequently asked questions
What is the difference between Apache Uniffle and Marquez?
They serve adjacent needs but don't currently overlap on shipped themes. Apache Uniffle and Marquez are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is Apache Uniffle better than Marquez?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. Apache Uniffle and Marquez are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.
What are the best alternatives to Apache Uniffle?
Top Apache Uniffle alternatives in Analytics are ranked by recent ship velocity. Browse the "Apache Uniffle alternatives" section above for the current picks, or visit /alternatives/apache-uniffle for the full list with editorial commentary on each.
What are the best alternatives to Marquez?
Top Marquez alternatives in Analytics are ranked by recent ship velocity. Browse the "Marquez alternatives" section above for the current picks, or visit /alternatives/marquez for the full list with editorial commentary on each.