LoginSign Up
← Back to all sparks
D

Delta Lake

ANALYTICS
Velocity5.0

Open table format bringing ACID transactions to data lakes

delta.io ↗

Delta Lake is handing table authority to Unity Catalog — under a feed buried in Databricks build tags.

lakehouseunity-catalogtable-formatsparkrest-catalogbuild-tags
◆Current state
The real releases in this window are 4.3.0 and its 4.3.1 patch. 4.3.0's headline is Spark talking to Unity Catalog through the UC Delta REST API, with server-side commit validation, server-advertised table features, and intent-based metadata updates; 4.3.1 fixes OAuth key case-sensitivity that broke Delta REST Catalog authentication, plus S3A fast listing and UC managed-table metadata handling. Everything else in the feed is a dbr-/dbi- kernel build tag cut from Databricks' internal build pipeline, several per week, with commit-message bodies and no user-facing content.
◆Where it's heading
The protocol is moving from client-enforced to server-enforced: a catalog now validates commits and advertises which table features are in play, rather than every engine reasoning about the log independently. The stated intent is to extend that path to Flink, Trino, and other engines, which would make catalog integration — not log format — the thing that defines Delta compatibility. Both of the last two patch releases were spent on the authentication and metadata seams of that integration, which is where a new client-server boundary usually hurts first.
◆Prediction
Expect the UC Delta REST API to reach a second engine, and for near-term patch releases to keep landing on catalog authentication and metadata edge cases rather than on the storage format itself.

◆Recent moves

  1. 4d ago

    Databricks kernel build tag (2026-07-30)

    An internal Databricks kernel build tag, not a Delta Lake release — it only sets a build version string. These tags appear several times a week and inflate the apparent shipping cadence without carrying any user-facing change.

    View source ↗
  2. 24d ago

    Kernel build tag: _last_checkpoint captured as opaque JSON

    A build tag carrying a single kernel commit that stores _last_checkpoint as opaque JSON for snapshot hints. Internal plumbing on the checkpoint read path, published as a tag rather than a release.

    View source ↗
  3. 27d ago

    Delta Lake 4.3.1

    A targeted patch on 4.3.0 that mostly repairs the new catalog integration: a case-insensitive config map was lowercasing camelCase OAuth keys and breaking Delta REST Catalog authentication outright. That the first patch after the UC integration lands on its auth path is a fair indication of where the integration's rough edges are.

    View source ↗
  4. 27d ago

    Databricks kernel build tag (2026-07-07)

    Another internal DBR kernel build tag with no user-visible content. Noise in the feed rather than a shipped change.

    View source ↗
  5. 28d ago

    Databricks kernel build tag, DBI variant (2026-07-06)

    The DBI counterpart to the same-day DBR tag, carrying the identical version bump. The duplication is an artefact of Databricks publishing two build streams from one commit.

    View source ↗
  6. 28d ago

    Databricks kernel build tag (2026-07-06)

    A DBR build tag that only sets a version string. One of a pair cut the same day alongside the matching DBI tag.

    View source ↗