← Back to home
Comparison · Analytics

mirai vs nanoparquet

A side-by-side editorial comparison of mirai and nanoparquet — release velocity, themes, recent moves, and the top alternatives to consider.

mirai vs nanoparquet: at a glance

Featuremirainanoparquet
SectorAnalyticsAnalytics
Velocity score2.50.0
Sparks · 30d00
Top themesparallel-computing, async, backpressure, shinyparquet, r-language, interoperability, data-formats
Last editorial update4h ago47m ago
WebsiteVisit →Visit →

What is mirai?

mirai removed its dispatcher process and added memory backpressure to the queue.

The async evaluation framework releases roughly monthly and moves fast at the architecture level. In 2.7.0 the dispatcher stopped being a separate process and became a thread, after its loop had already been rewritten in C inside nanonext one release earlier. The same release added an opt-in memory budget for queued task payloads and try_mirai(), which returns NULL immediately rather than blocking when that budget is exhausted.

Read the full mirai trajectory →

What is nanoparquet?

nanoparquet is chasing byte-level agreement with the Java and Rust Parquet readers, not feature count.

nanoparquet reads and writes Parquet from R with no Arrow dependency, which is its entire reason to exist. The 0.4.0 line renamed the reader API and added schema authoring plus `append_parquet()`, and the 0.5.x releases have gone after interoperability: definition and repetition level encodings the Apache Parquet Java library expects, flatbuffer alignment the Rust arrow-rs reader expects, 128-bit decimals, and Polars-written files that omit the dictionary page offset. The newest release adds `bit64::integer64` columns and writing to stdout.

Read the full nanoparquet trajectory →

mirai vs nanoparquet: editorial side-by-side

M
mirai
ANALYTICS
2.5

mirai removed its dispatcher process and added memory backpressure to the queue.

◆ Current state

The async evaluation framework releases roughly monthly and moves fast at the architecture level. In 2.7.0 the dispatcher stopped being a separate process and became a thread, after its loop had already been rewritten in C inside nanonext one release earlier. The same release added an opt-in memory budget for queued task payloads and try_mirai(), which returns NULL immediately rather than blocking when that budget is exhausted.

◆ Where it's heading

Two threads of work run together: cutting overhead out of the task path — thread-based dispatcher, in-process transport for synchronous daemons, lower per-element dispatch cost in mirai_map() — and making the framework safe to embed in an event loop, where blocking the host R thread is not acceptable. Deployment reach is growing too, with http_config() launching remote daemons over HTTP APIs and auto-configuring for Posit Workbench. Each release pins a minimum nanonext version, so the two packages advance as one unit.

◆ Prediction

With backpressure in place but opt-in, the open question these notes leave is whether a default memory budget arrives; continued overhead reduction and Shiny-facing non-blocking paths are the safer bet.

N
nanoparquet
ANALYTICS
0.0

nanoparquet is chasing byte-level agreement with the Java and Rust Parquet readers, not feature count.

◆ Current state

nanoparquet reads and writes Parquet from R with no Arrow dependency, which is its entire reason to exist. The 0.4.0 line renamed the reader API and added schema authoring plus `append_parquet()`, and the 0.5.x releases have gone after interoperability: definition and repetition level encodings the Apache Parquet Java library expects, flatbuffer alignment the Rust arrow-rs reader expects, 128-bit decimals, and Polars-written files that omit the dictionary page offset. The newest release adds `bit64::integer64` columns and writing to stdout.

◆ Where it's heading

Almost every entry since 0.4.0 names another engine — Java, arrow-rs, Polars, Arrow schema metadata — which tells you the maintainers are treating cross-reader fidelity as the product rather than R-side ergonomics. The type system is filling in from the edges: DECIMAL beyond 8 bytes, UUID, FLOAT16 and INTERVAL as raw lists, and now 64-bit integers with an explicit read-type option instead of a silent cast to double. Writing to `:stdout:` points at a second audience, shell pipelines rather than interactive R.

◆ Prediction

The remaining unmapped Parquet types the changelog has been parking in raw-vector lists — FLOAT16 and INTERVAL — are the obvious next targets, following the same pattern by which DECIMAL and UUID graduated to real R types.

Alternatives to mirai and nanoparquet

Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either mirai or nanoparquet.

See all mirai alternatives → · See all nanoparquet alternatives →

Recent activity from mirai and nanoparquet

Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.

  1. 25d agomiraiMap collection and daemon lifecycle fixes
  2. 2mo agomiraiAgent skill ships in-package; HTTP headers take over auth
  3. 3mo agomiraiDispatcher becomes a thread, and the queue gains a memory budget
  4. 3mo agonanoparquet64-bit integer columns and writing Parquet to stdout
  5. 4mo agonanoparquetFiles now readable by the Java and Rust Parquet libraries
  6. 5mo agomiraiParallel RNG seeding leaves experimental status
  7. 6mo agomiraiRemote daemons over HTTP, and a C dispatcher loop
  8. 8mo agomiraiTelemetry span timing and daemon-switch fix
  9. 1y agonanoparquetReads Polars files that omit the dictionary page offset
  10. 1y agonanoparquetDate, FLOAT, and mixed-encoding read fixes
  11. 1y agonanoparquetSchema authoring and append_parquet arrive with a renamed API
  12. 1y agonanoparquetFixes a write_parquet crash

Frequently asked questions

What is the difference between mirai and nanoparquet?

They serve adjacent needs but don't currently overlap on shipped themes. mirai is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.

Is mirai better than nanoparquet?

Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. mirai is currently shipping more aggressively (velocity 2.5 vs 0.0), with 0 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.

What are the best alternatives to mirai?

Top mirai alternatives in Analytics are ranked by recent ship velocity. Browse the "mirai alternatives" section above for the current picks, or visit /alternatives/mirai for the full list with editorial commentary on each.

What are the best alternatives to nanoparquet?

Top nanoparquet alternatives in Analytics are ranked by recent ship velocity. Browse the "nanoparquet alternatives" section above for the current picks, or visit /alternatives/nanoparquet for the full list with editorial commentary on each.