btm
BTM has shipped nothing but compiler and integration compliance since 2020
A side-by-side editorial comparison of Firecrawl and ragnar — release velocity, themes, recent moves, and the top alternatives to consider.
Firecrawl stopped selling pages and started selling answers — now it is giving the corpus away.
Firecrawl has spent four months converting a scraping API into an answer-retrieval layer for agents. Question, Highlights and the excerpt-scoring rebuild of /search all trade full-page delivery for the specific lines that answer a query, each pitched on token cost rather than coverage. Alongside that it has started owning corpora outright — the Research Index now spans 3M+ arXiv papers and 41M+ life-sciences papers — and /monitor turns crawling into a subscribable event stream.
ragnar turned its RAG store into an MCP server, so coding agents can search it directly.
ragnar builds retrieval-augmented generation stores in R on DuckDB, handling document chunking, embedding, and hybrid vector plus BM25 retrieval, and registering itself as a tool for ellmer chats. Version 0.3.0 adds mcp_serve_store(), which exposes a store over MCP to local clients such as Codex CLI and Claude Code, alongside Azure AI Foundry and Snowflake Cortex embedding providers. Store version 2, introduced in 0.2.0, brought chunk deoverlapping on retrieval and automatic heading augmentation.
Firecrawl has spent four months converting a scraping API into an answer-retrieval layer for agents. Question, Highlights and the excerpt-scoring rebuild of /search all trade full-page delivery for the specific lines that answer a query, each pitched on token cost rather than coverage. Alongside that it has started owning corpora outright — the Research Index now spans 3M+ arXiv papers and 41M+ life-sciences papers — and /monitor turns crawling into a subscribable event stream.
The centre of gravity is moving from generic crawl infrastructure to curated indexes with published benchmark numbers attached, and now to giving those indexes away. Every recent release argues the same point in a different register: the crawler should return the smallest correct thing, and Firecrawl should already have it indexed. Free access to Research Index converts a metered data product into a distribution channel for the paid scraping and monitoring endpoints around it.
Expect a third vertical index after AI/ML and life sciences — the pattern of a benchmark claim, daily refresh and API-plus-MCP-plus-CLI availability is now a repeatable template. Whether the free tier stays free once query volume lands is the open question the entries do not answer.
ragnar builds retrieval-augmented generation stores in R on DuckDB, handling document chunking, embedding, and hybrid vector plus BM25 retrieval, and registering itself as a tool for ellmer chats. Version 0.3.0 adds mcp_serve_store(), which exposes a store over MCP to local clients such as Codex CLI and Claude Code, alongside Azure AI Foundry and Snowflake Cortex embedding providers. Store version 2, introduced in 0.2.0, brought chunk deoverlapping on retrieval and automatic heading augmentation.
The package keeps widening who can reach a store and how many ways they can query it. Retrieval accepts vectors of queries, the ellmer tool withholds chunks it has already returned so an agent can dig deeper across calls, and now the store is reachable from outside R entirely. Embedding providers are added steadily — LM Studio, then Azure and Snowflake — which keeps the store portable across whoever supplies the vectors. Breaking changes are accepted readily at this stage, including a renamed default tool prefix and a flipped default in ragnar_find_links().
More MCP surface is the natural next step now that serving exists, since the retrieval tool already has the multi-query and no-repeat behavior that agent-driven search depends on.
Other ai-assistants products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either Firecrawl or ragnar.
BTM has shipped nothing but compiler and integration compliance since 2020
word2vec for R spent its 0.4 release proving two training paths give identical embeddings
doc2vec's one directional release added topic discovery to a document-embedding package
udpipe's last six releases are entirely compiler fixes, with no NLP change among them.
An R binding to NameTag that has not gained a feature since its 2020 debut.
The R binding to Google's tokenizer has shipped nothing but compiler fixes since 2021.
See all Firecrawl alternatives → · See all ragnar alternatives →
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
They serve adjacent needs but don't currently overlap on shipped themes. Firecrawl is currently shipping more aggressively (velocity 7.5 vs 0.0), with 2 editorial sparks in the last 30 days against 0. See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. Firecrawl is currently shipping more aggressively (velocity 7.5 vs 0.0), with 2 editorial sparks in the last 30 days against 0. For your specific use case, the alternatives sections above list other ai-assistants products to evaluate alongside.
Top Firecrawl alternatives in ai-assistants are ranked by recent ship velocity. Browse the "Firecrawl alternatives" section above for the current picks, or visit /alternatives/firecrawl for the full list with editorial commentary on each.
Top ragnar alternatives in ai-assistants are ranked by recent ship velocity. Browse the "ragnar alternatives" section above for the current picks, or visit /alternatives/ragnar-r for the full list with editorial commentary on each.