rnaturalearth
rnaturalearth finished its sp exit and is now optimising how the data actually arrives.
Comparison · Analytics
rgbif vs rvest
A side-by-side editorial comparison of rgbif and rvest — release velocity, themes, recent moves, and the top alternatives to consider.
rgbif vs rvest: at a glance
What is rgbif?
rgbif is steadily pushing users off paged searching and onto real downloads.
rgbif ships several times a year and the recent releases cluster around downloads. 3.8.1 added `occ_download_sql()` for SQL-based occurrence downloads; 3.8.2 added DOI-to-download-key resolution and institutionKey downloads; 3.8.3 relayed GBIF's new throttling of bulk paging through `occ_search()` with a message pointing users at `occ_download()`; 3.8.5 added a family of `occ_download_stats_*()` functions plus multiple-taxonomy and verbatim-extension downloads. Alongside that, `name_backbone()` moved to GBIF API v2, and 3.8.0 soft-deprecated `occ_data()`.
What is rvest?
rvest grew a real browser, turning a static scraper into a dynamic one.
rvest is the tidyverse's HTML scraping package. The 1.0.0 line rebuilt table parsing to mimic how browsers actually read tables, and 1.0.4 added read_html_live(), which drives a headless browser so JavaScript-rendered pages can be scraped at all. 1.0.5 is consolidation on that newer path.
rgbif vs rvest: editorial side-by-side
rgbif
0.0ANALYTICS
rgbif is steadily pushing users off paged searching and onto real downloads.
◆ Current state
rgbif ships several times a year and the recent releases cluster around downloads. 3.8.1 added `occ_download_sql()` for SQL-based occurrence downloads; 3.8.2 added DOI-to-download-key resolution and institutionKey downloads; 3.8.3 relayed GBIF's new throttling of bulk paging through `occ_search()` with a message pointing users at `occ_download()`; 3.8.5 added a family of `occ_download_stats_*()` functions plus multiple-taxonomy and verbatim-extension downloads. Alongside that, `name_backbone()` moved to GBIF API v2, and 3.8.0 soft-deprecated `occ_data()`.
◆ Where it's heading
Two things are happening at once. GBIF is discouraging bulk retrieval through the search API, and rgbif is building out the download path fast enough to absorb the traffic — SQL queries, DOI round-tripping, format description, and now statistics about the downloads themselves. Metadata coverage has expanded in parallel, with a dozen `dataset_*()` functions in 3.7.9 and GRSciColl institution search in 3.8.3. The deprecations are consistent: `occ_data()`, `occ_facet()`, `occ_count(type=)` all retired in favour of narrower replacements.
◆ Prediction
The download surface is where the next additions will land — likely more SQL-download tooling and further statistics endpoints, following 3.8.1 and 3.8.5.
rvest
0.0ANALYTICS
rvest grew a real browser, turning a static scraper into a dynamic one.
◆ Current state
rvest is the tidyverse's HTML scraping package. The 1.0.0 line rebuilt table parsing to mimic how browsers actually read tables, and 1.0.4 added read_html_live(), which drives a headless browser so JavaScript-rendered pages can be scraped at all. 1.0.5 is consolidation on that newer path.
◆ Where it's heading
The package has split into two modes: fast static parsing for ordinary documents, and a live browser session for client-rendered ones. Recent effort concentrates on hardening the live path, where page navigation and interaction bugs surface that never existed in static parsing.
◆ Prediction
Expect further fixes and documentation around read_html_live() as more scraping targets move rendering to the client.
Alternatives to rgbif and rvest
Other Analytics products tracked by Sparkpulse, ranked by recent ship velocity. Each card links to a full editorial trajectory and lets you pivot into a head-to-head comparison with either rgbif or rvest.
writexl
writexl spent nine years refusing to do formatting, then shipped all of it in 2.0.0.
rstanarm
rstanarm is community-maintained now, tracking Stan and lme4 rather than adding models.
taxa
taxa started a ground-up rewrite in 2021 and has published almost nothing since.
rotl
rotl's whole release history is keeping name matching honest against a moving taxonomy.
taxize
taxize spends its releases absorbing other people's API changes, one dead source at a time.
Recent activity from rgbif and rvest
Latest ship moves from both products, interleaved chronologically. ⚡ = editorial spark.
- 4mo agorgbifrgbif 3.8.5 adds occurrence download statistics functions
- 8mo agorgbifrgbif 3.8.4 moves name matching to GBIF API v2
- 11mo agorgbifrgbif 3.8.3 adds GRSciColl search, relays GBIF paging throttle
- 11mo agorvestrvest 1.0.5 fixes stale nodes after click navigation in LiveHTML
- 1y agorgbifrgbif 3.8.2 resolves download DOIs to keys
- 1y agorgbifrgbif 3.8.1 adds SQL-based occurrence downloads ⚡
- 2y agorgbifrgbif 3.8.0 soft-deprecates occ_data(), adds download describe
- 2y agorvestrvest 1.0.4 scrapes JavaScript pages via a live browser session ⚡
- 3y agorvestrvest 1.0.3 re-documents to fix .Rd HTML issues
- 4y agorvestrvest 1.0.2 returns empty tibbles for empty tables
- 5y agorvestrvest 1.0.1 parses blank rowspan and colspan as 1
- 5y agorvestrvest 1.0.0 rewrites table parsing to match browser behaviour
Frequently asked questions
What is the difference between rgbif and rvest?
They serve adjacent needs but don't currently overlap on shipped themes. rgbif and rvest are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). See the at-a-glance table above for a side-by-side breakdown of velocity, recent sparks, and editorial themes.
Is rgbif better than rvest?
Sparkpulse doesn't pick a winner — we score release velocity, not feature parity. rgbif and rvest are shipping at a similar cadence (velocity 0.0 vs 0.0, both within Sparkpulse's "active" band). For your specific use case, the alternatives sections above list other Analytics products to evaluate alongside.
What are the best alternatives to rgbif?
Top rgbif alternatives in Analytics are ranked by recent ship velocity. Browse the "rgbif alternatives" section above for the current picks, or visit /alternatives/rgbif for the full list with editorial commentary on each.
What are the best alternatives to rvest?
Top rvest alternatives in Analytics are ranked by recent ship velocity. Browse the "rvest alternatives" section above for the current picks, or visit /alternatives/rvest for the full list with editorial commentary on each.