Curated datasets at data.rmorie.com — morie_hosted

The MORIE project keeps 160 databases materialised from Google BigQuery public datasets, plus the Health Infobase tables and the OTIS research files, public datasets (Chicago crime, EPA air quality, US census, FEC, FDA, NOAA, NHTSA, Hacker News, Ethereum, World Bank, ...) and serves their tables from the edge. They open with the data key morie_llm_login stores; a downloaded table is used only when it matches the SHA-256 the manifest lists for it. The ICPSR, NCVS 38604 and a2aj tables also need their terms accepted at https://data.rmorie.com/terms. morie_hosted_manifest() returns the gateway's manifest (every table with rows, columns, size, SHA-256 and its BigQuery source), cached for a day; morie_hosted_datasets() the same as a data frame; morie_load_hosted_dataset("db/table") one table, cached in the dataset store so later calls are local. morie_load_dataset and rmorie pull accept the same db/table keys.

Usage

morie_hosted_manifest(refresh = FALSE)

morie_hosted_datasets(refresh = FALSE)

morie_load_hosted_dataset(key, db_path = NULL, refresh = FALSE)

Arguments

refresh: Fetch again even when a day-old copy is cached.
key: A db/table key from the manifest.
db_path: Dataset-store path, as in morie_load_dataset.

Value

morie_hosted_manifest(): a list; morie_hosted_datasets(): a data frame with key, name, rows, source; morie_load_hosted_dataset(): the table as a data frame.

Examples

# \donttest{
# with a stored MORIE key (rmorie login); without one this stops with that advice
try({
  head(morie_hosted_datasets())
  df <- morie_load_hosted_dataset("fec_cm_2020/fec_cm_2020")
})
#> Error : the curated tables need your MORIE data key: sign in with `rmorie login` (GitHub, or --email ADDRESS for a code), or ask for a key at https://rmorie.com/access; store one you hold with `rmorie login --token` (R: morie_llm_login(token = )).
# }