Crawl Eurostat -- download every dataset as a gzipped TSV (CONCURRENT, the big bulk). Reads the catalogue TOC, extracts dataset/table codes, downloads each via the SDMX 2.1 dissemination API (format=TSV&compressed=true -- the `files/` bulk path is 410 Gone). Concurrent (thread pool), resumable…
Eurostat, European Commission. Retrieved from https://ec.europa.eu/eurostat. Compiled and redistributed by the Elkassabgi Data Library.
Processing: Retrieved from the official source, normalized to a long {series_key, obs_date, value} schema (period-start dates), de-duplicated, and stored as zstd Parquet. Compiled and redistributed by the Elkassabgi Data Library.
Crawl Eurostat -- download every dataset as a gzipped TSV (CONCURRENT, the big bulk). Reads the catalogue TOC, extracts dataset/table codes, downloads each via the SDMX 2.1 dissemination API (format=TSV&compressed=true -- the `files/` bulk path is 410 Gone). Concurrent (thread pool), resumable (skips files already on disk), retry/backoff on 429/5xx, logs progress. Source: Eurostat (CC BY 4.0). Carve-outs applied later at serve. Run: python jobs/fetch_eurostat_bulk.py
{
"@context": "https://schema.org/",
"@type": "Dataset",
"name": "Eurostat",
"description": "Crawl Eurostat -- download every dataset as a gzipped TSV (CONCURRENT, the big bulk). Reads the catalogue TOC, extracts dataset/table codes, downloads each via the SDMX 2.1 dissemination API (format=TSV&compressed=true -- the `files/` bulk path is 410 Gone). Concurrent (thread pool), resumable…",
"url": "https://econdatalibrary.com/eurostat.html",
"identifier": "eurostat",
"isAccessibleForFree": true,
"publisher": {
"@type": "Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"creator": {
"@type": "Organization",
"name": "Eurostat"
},
"license": "https://creativecommons.org/licenses/by/4.0/",
"keywords": [
"macro",
"eurostat"
],
"temporalCoverage": "1947-01-01/..",
"creditText": "Source: Eurostat (CC BY 4.0)",
"citation": "Eurostat, European Commission. Retrieved from https://ec.europa.eu/eurostat. Compiled and redistributed by the Elkassabgi Data Library.",
"sameAs": [
"https://huggingface.co/datasets/econdatalibrary-eurostat",
"https://zenodo.org/communities/econdatalibrary"
],
"distribution": [
{
"@type": "DataDownload",
"encodingFormat": "text/csv",
"contentUrl": "https://econdatalibrary.com/download.html?source=eurostat",
"license": "https://creativecommons.org/licenses/by/4.0/"
}
]
}{
"@context": {
"@language": "en",
"@vocab": "https://schema.org/",
"cr": "http://mlcommons.org/croissant/",
"data": {
"@id": "cr:data",
"@type": "@json"
},
"dataType": {
"@id": "cr:dataType",
"@type": "@vocab"
},
"sc": "https://schema.org/",
"conformsTo": "dct:conformsTo",
"dct": "http://purl.org/dc/terms/"
},
"@type": "sc:Dataset",
"conformsTo": "http://mlcommons.org/croissant/1.0",
"name": "eurostat",
"description": "Crawl Eurostat -- download every dataset as a gzipped TSV (CONCURRENT, the big bulk). Reads the catalogue TOC, extracts dataset/table codes, downloads each via the SDMX 2.1 dissemination API (format=TSV&compressed=true -- the `files/` bulk path is 410 Gone). Concurrent (thread pool), resumable…",
"url": "https://econdatalibrary.com/eurostat.html",
"creator": {
"@type": "sc:Organization",
"name": "Eurostat"
},
"publisher": {
"@type": "sc:Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"license": "https://creativecommons.org/licenses/by/4.0/",
"keywords": [
"macro"
],
"citation": "Eurostat, European Commission. Retrieved from https://ec.europa.eu/eurostat. Compiled and redistributed by the Elkassabgi Data Library.",
"distribution": [
{
"@type": "cr:FileObject",
"@id": "eurostat-csv",
"name": "eurostat-csv",
"description": "Per-series CSV, downloadable with a free API key.",
"contentUrl": "https://econdatalibrary.com/download.html?source=eurostat",
"encodingFormat": "text/csv"
}
]
}