One account. Every library.
HF Data Library · Econ Data Library · more to come
Full-coverage grouped ingest of ILOSTAT (International Labour Organization). ILOSTAT exposes every indicator through the rplumber bulk API: - TOC of ALL indicators: /metadata/toc/indicator (1,947 indicator-frequency datasets) - bulk data per indicator: /data/indicator?id=<ID>&format=.parquet Each…
International Labour Organization, ILOSTAT. Retrieved from https://ilostat.ilo.org. Compiled and redistributed by the Elkassabgi Data Library.
Processing: Retrieved from the official source, normalized to a long {series_key, obs_date, value} schema (period-start dates), de-duplicated, and stored as zstd Parquet. Compiled and redistributed by the Elkassabgi Data Library.
Full-coverage grouped ingest of ILOSTAT (International Labour Organization). ILOSTAT exposes every indicator through the rplumber bulk API: - TOC of ALL indicators: /metadata/toc/indicator (1,947 indicator-frequency datasets) - bulk data per indicator: /data/indicator?id=<ID>&format=.parquet Each "id" is an indicator+frequency code (e.g. SDG_0111_SEX_AGE_RT_A, the trailing _A/_Q/_M is the frequency). A single bulk pull returns every country / sex / classification / source combination for that indicator -- the full long-format table whose row count equals the TOC's n.records (best_source=yes). We write ONE grouped Parquet per indicator-id to data/clean_full/ilostat/<id>.parquet: columns: series_key, ref_area, source, sex, classif1, classif2, obs_date (date32), time (orig period string), value, obs_status series_key = ilostat:<indicator>:<ref_area>:<sex>:<classif1>:<classif2>:<source> (empty dimension segments collapse, so e.g. ilostat:SDG_0552_NOC_RT:AGO::::BA:13951). license: cc-by-4.0 (configs/sources.yaml -> ilostat). A run manifest (data/raw/ilostat/_manifest.csv) records per-id status + rows so the run is idempotent (re-running skips completed ids) and verifiable against the TOC. Usage: python jobs/ingest_ilostat.py --toc # (re)download the indicator TOC only python jobs/ingest_ilostat.py --dry 5 # parse 5 ids, print, no writes python jobs/ingest_ilostat.py # full run (all 1,947 ids) python jobs/ingest_ilostat.py --workers 6 # set concurrency (default 6)
{
"@context": "https://schema.org/",
"@type": "Dataset",
"name": "ILOSTAT",
"description": "Full-coverage grouped ingest of ILOSTAT (International Labour Organization). ILOSTAT exposes every indicator through the rplumber bulk API: - TOC of ALL indicators: /metadata/toc/indicator (1,947 indicator-frequency datasets) - bulk data per indicator: /data/indicator?id=<ID>&format=.parquet Each…",
"url": "https://econdatalibrary.com/ilostat.html",
"identifier": "ilostat",
"isAccessibleForFree": true,
"publisher": {
"@type": "Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"creator": {
"@type": "Organization",
"name": "ILOSTAT"
},
"license": "https://creativecommons.org/licenses/by/4.0/",
"keywords": [
"labour",
"ilostat"
],
"temporalCoverage": "1947-12-31/2025-12-31",
"repeatFrequency": "P1Y",
"creditText": "Source: ILOSTAT (CC BY 4.0)",
"citation": "International Labour Organization, ILOSTAT. Retrieved from https://ilostat.ilo.org. Compiled and redistributed by the Elkassabgi Data Library.",
"sameAs": [
"https://huggingface.co/datasets/econdatalibrary-ilostat",
"https://zenodo.org/communities/econdatalibrary"
],
"distribution": [
{
"@type": "DataDownload",
"encodingFormat": "text/csv",
"contentUrl": "https://econdatalibrary.com/download.html?source=ilostat",
"license": "https://creativecommons.org/licenses/by/4.0/"
}
]
}{
"@context": {
"@language": "en",
"@vocab": "https://schema.org/",
"cr": "http://mlcommons.org/croissant/",
"data": {
"@id": "cr:data",
"@type": "@json"
},
"dataType": {
"@id": "cr:dataType",
"@type": "@vocab"
},
"sc": "https://schema.org/",
"conformsTo": "dct:conformsTo",
"dct": "http://purl.org/dc/terms/"
},
"@type": "sc:Dataset",
"conformsTo": "http://mlcommons.org/croissant/1.0",
"name": "ilostat",
"description": "Full-coverage grouped ingest of ILOSTAT (International Labour Organization). ILOSTAT exposes every indicator through the rplumber bulk API: - TOC of ALL indicators: /metadata/toc/indicator (1,947 indicator-frequency datasets) - bulk data per indicator: /data/indicator?id=<ID>&format=.parquet Each…",
"url": "https://econdatalibrary.com/ilostat.html",
"creator": {
"@type": "sc:Organization",
"name": "ILOSTAT"
},
"publisher": {
"@type": "sc:Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"license": "https://creativecommons.org/licenses/by/4.0/",
"keywords": [
"labour"
],
"temporalCoverage": "1947-12-31/2025-12-31",
"citation": "International Labour Organization, ILOSTAT. Retrieved from https://ilostat.ilo.org. Compiled and redistributed by the Elkassabgi Data Library.",
"distribution": [
{
"@type": "cr:FileObject",
"@id": "ilostat-csv",
"name": "ilostat-csv",
"description": "Per-series CSV, downloadable with a free API key.",
"contentUrl": "https://econdatalibrary.com/download.html?source=ilostat",
"encodingFormat": "text/csv"
}
]
}