One account. Every library.
HF Data Library · Econ Data Library · more to come
FULL-COVERAGE ingest of the World Bank Sovereign ESG database (API source=75). Catalog = ALL 71 ESG indicators (enumerated live from https://api.worldbank.org/v2/source/75/indicator ). For each indicator we pull EVERY economy x year via…
World Bank, Sovereign ESG Data Framework. Retrieved from https://datatopics.worldbank.org/esg. Compiled and redistributed by the Elkassabgi Data Library.
Processing: Retrieved from the official source, normalized to a long {series_key, obs_date, value} schema (period-start dates), de-duplicated, and stored as zstd Parquet. Compiled and redistributed by the Elkassabgi Data Library.
FULL-COVERAGE ingest of the World Bank Sovereign ESG database (API source=75). Catalog = ALL 71 ESG indicators (enumerated live from https://api.worldbank.org/v2/source/75/indicator ). For each indicator we pull EVERY economy x year via https://api.worldbank.org/v2/country/all/indicator/<IND>?source=75 in a single large page (per_page=20000; the largest indicator has ~15k rows). GROUPED storage (mirrors jobs/ingest_worldbank_wdi.py): ONE Parquet per indicator, all economies inside -> columns (country, obs_date, value). 71 indicators => 71 Parquet files for the whole source. No per-series files. Economy code fix: when queried with source=75 the API returns BLANK country.id / countryiso3code for the ~34 aggregate economies (World, Euro area, Sub-Saharan Africa, ...). We repair this with a name->code map built from the canonical /v2/country reference list (keys stripped of trailing spaces), so every row gets a proper WDI code (WLD, EMU, SSF, LCN, ...) exactly like the WDI bulk. License: cc-by-4.0 (reservable id from configs/sources.yaml -> worldbank_esg). Does NOT touch data/catalog.db or data/clean/ (per task constraints). Run: python jobs/ingest_worldbank_esg.py --dry # enumerate + 2 indicators, no writes python jobs/ingest_worldbank_esg.py # full run
{
"@context": "https://schema.org/",
"@type": "Dataset",
"name": "World Bank Sovereign ESG",
"description": "FULL-COVERAGE ingest of the World Bank Sovereign ESG database (API source=75). Catalog = ALL 71 ESG indicators (enumerated live from https://api.worldbank.org/v2/source/75/indicator ). For each indicator we pull EVERY economy x year via…",
"url": "https://econdatalibrary.com/worldbank_esg.html",
"identifier": "worldbank_esg",
"isAccessibleForFree": true,
"publisher": {
"@type": "Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"creator": {
"@type": "Organization",
"name": "World Bank Sovereign ESG"
},
"license": "https://creativecommons.org/licenses/by/4.0/",
"keywords": [
"Environmental",
"Governance",
"Social",
"worldbank_esg"
],
"temporalCoverage": "1960-12-31/2023-12-31",
"repeatFrequency": "P1Y",
"creditText": "Source: World Bank Sovereign ESG (CC BY 4.0)",
"citation": "World Bank, Sovereign ESG Data Framework. Retrieved from https://datatopics.worldbank.org/esg. Compiled and redistributed by the Elkassabgi Data Library.",
"sameAs": [
"https://huggingface.co/datasets/econdatalibrary-worldbank_esg",
"https://zenodo.org/communities/econdatalibrary"
],
"distribution": [
{
"@type": "DataDownload",
"encodingFormat": "text/csv",
"contentUrl": "https://econdatalibrary.com/download.html?source=worldbank_esg",
"license": "https://creativecommons.org/licenses/by/4.0/"
}
]
}{
"@context": {
"@language": "en",
"@vocab": "https://schema.org/",
"cr": "http://mlcommons.org/croissant/",
"data": {
"@id": "cr:data",
"@type": "@json"
},
"dataType": {
"@id": "cr:dataType",
"@type": "@vocab"
},
"sc": "https://schema.org/",
"conformsTo": "dct:conformsTo",
"dct": "http://purl.org/dc/terms/"
},
"@type": "sc:Dataset",
"conformsTo": "http://mlcommons.org/croissant/1.0",
"name": "worldbank_esg",
"description": "FULL-COVERAGE ingest of the World Bank Sovereign ESG database (API source=75). Catalog = ALL 71 ESG indicators (enumerated live from https://api.worldbank.org/v2/source/75/indicator ). For each indicator we pull EVERY economy x year via…",
"url": "https://econdatalibrary.com/worldbank_esg.html",
"creator": {
"@type": "sc:Organization",
"name": "World Bank Sovereign ESG"
},
"publisher": {
"@type": "sc:Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"license": "https://creativecommons.org/licenses/by/4.0/",
"keywords": [
"Environmental",
"Governance",
"Social"
],
"temporalCoverage": "1960-12-31/2023-12-31",
"citation": "World Bank, Sovereign ESG Data Framework. Retrieved from https://datatopics.worldbank.org/esg. Compiled and redistributed by the Elkassabgi Data Library.",
"distribution": [
{
"@type": "cr:FileObject",
"@id": "worldbank_esg-csv",
"name": "worldbank_esg-csv",
"description": "Per-series CSV, downloadable with a free API key.",
"contentUrl": "https://econdatalibrary.com/download.html?source=worldbank_esg",
"encodingFormat": "text/csv"
}
]
}