Worldbank Wdi

Name: Worldbank Wdi
Creator: Worldbank Wdi

Metadata onlyLicense under reviewmacro

Metadata only. This source’s license does not permit redistribution, so we catalog its metadata but do not re-serve the data. Use the provider link to obtain it under the original terms.

Coverage

Series catalogued

1,486

Temporal coverage

1960-12-31 – 2025-12-31

Frequencies

Annual

Licensing & provenance

License: License under review
Redistribution: Not permitted (metadata only)
Commercial use: Restricted / no
Modification: Permitted

How to cite

World Bank, World Development Indicators. Retrieved from https://data.worldbank.org. Compiled and redistributed by the Elkassabgi Data Library.

Processing: Retrieved from the official source, normalized to a long {series_key, obs_date, value} schema (period-start dates), de-duplicated, and stored as zstd Parquet. Compiled and redistributed by the Elkassabgi Data Library.

Access & mirrors

Download: Select & download worldbank_wdi series as CSV →
API: Get a free API key, then GET /v1/series/<id>.csv
Canonical landing: https://econdatalibrary.com/worldbank_wdi.html
Update cadence: quarterly
Update strategy: bulk snapshot if changed
Storage layout: single zstd parquet data/clean_full/worldbank_wdi/worldbank_wdi.parquet (~60 MB, ~8.9M obs), schema (series_key 'WDI:{ind}:{ctry}', obs_date date32 year-end, value float64). Written via ParquetWriter in 1M-row batches to one file. Code has a commented intent to split if >100M rows but BATCH only chunks writes, never splits files.

Full description

World Bank World Development Indicators (WDI) -- full bulk ingest. Source: https://datatopics.worldbank.org/world-development-indicators/ License: CC BY 4.0 Coverage: ~1,400 indicators × 260+ countries, 1960-present Downloads the official WDI bulk CSV ZIP from the World Bank data API, parses the wide-format WDICSV.csv into long format, and writes one Parquet file per indicator batch (to avoid millions of tiny files). series_key format: WDI:{IndicatorCode}:{CountryCode} e.g. WDI:NY.GDP.MKTP.KD:USA Output: data/clean_full/worldbank_wdi/ worldbank_wdi.parquet (all indicators concatenated) OR one parquet per indicator if total > 100M rows Run: python jobs/ingest_worldbank_wdi.py

Structured metadata

schema.org/Dataset (Google Dataset Search)

{
  "@context": "https://schema.org/",
  "@type": "Dataset",
  "name": "Worldbank Wdi",
  "description": "World Bank World Development Indicators (WDI) -- full bulk ingest. Source: https://datatopics.worldbank.org/world-development-indicators/ License: CC BY 4.0 Coverage: ~1,400 indicators × 260+ countries, 1960-present Downloads the official WDI bulk CSV ZIP from the World Bank data API, parses the…",
  "url": "https://econdatalibrary.com/worldbank_wdi.html",
  "identifier": "worldbank_wdi",
  "isAccessibleForFree": false,
  "publisher": {
    "@type": "Organization",
    "name": "Econ Data Library",
    "url": "https://econdatalibrary.com"
  },
  "creator": {
    "@type": "Organization",
    "name": "Worldbank Wdi"
  },
  "keywords": [
    "macro",
    "worldbank_wdi"
  ],
  "temporalCoverage": "1960-12-31/2025-12-31",
  "repeatFrequency": "P1Y",
  "citation": "World Bank, World Development Indicators. Retrieved from https://data.worldbank.org. Compiled and redistributed by the Elkassabgi Data Library.",
  "sameAs": [
    "https://huggingface.co/datasets/econdatalibrary-worldbank_wdi",
    "https://zenodo.org/communities/econdatalibrary"
  ],
  "usageInfo": "Metadata-only catalog entry. This source's license does not permit redistribution, so the data itself is not served here; use the provider link to obtain the data under its terms."
}

Croissant (ML-ready, schema.org JSON-LD)

{
  "@context": {
    "@language": "en",
    "@vocab": "https://schema.org/",
    "cr": "http://mlcommons.org/croissant/",
    "data": {
      "@id": "cr:data",
      "@type": "@json"
    },
    "dataType": {
      "@id": "cr:dataType",
      "@type": "@vocab"
    },
    "sc": "https://schema.org/",
    "conformsTo": "dct:conformsTo",
    "dct": "http://purl.org/dc/terms/"
  },
  "@type": "sc:Dataset",
  "conformsTo": "http://mlcommons.org/croissant/1.0",
  "name": "worldbank_wdi",
  "description": "World Bank World Development Indicators (WDI) -- full bulk ingest. Source: https://datatopics.worldbank.org/world-development-indicators/ License: CC BY 4.0 Coverage: ~1,400 indicators × 260+ countries, 1960-present Downloads the official WDI bulk CSV ZIP from the World Bank data API, parses the…",
  "url": "https://econdatalibrary.com/worldbank_wdi.html",
  "creator": {
    "@type": "sc:Organization",
    "name": "Worldbank Wdi"
  },
  "publisher": {
    "@type": "sc:Organization",
    "name": "Econ Data Library",
    "url": "https://econdatalibrary.com"
  },
  "keywords": [
    "macro"
  ],
  "temporalCoverage": "1960-12-31/2025-12-31",
  "citation": "World Bank, World Development Indicators. Retrieved from https://data.worldbank.org. Compiled and redistributed by the Elkassabgi Data Library.",
  "isAccessibleForFree": false,
  "usageInfo": "Metadata-only Croissant record; underlying data is not redistributed under this source's license."
}

Part of the Econ Data Library catalog · metadata generated 2026-07-14 from the central registry · browse all datasets