One account. Every library.
HF Data Library · Econ Data Library · more to come
Full-coverage grouped ingest of the Bank of England IADB (Interactive statistical DataBase). Enumeration (separate step, jobs/_boe_enumerate.py) crawls the database's "Combined A to Z" category index across all facets and unions every series code it can reach -> data/raw/boe/_series_codes.json.…
Bank of England, Statistical Interactive Database. Retrieved from https://www.bankofengland.co.uk. Compiled and redistributed by the Elkassabgi Data Library.
Processing: Retrieved from the official source, normalized to a long {series_key, obs_date, value} schema (period-start dates), de-duplicated, and stored as zstd Parquet. Compiled and redistributed by the Elkassabgi Data Library.
Full-coverage grouped ingest of the Bank of England IADB (Interactive statistical DataBase). Enumeration (separate step, jobs/_boe_enumerate.py) crawls the database's "Combined A to Z" category index across all facets and unions every series code it can reach -> data/raw/boe/_series_codes.json. This job consumes that list. Pull: the IADB CSV export /boeapps/database/_iadb-fromshowcolumns.asp?csv.x=yes&SeriesCodes=<a,b,..> returns a wide CSV (a SERIES/DESCRIPTION block, then DATE,<code>,<code>,... rows) for up to ~50 series at a time over the FULL history. We request the full date range and clamp happens server-side. Grouped storage (ANTI-BLOAT): ONE Parquet per 3-character series-code PREFIX (e.g. "XUD","IUM","CFM","RPM","VPQ" ...). The 3-char prefix is the documented type+frequency family, so each file is dense and holds many series. ~37 files for the whole source (NOT one-file-per-series). Columns: series_key : BoE series code (e.g. "XUDLUSS") -- canonical series id obs_date : date32 (parsed from "02 Jan 1975") value : float64 (null where the cell is blank) Plus a sidecar <prefix>.titles.json mapping series_key -> description. License: ogl-uk-3.0 (Open Government Licence v3.0; the reservable id in configs/sources.yaml for source "boe"). Resumable: each prefix writes <prefix>.parquet + <prefix>.done (json stats); a present .done is skipped. Memory is bounded -- we process one prefix at a time and stream batches to a ParquetWriter. Usage: python jobs/ingest_boe.py --dry 3 # process 3 small prefixes, print, no commit-to-catalog python jobs/ingest_boe.py # full run (all prefixes) python jobs/ingest_boe.py --workers 6 --batch 50
{
"@context": "https://schema.org/",
"@type": "Dataset",
"name": "Bank of England",
"description": "Full-coverage grouped ingest of the Bank of England IADB (Interactive statistical DataBase). Enumeration (separate step, jobs/_boe_enumerate.py) crawls the database's \"Combined A to Z\" category index across all facets and unions every series code it can reach -> data/raw/boe/_series_codes.json.…",
"url": "https://econdatalibrary.com/boe.html",
"identifier": "boe",
"isAccessibleForFree": true,
"publisher": {
"@type": "Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"creator": {
"@type": "Organization",
"name": "Bank of England"
},
"license": "https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/",
"keywords": [
"deposit_rate",
"exchange_rate",
"gilt_yield",
"gilt_yield_real",
"lending_rate",
"monetary_aggregate",
"policy_rate",
"reference_rate",
"boe"
],
"temporalCoverage": "1975-01-02/2026-06-01",
"repeatFrequency": [
"P1D",
"P1M"
],
"creditText": "Source: Bank of England (OGL v3.0)",
"citation": "Bank of England, Statistical Interactive Database. Retrieved from https://www.bankofengland.co.uk. Compiled and redistributed by the Elkassabgi Data Library.",
"sameAs": [
"https://huggingface.co/datasets/econdatalibrary-boe",
"https://zenodo.org/communities/econdatalibrary"
],
"distribution": [
{
"@type": "DataDownload",
"encodingFormat": "text/csv",
"contentUrl": "https://econdatalibrary.com/download.html?source=boe",
"license": "https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/"
}
]
}{
"@context": {
"@language": "en",
"@vocab": "https://schema.org/",
"cr": "http://mlcommons.org/croissant/",
"data": {
"@id": "cr:data",
"@type": "@json"
},
"dataType": {
"@id": "cr:dataType",
"@type": "@vocab"
},
"sc": "https://schema.org/",
"conformsTo": "dct:conformsTo",
"dct": "http://purl.org/dc/terms/"
},
"@type": "sc:Dataset",
"conformsTo": "http://mlcommons.org/croissant/1.0",
"name": "boe",
"description": "Full-coverage grouped ingest of the Bank of England IADB (Interactive statistical DataBase). Enumeration (separate step, jobs/_boe_enumerate.py) crawls the database's \"Combined A to Z\" category index across all facets and unions every series code it can reach -> data/raw/boe/_series_codes.json.…",
"url": "https://econdatalibrary.com/boe.html",
"creator": {
"@type": "sc:Organization",
"name": "Bank of England"
},
"publisher": {
"@type": "sc:Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"license": "https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/",
"keywords": [
"deposit_rate",
"exchange_rate",
"gilt_yield",
"gilt_yield_real",
"lending_rate",
"monetary_aggregate",
"policy_rate",
"reference_rate"
],
"temporalCoverage": "1975-01-02/2026-06-01",
"citation": "Bank of England, Statistical Interactive Database. Retrieved from https://www.bankofengland.co.uk. Compiled and redistributed by the Elkassabgi Data Library.",
"distribution": [
{
"@type": "cr:FileObject",
"@id": "boe-csv",
"name": "boe-csv",
"description": "Per-series CSV, downloadable with a free API key.",
"contentUrl": "https://econdatalibrary.com/download.html?source=boe",
"encodingFormat": "text/csv"
}
]
}