FULL-COVERAGE ingest of the U.S. Federal Reserve Board Data Download Program (DDP). Source: https://www.federalreserve.gov/datadownload/ -- the Fed's bulk-download facility. For EVERY statistical release the DDP publishes a single ZIP package containing the entire release as one SDMX-compact XML…
Board of Governors of the Federal Reserve System (US). Retrieved from https://www.federalreserve.gov. Compiled and redistributed by the Elkassabgi Data Library.
Processing: Retrieved from the official source, normalized to a long {series_key, obs_date, value} schema (period-start dates), de-duplicated, and stored as zstd Parquet. Compiled and redistributed by the Elkassabgi Data Library.
FULL-COVERAGE ingest of the U.S. Federal Reserve Board Data Download Program (DDP). Source: https://www.federalreserve.gov/datadownload/ -- the Fed's bulk-download facility. For EVERY statistical release the DDP publishes a single ZIP package containing the entire release as one SDMX-compact XML file: https://www.federalreserve.gov/datadownload/Output.aspx?rel=<REL>&filetype=zip The 18 releases that exist (enumerated from the DDP home page's Choose.aspx?rel= links on 2026-06-03): CHGDEL CP DSR E2 FOR G17 G19 G20 H10 H15 H3 H41 H6 H8 PRATES SCOOS SLOOS Z1 SDMX layout (compact schema): <frb:DataSet id="..."> <kf:Series SERIES_NAME="..." FREQ="9" UNIT="..." ...dimension attrs...> <frb:Annotations>... Short/Long Description ...</frb:Annotations> <frb:Obs OBS_STATUS="A" OBS_VALUE="1.13" TIME_PERIOD="1954-07-01"/> ... </kf:Series> </frb:DataSet> A release may contain several DataSets (e.g. CP -> RATES/VOL/OUTST...; G17 -> 14 IP_* cubes). SERIES_NAME is unique within a DataSet but can repeat ACROSS DataSets in the same release, so the unique series key is (dataset, series_name). OBS_STATUS="ND" with OBS_VALUE="-9999" means "no data published" -> skipped. GROUPED storage (mirrors jobs/ingest_eurostat.py / ingest_bls.py): ONE Parquet per RELEASE -> data/clean_full/fed_board/<REL>.parquet with a `dataset` + `series_key` column inside (NOT one file per series). A sidecar <REL>__series.parquet holds one metadata row per series (freq, unit, descriptions, full dimension dict as JSON). Memory is bounded via lxml.iterparse with el.clear() and row-group batch flushing -- essential for Z.1 (590 MB XML, ~40k series). License: us-public-domain (configs/sources.yaml -> fed_board). Usage: python jobs/ingest_fed_board.py --probe # parse 3 small releases, no big ones python jobs/ingest_fed_board.py --only H15,Z1 # one/few releases python jobs/ingest_fed_board.py # full run (all 18 releases) python jobs/ingest_fed_board.py --skip-download # reuse already-downloaded ZIPs python jobs/ingest_fed_board.py --force # ignore resume sidecars, redo
{
"@context": "https://schema.org/",
"@type": "Dataset",
"name": "Federal Reserve Board (H.15 etc.)",
"description": "FULL-COVERAGE ingest of the U.S. Federal Reserve Board Data Download Program (DDP). Source: https://www.federalreserve.gov/datadownload/ -- the Fed's bulk-download facility. For EVERY statistical release the DDP publishes a single ZIP package containing the entire release as one SDMX-compact XML…",
"url": "https://econdatalibrary.com/fed_board.html",
"identifier": "fed_board",
"isAccessibleForFree": true,
"publisher": {
"@type": "Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"creator": {
"@type": "Organization",
"name": "Federal Reserve Board (H.15 etc.)"
},
"license": "https://www.usa.gov/government-works",
"keywords": [
"policy_rate",
"reference_rate",
"treasury_bill",
"treasury_cmt",
"treasury_tips",
"fed_board"
],
"temporalCoverage": "1954-01-04/2026-06-01",
"repeatFrequency": "P1D",
"citation": "Board of Governors of the Federal Reserve System (US). Retrieved from https://www.federalreserve.gov. Compiled and redistributed by the Elkassabgi Data Library.",
"sameAs": [
"https://huggingface.co/datasets/econdatalibrary-fed_board",
"https://zenodo.org/communities/econdatalibrary"
],
"distribution": [
{
"@type": "DataDownload",
"encodingFormat": "text/csv",
"contentUrl": "https://econdatalibrary.com/download.html?source=fed_board",
"license": "https://www.usa.gov/government-works"
}
]
}{
"@context": {
"@language": "en",
"@vocab": "https://schema.org/",
"cr": "http://mlcommons.org/croissant/",
"data": {
"@id": "cr:data",
"@type": "@json"
},
"dataType": {
"@id": "cr:dataType",
"@type": "@vocab"
},
"sc": "https://schema.org/",
"conformsTo": "dct:conformsTo",
"dct": "http://purl.org/dc/terms/"
},
"@type": "sc:Dataset",
"conformsTo": "http://mlcommons.org/croissant/1.0",
"name": "fed_board",
"description": "FULL-COVERAGE ingest of the U.S. Federal Reserve Board Data Download Program (DDP). Source: https://www.federalreserve.gov/datadownload/ -- the Fed's bulk-download facility. For EVERY statistical release the DDP publishes a single ZIP package containing the entire release as one SDMX-compact XML…",
"url": "https://econdatalibrary.com/fed_board.html",
"creator": {
"@type": "sc:Organization",
"name": "Federal Reserve Board (H.15 etc.)"
},
"publisher": {
"@type": "sc:Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"license": "https://www.usa.gov/government-works",
"keywords": [
"policy_rate",
"reference_rate",
"treasury_bill",
"treasury_cmt",
"treasury_tips"
],
"temporalCoverage": "1954-01-04/2026-06-01",
"citation": "Board of Governors of the Federal Reserve System (US). Retrieved from https://www.federalreserve.gov. Compiled and redistributed by the Elkassabgi Data Library.",
"distribution": [
{
"@type": "cr:FileObject",
"@id": "fed_board-csv",
"name": "fed_board-csv",
"description": "Per-series CSV, downloadable with a free API key.",
"contentUrl": "https://econdatalibrary.com/download.html?source=fed_board",
"encodingFormat": "text/csv"
}
]
}