One account. Every library.
Your free ElkassabgiData key unlocks the whole family: Econ Data Library (this site) and HF Data Library — 1-minute intraday U.S. equity data — and IP Data Library — patent & innovation measures.
Full-coverage grouped ingest of Statistics Canada (WDS). Enumerates the ENTIRE cube catalog via getAllCubesListLite (~8,200 cubes), then for each cube pulls the full-table CSV bulk download (getFullTableDownloadCSV -> zip URL on www150), streams the data CSV, and writes ONE Parquet per cube.…
Statistics Canada. Reproduced and distributed on an 'as is' basis with the permission of Statistics Canada. Compiled and redistributed by the Elkassabgi Data Library.
Processing: Retrieved from Statistics Canada's Web Data Service and stored as zstd Parquet, one file per Product ID. Served at TABLE grain because the source averages 10.8 observations per series across 5.26 billion series; large tables are split on one of their own dimension columns or on the coordinate hierarchy.
Full-coverage grouped ingest of Statistics Canada (WDS). Enumerates the ENTIRE cube catalog via getAllCubesListLite (~8,200 cubes), then for each cube pulls the full-table CSV bulk download (getFullTableDownloadCSV -> zip URL on www150), streams the data CSV, and writes ONE Parquet per cube. Parquet columns (grouped, one file per productId): series_key : StatCan VECTOR id (e.g. "v41690973") -- the canonical series key obs_date : date32 (REF_DATE parsed: YYYY / YYYY-MM / YYYY-MM-DD) value : float64 (null when suppressed/"..") geo : geography label uom : unit of measure coordinate : StatCan dimension coordinate (e.g. "1.1.2") status : STATUS flag (".."=unavailable, E=use w/ caution, F=too unreliable, etc.) License: statcan-open (Statistics Canada Open Licence). Memory is bounded: zips stream to a temp file, the CSV is parsed row-by-row, and rows are flushed to the Parquet writer in batches (so even the 2 GB cube is fine). Resumable: a cube with an existing .parquet + .done marker is skipped. Usage: python jobs/ingest_statcan.py --dry 5 # enumerate + process 5 small cubes, print python jobs/ingest_statcan.py # full run (all cubes) python jobs/ingest_statcan.py --workers 6 # set concurrency (default 6)
{
"@context": "https://schema.org/",
"@type": "Dataset",
"name": "Statistics Canada",
"description": "CIMT; Period of immigration by first official language spoken, place of birth, admission category. Statistics Canada. 466,341 series, 1851–2075. Free download.",
"url": "https://econdatalibrary.com/statcan",
"identifier": "statcan",
"isAccessibleForFree": true,
"publisher": {
"@type": "Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"includedInDataCatalog": {
"@type": "DataCatalog",
"@id": "https://econdatalibrary.com/#catalog",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com/catalog"
},
"creator": {
"@type": "Organization",
"name": "Statistics Canada",
"url": "https://www150.statcan.gc.ca/"
},
"license": "Statistics Canada Open Licence",
"keywords": [
"Macroeconomics",
"statcan"
],
"temporalCoverage": "1851-12-31/2075-12-31",
"repeatFrequency": [
"P1Y",
"P1D",
"P1M",
"P3M",
"P1W"
],
"creditText": "Source: Statistics Canada. Reproduced and distributed on an 'as is' basis with the permission of Statistics Canada.",
"citation": "Statistics Canada. Reproduced and distributed on an 'as is' basis with the permission of Statistics Canada. Compiled and redistributed by the Elkassabgi Data Library.",
"sameAs": [
"https://huggingface.co/datasets/econdatalibrary-statcan",
"https://zenodo.org/communities/econdatalibrary"
],
"distribution": [
{
"@type": "DataDownload",
"name": "statcan — CSV",
"encodingFormat": "text/csv",
"contentUrl": "https://econdatalibrary.com/download.html?source=statcan"
}
]
}{
"@context": {
"@language": "en",
"@vocab": "https://schema.org/",
"cr": "http://mlcommons.org/croissant/",
"data": {
"@id": "cr:data",
"@type": "@json"
},
"dataType": {
"@id": "cr:dataType",
"@type": "@vocab"
},
"sc": "https://schema.org/",
"conformsTo": "dct:conformsTo",
"dct": "http://purl.org/dc/terms/"
},
"@type": "sc:Dataset",
"conformsTo": "http://mlcommons.org/croissant/1.0",
"name": "statcan",
"description": "CIMT; Period of immigration by first official language spoken, place of birth, admission category. Statistics Canada. 466,341 series, 1851–2075. Free download.",
"url": "https://econdatalibrary.com/statcan",
"creator": {
"@type": "sc:Organization",
"name": "Statistics Canada",
"url": "https://www150.statcan.gc.ca/"
},
"publisher": {
"@type": "sc:Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"license": "Statistics Canada Open Licence",
"keywords": [
"Macroeconomics"
],
"temporalCoverage": "1851-12-31/2075-12-31",
"citation": "Statistics Canada. Reproduced and distributed on an 'as is' basis with the permission of Statistics Canada. Compiled and redistributed by the Elkassabgi Data Library.",
"distribution": [
{
"@type": "cr:FileObject",
"@id": "statcan-csv",
"name": "statcan-csv",
"description": "Per-series CSV, downloadable with a free API key.",
"contentUrl": "https://econdatalibrary.com/download.html?source=statcan",
"encodingFormat": "text/csv"
}
]
}
One account. Every library.
Your free ElkassabgiData key unlocks the whole family: Econ Data Library (this site) and HF Data Library — 1-minute intraday U.S. equity data — and IP Data Library — patent & innovation measures.