Full-coverage grouped ingest of DeFiLlama. Writes GROUPED Parquet to data/clean_full/defillama/ -- one file per cube, each holding MANY series via a series-key column. License: defillama-open. Families (phases): catalog - protocols/chains/pools/stablecoins master lists (metadata) overview -…
DefiLlama (DeFi TVL). Retrieved from https://defillama.com. Compiled and redistributed by the Elkassabgi Data Library.
Processing: Retrieved from the official source, normalized to a long {series_key, obs_date, value} schema (period-start dates), de-duplicated, and stored as zstd Parquet. Compiled and redistributed by the Elkassabgi Data Library.
Full-coverage grouped ingest of DeFiLlama. Writes GROUPED Parquet to data/clean_full/defillama/ -- one file per cube, each holding MANY series via a series-key column. License: defillama-open. Families (phases): catalog - protocols/chains/pools/stablecoins master lists (metadata) overview - fees/revenue/dexs/options/aggregators/etc. -> ONE file per (type,dataType) holding ALL protocols' full daily history chains - per-chain historical TVL -> ONE file (chain-tvl.parquet) stablecoins- per-asset circulating history -> grouped files tvl - per-protocol TVL + chain-split history -> sharded grouped files yields - per-pool APY/TVL history -> sharded grouped files Usage: python jobs/ingest_defillama.py <phase> [--limit N] [--shard k/n] phases: catalog overview chains stablecoins tvl yields (or 'all' lists order) Anti-bloat: at most a few hundred Parquet files for the whole source. Concurrency <= 6, polite UA, retry/backoff.
{
"@context": "https://schema.org/",
"@type": "Dataset",
"name": "DeFiLlama",
"description": "Full-coverage grouped ingest of DeFiLlama. Writes GROUPED Parquet to data/clean_full/defillama/ -- one file per cube, each holding MANY series via a series-key column. License: defillama-open. Families (phases): catalog - protocols/chains/pools/stablecoins master lists (metadata) overview -…",
"url": "https://econdatalibrary.com/defillama.html",
"identifier": "defillama",
"isAccessibleForFree": true,
"publisher": {
"@type": "Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"creator": {
"@type": "Organization",
"name": "DeFiLlama"
},
"license": "defillama-open",
"keywords": [
"crypto",
"defillama"
],
"temporalCoverage": "2017-09-27/2026-06-03",
"repeatFrequency": "P1D",
"creditText": "Source: DeFiLlama",
"citation": "DefiLlama (DeFi TVL). Retrieved from https://defillama.com. Compiled and redistributed by the Elkassabgi Data Library.",
"sameAs": [
"https://huggingface.co/datasets/econdatalibrary-defillama",
"https://zenodo.org/communities/econdatalibrary"
],
"distribution": [
{
"@type": "DataDownload",
"encodingFormat": "text/csv",
"contentUrl": "https://econdatalibrary.com/download.html?source=defillama"
}
]
}{
"@context": {
"@language": "en",
"@vocab": "https://schema.org/",
"cr": "http://mlcommons.org/croissant/",
"data": {
"@id": "cr:data",
"@type": "@json"
},
"dataType": {
"@id": "cr:dataType",
"@type": "@vocab"
},
"sc": "https://schema.org/",
"conformsTo": "dct:conformsTo",
"dct": "http://purl.org/dc/terms/"
},
"@type": "sc:Dataset",
"conformsTo": "http://mlcommons.org/croissant/1.0",
"name": "defillama",
"description": "Full-coverage grouped ingest of DeFiLlama. Writes GROUPED Parquet to data/clean_full/defillama/ -- one file per cube, each holding MANY series via a series-key column. License: defillama-open. Families (phases): catalog - protocols/chains/pools/stablecoins master lists (metadata) overview -…",
"url": "https://econdatalibrary.com/defillama.html",
"creator": {
"@type": "sc:Organization",
"name": "DeFiLlama"
},
"publisher": {
"@type": "sc:Organization",
"name": "Econ Data Library",
"url": "https://econdatalibrary.com"
},
"license": "defillama-open",
"keywords": [
"crypto"
],
"temporalCoverage": "2017-09-27/2026-06-03",
"citation": "DefiLlama (DeFi TVL). Retrieved from https://defillama.com. Compiled and redistributed by the Elkassabgi Data Library.",
"distribution": [
{
"@type": "cr:FileObject",
"@id": "defillama-csv",
"name": "defillama-csv",
"description": "Per-series CSV, downloadable with a free API key.",
"contentUrl": "https://econdatalibrary.com/download.html?source=defillama",
"encodingFormat": "text/csv"
}
]
}