USDA NASS + ERS

Name: USDA NASS + ERS
Creator: USDA NASS + ERS
License: https://www.usa.gov/government-works

Open · redistributedU.S. Government Work (public domain)AgricultureAgriculture & Food

Redistributable. This source is served as canonical Parquet under the license below, with attribution and provenance preserved.

Coverage

Series catalogued

69,704

Temporal coverage

1850-12-31 – 2026-12-31

Distinct geographies

Licensing & provenance

License: U.S. Government Work (public domain)
License URL: https://www.usa.gov/government-works
Required attribution: Source: USDA (public domain)
Redistribution: Permitted (served here)
Commercial use: Yes
Modification: Permitted

How to cite

U.S. Department of Agriculture, National Agricultural Statistics Service, Quick Stats. Compiled and redistributed by the Elkassabgi Data Library.

Processing: Retrieved from USDA NASS Quick Stats and stored as zstd Parquet. Served at TABLE grain — one CSV per (source, aggregation level, measure) — because the source averages 3.7 observations per series. Each row carries its location, domain category and reference period, so a forecast vintage is distinguishable from a final estimate.

Access & mirrors

Download: Select & download usda series as CSV →
API: Get a free API key, then GET /v1/series/<id>.csv
Canonical landing: https://econdatalibrary.com/usda
Update cadence: monthly
Automated refresh: live — this database is on the daily update run
Update strategy: bulk snapshot if changed
Storage layout: per-cube directory of rolling part files: data/clean_full/usda/<cube>/part_NNN.parquet (each capped at PART_ROWS=1,000,000 rows, flushed in BATCH_ROWS=200k row-groups, zstd) plus a per-cube '_complete' sentinel; cubes = animals_products, crops (25 parts), demographics, economics, environmental. Plus _manifest.json (source_id, license, per-cube rows/series, totals: 57,629,841 rows / 15,534,339 series). Wide schema: series_key + ~31 self-describing NASS dimension columns + obs_date(date32) + value(float64) + value_flag(string). series_key = 'usda:' + pipe-joined KEY_COLS.

Full description

Grouped ingest of USDA NASS Quick Stats bulk files (FULL coverage). Source of truth: the Quick Stats bulk .txt.gz dumps at https://www.nass.usda.gov/datasets/ -- these are the ENTIRE Quick Stats database (every survey + census observation, national/state/county/district/ watershed/zip), far more complete than per-series api_GET calls. Storage pattern (mirrors ingest_eurostat / ingest_sec_edgar): ONE Parquet per "cube" = per bulk file group: crops, animals_products, demographics, economics, environmental, census2002, census2007, census2007zipcode, census2012, census2017, census2017zipcode, census2022 Each Parquet has a `series_key` column (a stable composite id) plus the full set of self-describing NASS dimension columns, obs_date, value, raw value flags, and the time descriptors. Written in streamed row-group batches so memory stays bounded even for the >100M-row crops cube. License: us-public-domain (USDA NASS Quick Stats is U.S. public domain). Usage: python jobs/ingest_usda.py --probe qs.crops_20260603.txt.gz # profile one file python jobs/ingest_usda.py --dry # parse all, no writes (counts only) python jobs/ingest_usda.py # full run -> Parquet

Structured metadata

schema.org/Dataset (Google Dataset Search)

{
  "@context": "https://schema.org/",
  "@type": "Dataset",
  "name": "USDA NASS + ERS",
  "description": "U.S. agricultural statistics — crop production and values by commodity (USDA NASS). USDA NASS + ERS. 69,704 series, 1850–2026. Free download.",
  "url": "https://econdatalibrary.com/usda",
  "identifier": "usda",
  "isAccessibleForFree": true,
  "publisher": {
    "@type": "Organization",
    "name": "Econ Data Library",
    "url": "https://econdatalibrary.com"
  },
  "includedInDataCatalog": {
    "@type": "DataCatalog",
    "@id": "https://econdatalibrary.com/#catalog",
    "name": "Econ Data Library",
    "url": "https://econdatalibrary.com/catalog"
  },
  "creator": {
    "@type": "Organization",
    "name": "USDA NASS + ERS"
  },
  "license": "https://www.usa.gov/government-works",
  "keywords": [
    "Agriculture",
    "Agriculture & Food",
    "usda"
  ],
  "temporalCoverage": "1850-12-31/2026-12-31",
  "citation": "U.S. Department of Agriculture, National Agricultural Statistics Service, Quick Stats. Compiled and redistributed by the Elkassabgi Data Library.",
  "sameAs": [
    "https://huggingface.co/datasets/econdatalibrary-usda",
    "https://zenodo.org/communities/econdatalibrary"
  ],
  "distribution": [
    {
      "@type": "DataDownload",
      "name": "usda — CSV",
      "encodingFormat": "text/csv",
      "contentUrl": "https://econdatalibrary.com/download.html?source=usda",
      "license": "https://www.usa.gov/government-works"
    }
  ]
}

Croissant (ML-ready, schema.org JSON-LD)

{
  "@context": {
    "@language": "en",
    "@vocab": "https://schema.org/",
    "cr": "http://mlcommons.org/croissant/",
    "data": {
      "@id": "cr:data",
      "@type": "@json"
    },
    "dataType": {
      "@id": "cr:dataType",
      "@type": "@vocab"
    },
    "sc": "https://schema.org/",
    "conformsTo": "dct:conformsTo",
    "dct": "http://purl.org/dc/terms/"
  },
  "@type": "sc:Dataset",
  "conformsTo": "http://mlcommons.org/croissant/1.0",
  "name": "usda",
  "description": "U.S. agricultural statistics — crop production and values by commodity (USDA NASS). USDA NASS + ERS. 69,704 series, 1850–2026. Free download.",
  "url": "https://econdatalibrary.com/usda",
  "creator": {
    "@type": "sc:Organization",
    "name": "USDA NASS + ERS"
  },
  "publisher": {
    "@type": "sc:Organization",
    "name": "Econ Data Library",
    "url": "https://econdatalibrary.com"
  },
  "license": "https://www.usa.gov/government-works",
  "keywords": [
    "Agriculture",
    "Agriculture & Food"
  ],
  "temporalCoverage": "1850-12-31/2026-12-31",
  "citation": "U.S. Department of Agriculture, National Agricultural Statistics Service, Quick Stats. Compiled and redistributed by the Elkassabgi Data Library.",
  "distribution": [
    {
      "@type": "cr:FileObject",
      "@id": "usda-csv",
      "name": "usda-csv",
      "description": "Per-series CSV, downloadable with a free API key.",
      "contentUrl": "https://econdatalibrary.com/download.html?source=usda",
      "encodingFormat": "text/csv"
    }
  ]
}

Part of the Econ Data Library catalog · metadata generated 2026-08-02 from the central registry · browse all datasets