NOAA NCEI / Climate Data Online

Name: NOAA NCEI / Climate Data Online
Creator: NOAA NCEI / Climate Data Online
License: https://www.usa.gov/government-works

Open · redistributedU.S. Government Work (public domain)climate

Redistributable. This source is served as canonical Parquet under the license below, with attribution and provenance preserved.

Coverage

Series catalogued

Temporal coverage

1990-01-01 – 2026-04-01

Frequencies

Monthly

Distinct geographies

Licensing & provenance

License: U.S. Government Work (public domain)
License URL: https://www.usa.gov/government-works
Required attribution: Source: NOAA (public domain)
Redistribution: Permitted (served here)
Commercial use: Yes
Modification: Permitted

How to cite

NOAA National Centers for Environmental Information (GHCN). Retrieved from https://www.ncei.noaa.gov. Compiled and redistributed by the Elkassabgi Data Library.

Processing: Retrieved from the official source, normalized to a long {series_key, obs_date, value} schema (period-start dates), de-duplicated, and stored as zstd Parquet. Compiled and redistributed by the Elkassabgi Data Library.

Access & mirrors

Download: Select & download noaa series as CSV →
API: Get a free API key, then GET /v1/series/<id>.csv
Canonical landing: https://econdatalibrary.com/noaa.html
Update cadence: monthly
Update strategy: bulk snapshot if changed
Storage layout: overwrite-multi-file, grouped by 2-char GHCN country/network prefix: data/clean_full/noaa/<ds>__<PREFIX>.parquet (obs) + <ds>__<PREFIX>__series.parquet (series meta sidecar), ds in {gsom,gsoy}. ~834 parquet files total currently; ~552M obs (COVERAGE LARGE). Obs schema: dataset, station, series_key ('<station>:<element>'), obs_date (date32), element, value (float64), attributes. Raw cache: data/raw/noaa/{gsom,gsoy}/*.csv (~214K station CSVs), plus _manifest.json, _<ds>_failures.json, station_ids.txt, doc/ghcnd-stations.txt.

Full description

Full-coverage ingest of NOAA NCEI GSOM + GSOY climate summaries. Source: NOAA NCEI bulk archive GSOM (Global Summary of the Month): https://www.ncei.noaa.gov/data/gsom/access/ GSOY (Global Summary of the Year): https://www.ncei.noaa.gov/data/gsoy/access/ License: us-public-domain. Attribution: "Source: NOAA (public domain)". The bulk archive publishes ONE wide CSV per weather station (STATION, DATE, LATITUDE, LONGITUDE, ELEVATION, NAME, then ~55 climate elements each paired with an <ELEM>_ATTRIBUTES column). Counts (enumerated 2026-06): GSOM: 127,905 station CSVs GSOY: 86,018 station CSVs GROUPED storage (anti-bloat -- NEVER one file per station): We melt each wide CSV to LONG form (dataset, station, series_key, obs_date, element, value, attributes) and accumulate rows into SHARDS keyed by the 2-char GHCN country/network prefix of the station id (US, AS, CA, ...). Output: data/clean_full/noaa/gsom__<PREFIX>.parquet (obs, many stations) data/clean_full/noaa/gsom__<PREFIX>__series.parquet (series meta) ~250 prefixes x 2 datasets + sidecars => a few hundred files total. series_key = "<station>:<element>" (one series per station x element). Stages (resumable): --enumerate (re)fetch the station-id manifests + station metadata --download fetch every station CSV (skips files already on disk) --build parse raw CSVs -> grouped long parquet shards + verify --verify re-read shards and print obs/series/coverage report Default (no flag) = --build. Usage: python jobs/ingest_noaa.py --download python jobs/ingest_noaa.py --download --dataset gsoy --workers 6 python jobs/ingest_noaa.py --build python jobs/ingest_noaa.py --verify

Structured metadata

schema.org/Dataset (Google Dataset Search)

{
  "@context": "https://schema.org/",
  "@type": "Dataset",
  "name": "NOAA NCEI / Climate Data Online",
  "description": "Full-coverage ingest of NOAA NCEI GSOM + GSOY climate summaries. Source: NOAA NCEI bulk archive GSOM (Global Summary of the Month): https://www.ncei.noaa.gov/data/gsom/access/ GSOY (Global Summary of the Year): https://www.ncei.noaa.gov/data/gsoy/access/ License: us-public-domain. Attribution:…",
  "url": "https://econdatalibrary.com/noaa.html",
  "identifier": "noaa",
  "isAccessibleForFree": true,
  "publisher": {
    "@type": "Organization",
    "name": "Econ Data Library",
    "url": "https://econdatalibrary.com"
  },
  "creator": {
    "@type": "Organization",
    "name": "NOAA NCEI / Climate Data Online"
  },
  "license": "https://www.usa.gov/government-works",
  "keywords": [
    "climate",
    "noaa"
  ],
  "temporalCoverage": "1990-01-01/2026-04-01",
  "repeatFrequency": "P1M",
  "citation": "NOAA National Centers for Environmental Information (GHCN). Retrieved from https://www.ncei.noaa.gov. Compiled and redistributed by the Elkassabgi Data Library.",
  "sameAs": [
    "https://huggingface.co/datasets/econdatalibrary-noaa",
    "https://zenodo.org/communities/econdatalibrary"
  ],
  "distribution": [
    {
      "@type": "DataDownload",
      "encodingFormat": "text/csv",
      "contentUrl": "https://econdatalibrary.com/download.html?source=noaa",
      "license": "https://www.usa.gov/government-works"
    }
  ]
}

Croissant (ML-ready, schema.org JSON-LD)

{
  "@context": {
    "@language": "en",
    "@vocab": "https://schema.org/",
    "cr": "http://mlcommons.org/croissant/",
    "data": {
      "@id": "cr:data",
      "@type": "@json"
    },
    "dataType": {
      "@id": "cr:dataType",
      "@type": "@vocab"
    },
    "sc": "https://schema.org/",
    "conformsTo": "dct:conformsTo",
    "dct": "http://purl.org/dc/terms/"
  },
  "@type": "sc:Dataset",
  "conformsTo": "http://mlcommons.org/croissant/1.0",
  "name": "noaa",
  "description": "Full-coverage ingest of NOAA NCEI GSOM + GSOY climate summaries. Source: NOAA NCEI bulk archive GSOM (Global Summary of the Month): https://www.ncei.noaa.gov/data/gsom/access/ GSOY (Global Summary of the Year): https://www.ncei.noaa.gov/data/gsoy/access/ License: us-public-domain. Attribution:…",
  "url": "https://econdatalibrary.com/noaa.html",
  "creator": {
    "@type": "sc:Organization",
    "name": "NOAA NCEI / Climate Data Online"
  },
  "publisher": {
    "@type": "sc:Organization",
    "name": "Econ Data Library",
    "url": "https://econdatalibrary.com"
  },
  "license": "https://www.usa.gov/government-works",
  "keywords": [
    "climate"
  ],
  "temporalCoverage": "1990-01-01/2026-04-01",
  "citation": "NOAA National Centers for Environmental Information (GHCN). Retrieved from https://www.ncei.noaa.gov. Compiled and redistributed by the Elkassabgi Data Library.",
  "distribution": [
    {
      "@type": "cr:FileObject",
      "@id": "noaa-csv",
      "name": "noaa-csv",
      "description": "Per-series CSV, downloadable with a free API key.",
      "contentUrl": "https://econdatalibrary.com/download.html?source=noaa",
      "encodingFormat": "text/csv"
    }
  ]
}

Part of the Econ Data Library catalog · metadata generated 2026-07-14 from the central registry · browse all datasets