The Registry of Open Data on AWS is now available on AWS Data Exchange
All datasets on the Registry of Open Data are now discoverable on AWS Data Exchange alongside 3,000+ existing data products from category-leading data providers across industries. Explore the catalog to find open, free, and commercial data sets. Learn more about AWS Data Exchange

AI Weather Prediction (AIWP) Model Reforecasts

environmental meteorological weather

Description



This is an archive of pure AI-based weather prediction reforecasts produced collaboratively between the Cooperative Institute for Research in the Atmosphere (CIRA) and the NOAA Global Systems Laboratory (NOAA-GSL).

Currently, FourCastNetv2-small, Pangu-Weather, and GraphCast are included, with more models to come. Each of these models has been initialized with both NOAA GFS (directories with no extension) and ECMWF IFS initial conditions (directories ending in "_IFS"). The datasets are updated with near-real-time data twice per day (00Z and 12Z initializations).

FourCastNetv2-small and Pangu-Weather are available from 10/2020 to present, while GraphCast is available from 01/2022 to present. These periods are selected to avoid overlap with training and fine-tuning periods for each model. Data may be missing and is not guaranteed to be available at any given time. If there is data missing that you require, please email jacob.radford@noaa.gov.

For real-time visualizations, visit our visualizations page.

The directory structure is as follows:
s3://noaa-oar-mlwp-data/MMMM_vNNN_III/YYYY/mmdd/MMMM_vNNN_III_YYYYmmddhh_fXXX_fYYY_ZZ.nc; where
MMMM = Four character model code (FOUR, PANG, or GRAP)
NNN = Three digit version number (currently 100 or 200)
YYYY = Four digit year
mm = Two digit month
dd = Two digit day
III = Three character initial condition system (GFS)
hh = Two digit initialization time (00, 06, 12, or 18)
XXX = Three digit first forecast hour of file (currently 000 for all files)
YYY = Three digit last forecast hour of file (currently 240 for all files)
ZZ = Two digit forecast step (currently 06 for all files)

Variables available by model\:

  • FourCastNet v2-small:
    • 10-m u wind component
    • 10-m v wind component
    • 100-m u wind component
    • 100-m v wind component
    • 2-m temperature
    • Surface pressure
    • Mean sea level pressure
    • Total column integrated water vapor
    • Geopotential at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • Temperature at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • U wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • V wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • Relative humidity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
  • Pangu-Weather:
    • 10-m u wind component
    • 10-m v wind component
    • 2-m temperature
    • Mean sea level pressure
    • Geopotential at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • Temperature at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • U wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • V wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • Specific humidity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
  • GraphCast Operational:
    • 10-m u wind component
    • 10-m v wind component
    • 2-m temperature
    • Mean sea level pressure
    • Geopotential at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • Temperature at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • U wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • V wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • Specific humidity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • Vertical velocity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • 6-hr accumulated precipitation

Update Frequency

2 times a day, every 12 hours starting at midnight UTC

License

Open Data. There are no restrictions on the use of this data.

Documentation

https://noaa-oar-mlwp-data.s3.amazonaws.com/README.txt

Managed By

Dr. Jacob Radford (jacob.radford@noaa.gov)

See all datasets managed by Dr. Jacob Radford (jacob.radford@noaa.gov).

Contact

For questions regarding data availability, content, or quality, contact Dr. Jacob Radford (jacob.radford@noaa.gov). For any general questions regarding the NOAA Open Data Dissemination (NODD) Program, email the NODD Team at nodd@noaa.gov.
We also seek to identify case studies on how NOAA data is being used and will be featuring those stories in joint publications and in upcoming events. If you are interested in seeing your story highlighted, please share it with the NODD team by emailing nodd@noaa.gov

How to Cite

AI Weather Prediction (AIWP) Model Reforecasts was accessed on DATE from https://registry.opendata.aws/aiwp.

Resources on AWS

  • Description
    AIWP data
    Resource type
    S3 Bucket
    Amazon Resource Name (ARN)
    arn:aws:s3:::noaa-oar-mlwp-data
    AWS Region
    us-east-1
    AWS CLI Access (No AWS account required)
    aws s3 ls --no-sign-request s3://noaa-oar-mlwp-data/
    Explore
    Browse Bucket

Edit this dataset entry on GitHub

Tell us about your project

Home