Hi everyone!
There have been a lot of significant updates to the WxData Python package since my last post in here.
Background on WxData
WxData is an open-source Python package (first released in November 2025) that helps meteorologists retrieve and work with various types of weather data (both observational and model data) in Python. WxData has a medley of clients, processors, API interfaces and tools to help query data, fill in data gaps, transform data and assist users with automated workflows.
To be more specific, here are the various features in WxData 2.2:
-
14 Weather Forecast Models: GFS0P25, GFS0P50, GEFS0P25, GEFS0P50, AIGFS, AIGEFS, HGEFS, ECMWF IFS, ECMWF AIFS, ECMWF IFS Wave, ECMWF IFS Ensemble, ECMWF AIFS Ensemble, ECMWF Wave Ensemble, CFS.
-
NWS Forecasts
-
SPC Outlooks
-
CPC Outlooks
-
FEMS Fuels Data
-
METAR Observations
-
Observed Sounding Data
-
NEXRAD II Radar Data
-
2 API Interfaces (Open-Meteo & Air Now)
-
Tools to query, transform and fill gaps in weather data.
-
Tools to assist users with Python automated workflows.
What’s New?
- WxData now utilizes smart-filtering or byte-range requests which allows users to download the data for their variables of interest regardless if there is a GRIB filter present or not. This allows for faster downloads and minimizing traffic over the network.
- WxData also can retrieve data from cloud sources (AWS & Google Cloud) for datasets that exist on cloud servers. Users define which server they wish to use as a default and the WxData clients are now smart enough to rotate between the various servers if the server it initially tries to connect to (i.e. the default server) and that server is experiencing issues.
End-To-End clients with multiple servers to pull data from can find the different options for source by the table below
source='noaa' - NOAA/NCEP/NOMADS OR NOAA/NWS/FTP
source='ecmwf' - ECMWF Open-Data Server
source='aws' - Amazon Web Services (AWS)
source='google' - Google Cloud
| Client | NOAA/NCEP/NOMADS | ECMWF Open-Data | Amazon AWS | Google Cloud | NOAA/NWS/FTP |
|---|---|---|---|---|---|
| GFS0P25 | Y | N | Y | Y | N |
| GFS0P25 SECONDARY PARAMETERS | Y | N | Y | Y | N |
| GFS0P50 | Y | N | Y | Y | N |
| GEFS0P50 | Y | N | Y | Y | N |
| GEFS0P50 SECONDARY PARAMETERS | Y | N | Y | Y | N |
| GEFS0P25 | Y | N | Y | Y | N |
| ECMWF IFS | N | Y | Y | Y | N |
| ECMWF IFS Ensemble | N | Y | Y | Y | N |
| ECMWF AIFS | N | Y | Y | Y | N |
| ECMWF AIFS Ensemble | N | Y | Y | Y | N |
| ECMWF IFS Wave | N | Y | Y | Y | N |
| ECMWF IFS Wave Ensemble | N | Y | Y | Y | N |
| Get NDFD Grids | N | N | Y | N | Y |
| RTMA | Y | N | Y | N | N |
- WxData now has expansive Python interfaces for 2 major weather-related APIs: Open-Meteo and Air Now.
How To Install
Requires Python >= 3.10
Copy and paste either command into your terminal or anaconda prompt:
Install via Anaconda
conda install wxdata
OR
mamba install wxdata
Install via pip
pip install wxdata
How To Update To The Latest Version
Copy and paste either command into your terminal or anaconda prompt:
Update via Anaconda
This is for users who initially installed WxData through Anaconda
conda update wxdata
OR
mamba update wxdata
Update via pip
This is for users who initially installed WxData through pip
pip install --upgrade wxdata
Lastly, I’ve utilized GitHub Pages & GitHub Wiki features to revamp and update the WxData Documentation so it is more organized and easier for users to navigate.
Below are some useful links to both the new updated WxData documentation and the WxData GitHub repository. Feel free to check them out.
If you would like to get involved and contribute to this open-source project, please see the contributing guidelines
All Imports In WxData 2.2
"""
This file hosts all of the functions in the WxData Python library that directly interact with the user.
(C) Eric J. Drewitz 2025-2026
"""
"""
This section of functions are for users who want full wxdata functionality.
These functions do the following:
1) Scan for the latest available data.
- If the data on your local machine is not up to date, new data will download automatically.
- If the data on your local machine is up to date, new data download is bypassed.
- This is a safeguard that prevents excessive requests on the data servers.
2) Builds the wxdata directory to store the weather data files.
- Scans for the directory branch and builds the branch if it does not exist.
3) Downloads the data.
- Users can define their VPN/PROXY IP Address as a (dict) in their script and pass their
VPN/PROXY IP address into the function to avoid SSL Certificate errors when requesting data.
- Algorithm allows for up to 5 retries with a 30 second break between each retry to resolve connection
interruptions while not overburdening the data servers.
4) Pre-processes the data via filename formatting and correctly filing in the wxdata directory.
5) Post-processing by doing the following tasks:
- Remapping GRIB2 variable keys into plain language variable keys.
- Fixing dataset build errors and grouping all variables together.
- Transforms longitude from 0 to 360 degrees into -180 to 180 degrees.
- Subsetting the data to the latitude/longitude boundaries specified by the user.
- Converting temperature from kelvin to units the user wants (default is Celsius).
- Returning a post-processed xarray.array to the user.
6) Preserves system memory by doing the following:
- Deleting old data files before each new download.
- When clear_recycle_bin=True, the user's recycle bin is also cleared.
"""
# Global Forecast System (GFS)
# - GFS 0.25x0.25 Degree Primary Parameters
# - GFS 0.25x0.25 Degree Secondary Parameters
# - GFS 0.5x0.5 Degree
from wxdata.gfs.gfs import(
gfs_0p25,
gfs_0p25_secondary_parameters,
gfs_0p50
)
# AI Global Forecast System (AIGFS)
from wxdata.aigfs.aigfs import aigfs
# Hybrid Global Ensemble Forecast System (HGEFS)
from wxdata.hgefs.hgefs import hgefs_mean_spread
# Global Ensemble Forecast System (GEFS)
# - GEFS 0.5x0.5 Degree Primary Parameters
# - GEFS 0.5x0.5 Degree Secondary Parameters
# - GEFS 0.25x0.25 Degree
from wxdata.gefs.gefs import(
gefs_0p50,
gefs_0p50_secondary_parameters,
gefs_0p25
)
# Climate Forecast System (CFS)
# - CFS Flux Products
# - CFS Pressure Products
from wxdata.cfs.cfs import(
cfs_flux,
cfs_pressure
)
# AI Global Ensemble Forecast System (AIGEFS)
# - AIGEFS Pressure Members (Pressure Level Variables)
# - AIGEFS Surface Members (Surface Level Variables)
# - AIGEFS Single (AIGEFS Ensemble Mean & AIGEFS Ensemble Spread)
from wxdata.aigefs.aigefs import(
aigefs_pressure_members,
aigefs_surface_members,
aigefs_single
)
# European Centre for Medium-Range Weather Forecasts (ECMWF)
# - ECMWF IFS
# - ECMWF IFS Ensemble
# - ECMWF AIFS
# - ECMWF AIFS Ensemble
# - ECMWF IFS Wave
# - ECMWF IFS Wave Ensemble
from wxdata.ecmwf.ecmwf import(
ecmwf_ifs,
ecmwf_ifs_ens,
ecmwf_aifs,
ecmwf_aifs_ens,
ecmwf_ifs_wave,
ecmwf_ifs_wave_ens
)
# FEMS RAWS Network
# - Single Station Weather Observations
# - Single Station Fuels Observations
# - Multi Station Weather Observations
# - Multi Station Fuels Observations
# - Current Weather Observations - Multi Station
# - Current Fuels Observations - Multi Station
# - Current Weather Observations - All Stations By State
# - Current Fuels Observations - All Stations By State
# - Single Station NFDRS Forecast
# - Multi Station NFDRS Forecast
# - Single Station Weather Forecast
# - Multi Station Weather Forecast
from wxdata.fems.observations import(
get_single_raws_station_weather_observations,
get_single_raws_station_fuels_observations,
get_multi_raws_station_weather_observations,
get_multi_raws_station_fuels_observations,
get_current_multi_raws_station_weather_observations,
get_current_multi_raws_station_fuels_observations,
get_current_all_raws_station_weather_observations,
get_current_all_raws_station_fuels_observations,
get_single_raws_station_nfdrs_forecast,
get_multi_raws_station_nfdrs_forecast,
get_single_raws_station_weather_forecast,
get_multi_raws_station_weather_forecast
)
# FEMS RAWS Network
# - Single Station Meta Data
# - Multi Station Meta Data
from wxdata.fems.meta_data import(
get_single_raws_station_meta_data,
get_multi_raws_station_meta_data
)
# Real-Time Mesoscale Analysis (RTMA)
# - RTMA Latest
# - RTMA Comparison Between Two Times
from wxdata.rtma.rtma import(
rtma,
rtma_comparison
)
# NOAA
# - Storm Prediction Center Outlooks
# - Climate Prediction Center Outlooks
# - National Weather Service Forecasts
from wxdata.noaa.nws import(
get_ndfd_grids,
get_cpc_outlook
)
# Observed Upper-Air Soundings
# (University of Wyoming Database)
from wxdata.soundings.wyoming_soundings import get_observed_sounding_data
# METAR Observational Data (From NOAA)
from wxdata.metars.metar_obs import download_metar_data
# NEXRAD2 Radar Data
# - NEXRAD2 Radar Single Station
# - NEXRAD2 Radar Multi Station
from wxdata.radar.nexrad2 import(
download_current_single_station_nexrad2_radar_data,
download_current_multi_station_nexrad2_radar_data
)
"""
This section hosts all the functions and modules that involve post-processing the data.
These are the functions and modules that:
1) Re-map the GRIB2 Variable Keys into Plain Language Keys
2) Build the xarray.array of the various datasets.
"""
# Global Forecast System (GFS)
import wxdata.post_processors.gfs_post_processing as gfs_post_processing
# AI Global Forecast System (AIGFS)
import wxdata.post_processors.aigfs_post_processing as aigfs_post_processing
# Hybrid Global Ensemble Forecast System (HGEFS)
import wxdata.post_processors.hgefs_post_processing as hgefs_post_processing
# Global Ensemble Forecast System (GEFS)
import wxdata.post_processors.gefs_post_processing as gefs_post_processing
# AI Global Ensemble Forecast System (AIGEFS)
import wxdata.post_processors.aigefs_post_processing as aigefs_post_processing
# European Centre for Medium-Range Weather Forecasts (ECMWF)
import wxdata.post_processors.ecmwf_post_processing as ecmwf_post_processing
# Climate Forecast System (CFS)
import wxdata.post_processors.cfs_post_processing as cfs_post_processing
# Real-Time Mesoscale Analysis (RTMA)
from wxdata.post_processors.rtma_post_processing import process_rtma_data
"""
This section hosts the utility functions accessable to the user.
These functions provide helpful utilities when analyzing weather data.
Utility functions are geared towards the following types of users:
1) Users who want to use their own scripts to download the data however, they
would like to use the wxdata post-processing capabilities.
2) Users who want to make hemispheric graphics or any graphics where cyclic points
resolve missing data along the prime meridian or international dateline.
"""
# WxData function using cartopy to make cyclic points
# This is for users who wish to make graphics that cross the -180/180 degree longitude line
# This is commonly used for Hemispheric graphics
# Function that converts the longitude dimension in an xarray.array
# From 0 to 360 to -180 to 180
from wxdata.utils.coords import(
cyclic_point,
shift_longitude
)
# Functions to pixel query and query pixels along a line between points A and B
# Function to interpolate to n amount of points in between x and y values respectively
from wxdata.utils.tools import(
pixel_query,
line_query,
linear_anti_aliasing
)
# This function executes a list of Python scripts in the order the user lists them
from wxdata.utils.scripts import run_external_scripts
"""
This section hosts the various data clients that retrieve various types of data.
These clients can be easily configured to work on VPN/PROXY connections.
"""
# These are the wxdata HTTPS Clients with full VPN/PROXY Support
# Client List:
# - get_gridded_data()
# - get_csv_data()
# - get_excel_data()
# - get_xmacis_data()
# - get_aws_open_data()
# - byte_range_request()
import wxdata.client.client as client
"""
***************************************************************************
************ This section hosts the different API Interfaces. ***********
***************************************************************************
"""
#######################
### Open-Meteo API ###
#######################
# Open-Meteo API: https://open-meteo.com/
### Weather Forecasts ###
# - NOAA/NCEP Models
# - ECMWF Models
# - Deutscher Wetterdienst (DWD) Models
# - Meteo-France Models
# - CMC Models
# - Japan Meteorological Agency (JMA) Models
# - UK Met Office (UKMO)
# - Current Weather (Model Mosaic)
# - Google (Weather Next 2 Ensemble)
import wxdata.open_meteo_api.weather_forecasts.noaa as open_meteo_api_noaa
import wxdata.open_meteo_api.weather_forecasts.ecmwf as open_meteo_api_ecmwf
import wxdata.open_meteo_api.weather_forecasts.dwd as open_meteo_api_dwd
import wxdata.open_meteo_api.weather_forecasts.meteo_france as open_meteo_api_meteo_france
import wxdata.open_meteo_api.weather_forecasts.cmc as open_meteo_api_cmc
import wxdata.open_meteo_api.weather_forecasts.jma as open_meteo_api_jma
import wxdata.open_meteo_api.weather_forecasts.ukmo as open_meteo_api_ukmo
import wxdata.open_meteo_api.weather_forecasts.current_weather as open_meteo_api_current_weather
import wxdata.open_meteo_api.weather_forecasts.google as open_meteo_api_google
### Seasonal Forecasts (ECMWF EC46 & SEAS5) ###
# - Daily Data (EC46 & SEAS5)
# - Weekly Data (EC46)
# - Monthly Data (SEAS5)
import wxdata.open_meteo_api.seasonal_forecasts.ecmwf_daily as open_meteo_api_ecmwf_seasonal_forecasts_daily
import wxdata.open_meteo_api.seasonal_forecasts.ecmwf_weekly as open_meteo_api_ecmwf_seasonal_forecasts_weekly
import wxdata.open_meteo_api.seasonal_forecasts.ecmwf_monthly as open_meteo_api_ecmwf_seasonal_forecasts_monthly
### Climate Data ###
import wxdata.open_meteo_api.climate.climate_data as open_meteo_api_climate_data
### Air Quality Information ###
import wxdata.open_meteo_api.air_quality.cams as open_meteo_api_air_quality
### Marine Forecasts ###
# - Meteo-France
# - Deutscher Wetterdienst (DWD)
# - ECMWF
# - NOAA
import wxdata.open_meteo_api.marine_forecasts.meteo_france as open_meteo_api_meteo_france_marine
import wxdata.open_meteo_api.marine_forecasts.dwd as open_meteo_api_dwd_marine
import wxdata.open_meteo_api.marine_forecasts.ecmwf as open_meteo_api_ecmwf_marine
import wxdata.open_meteo_api.marine_forecasts.noaa as open_meteo_api_noaa_marine
### Solar Radiation Forecasts ###
import wxdata.open_meteo_api.solar_radiation.solar_radiation as open_meteo_api_solar_radiation
###################
### Air-Now API ###
###################
# Air-Now API: https://docs.airnowapi.org/
# - Observations
import wxdata.airnow_api.observations as air_now_observations