NEXRAD on AWS

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/noaa-nexrad-dataset")

fs.listdir("s3://noaa-nexrad-level2")

Description:

Real-time and archival data from the Next Generation Weather Radar (NEXRAD) network.

Contact:

Real-time and archival data from the Next Generation Weather Radar (NEXRAD) network.

Update Frequency:

New Level II data is added as soon as it is available.

Managed By:

https://www.unidata.ucar.edu/

Collabs:

• ASDI:
  • Tags: weather

Resources:

1. resource:

   • Description: NEXRAD Level II archive data
   • ARN: arn:aws:s3:::noaa-nexrad-level2
   • Region: us-east-1
   • Type: S3 Bucket
   • Explore: Browse Bucket

2. resource:

   • Description: NEXRAD Level II real-time data
   • ARN: arn:aws:s3:::unidata-nexrad-level2-chunks
   • Region: us-east-1
   • Type: S3 Bucket

3. resource:

   • Description: NEXRAD Level III real-time select data
   • ARN: arn:aws:s3:::unidata-nexrad-level3
   • Region: us-east-1
   • Type: S3 Bucket
   • Explore: Browse Bucket

4. resource:

   • Description: Rich notifications for real-time data with filterable fields
   • ARN: arn:aws:sns:us-east-1:684042711724:NewNEXRADLevel2ObjectFilterable
   • Region: us-east-1
   • Type: SNS Topic

5. resource:

   • Description: Notifications for the Level II archival bucket
   • ARN: arn:aws:sns:us-east-1:811054952067:NewNEXRADLevel2Archive
   • Region: us-east-1
   • Type: SNS Topic

6. resource:

   • Description: Notifications for the Level III bucket
   • ARN: arn:aws:sns:us-east-1:684042711724:NewNEXRADLevel3Object
   • Region: us-east-1
   • Type: SNS Topic

Tags:

aws-pds, agriculture, earth observation, natural resource, weather, meteorological, sustainability

Tutorials:

1. tutorial:

   • Title: Using Python to Access NCEI Archived NEXRAD Level 2 Data (Jupyter notebook)
   • URL: http://nbviewer.jupyter.org/gist/dopplershift/356f2e14832e9b676207
   • AuthorName: Ryan May
   • AuthorURL: http://dopplershift.github.io

2. tutorial:

   • Title: Mapping Noaa Nexrad Radar Data With CARTO
   • URL: https://carto.com/blog/mapping-nexrad-radar-data/
   • AuthorName: Stuart Lynn
   • AuthorURL: https://carto.com/blog/author/stuart-lynn/

3. tutorial:

   • Title: NEXRAD on EC2 tutorial
   • URL: https://github.com/openradar/AMS_radar_in_the_cloud
   • AuthorName: openradar
   • AuthorURL: https://github.com/openradar
   • Services: EC2

4. tutorial:

   • Title: Get NEXRAD data from AWS, get severe reports from SPC archive, and plot a loop of them
   • URL: https://github.com/russ-schumacher/ats641_spring2022/blob/master/example_notebooks/pyart_nexrad_maps_reports.ipynb
   • AuthorName: Russ Schumacher
   • AuthorURL: https://www.atmos.colostate.edu/people/faculty/schumacher/

5. tutorial:

   • Title: Updated introduction to S3, Boto, and NOAA Nexrad in SageMaker Studio Lab (SMSL)
   • URL: https://github.com/aws-samples/aws-nexrad-smsl-notebook/
   • NotebookURL: https://github.com/aws-samples/aws-nexrad-smsl-notebook/blob/main/Nexrad_Demo.ipynb
   • AuthorName: Chris Stoner
   • Services: SageMaker Studio Lab

Tools & Applications:

1. tools & applications:

   • Title: nexradaws on pypi.python.org - python module to query and download Nexrad data from Amazon S3
   • URL: https://pypi.org/project/nexradaws/
   • AuthorName: Aaron Anderson
   • AuthorURL: https://github.com/aarande

2. tools & applications:

   • Title: WeatherPipe - Amazon EMR based analysis tool for NEXRAD data stored on Amazon S3
   • URL: https://github.com/stephenlienharrell/WeatherPipe
   • AuthorName: Stephen Lien Harrell
   • AuthorURL: https://github.com/stephenlienharrell

3. tools & applications:

   • Title: Open NEXRAD Data Access for Level 3 with Lambda@Edge
   • URL: https://github.com/zflamig/ondas-pds
   • AuthorName: Zac Flamig

4. tools & applications:

   • Title: Into the eye of the storm: NEXRAD Level II open data
   • URL: https://blog.mapbox.com/3d-animated-hurricane-map-from-radar-data-affaed8a3d70
   • AuthorName: Jonni Walker

Publication:

1. publication:

   • Title: Level 2 Interface Control Document for Transfer: Build 18
   • URL: https://www.roc.noaa.gov/wsr88d/PublicDocs/ICDs/2620010G.pdf
   • AuthorName: NOAA ROC

2. publication:

   • Title: Level 2 Interface Control Document for Message Data Formats: Build 18
   • URL: https://www.roc.noaa.gov/wsr88d/PublicDocs/ICDs/2620002R.pdf
   • AuthorName: NOAA ROC

3. publication:

   • Title: Level 3 Interface Control Document for Message Data Formats: Build 18
   • URL: https://www.roc.noaa.gov/wsr88d/PublicDocs/ICDs/2620001X.pdf
   • AuthorName: NOAA ROC

4. publication:

   • Title: Seasonal abundance and survival of North America’s migratory avifauna determined by weather radar
   • URL: https://www.nature.com/articles/s41559-018-0666-4
   • AuthorName: Adriaan M. Dokter, Andrew Farnsworth, Daniel Fink, Viviana Ruiz-Gutierrez, Wesley M. Hochachka, Frank A. La Sorte, Orin J. Robinson, Kenneth V. Rosenberg & Steve Kelling

5. publication:

   • Title: Unlocking the Potential of NEXRAD Data through NOAA’s Big Data Partnership
   • URL: https://journals.ametsoc.org/doi/full/10.1175/BAMS-D-16-0021.1
   • AuthorName: Steve Ansari and Stephen Del Greco

6. publication:

   • Title: Declines in an abundant aquatic insect, the burrowing mayfly, across major North American waterways
   • URL: https://www.pnas.org/content/117/6/2987
   • AuthorName: Phillip M. Stepanian, Sally A. Entrekin, Charlotte E. Wainwright, Djordje Mirkovic, Jennifer L. Tank, & Jeffrey F. Kelly

7. publication:

   • Title: Extreme Pyroconvective Updrafts During a Megafire
   • URL: https://agupubs.onlinelibrary.wiley.com/doi/abs/10.1029/2020GL089001
   • AuthorName: B. Rodriguez, N. P. Lareau, D. E. Kingsmill, & C. B. Clements