NOAA Geostationary Operational Environmental Satellites (GOES) 16, 17 & 18

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/noaa-goes-dataset")

fs.listdir("s3://noaa-goes18")

Description:

NOTICE: As of January 10th 2023, GOES-18 assumed the GOES-West position and all data files are deemed both operational and provisional, so no ‘preliminary, non-operational’ caveat is needed. GOES-17 is now offline, shifted approximately 105 degree West, where it will be in on-orbit storage. GOES-17 data will no longer flow into the GOES-17 bucket. Operational GOES-West products can be found in the GOES-18 bucket.

NEW GOES-18 Data!!! GOES-18 is now provisional and data has began streaming. Data files will be available between Provisional and the Operational Declaration of the satellite, however, data will have the caveat GOES-18 Preliminary, Non-Operational Data. The exception is during the interleave period when ABI Radiances and Cloud and Moisture Imagery data will be shared operationally via the NOAA Open Data Dissemination Program.

GOES satellites (GOES-16, GOES-17, & GOES-18) provide continuous weather imagery and monitoring of meteorological and space environment data across North America. GOES satellites provide the kind of continuous monitoring necessary for intensive data analysis. They hover continuously over one position on the surface. The satellites orbit high enough to allow for a full-disc view of the Earth. Because they stay above a fixed spot on the surface, they provide a constant vigil for the atmospheric "triggers" for severe weather conditions such as tornadoes, flash floods, hailstorms, and hurricanes. When these conditions develop, the GOES satellites are able to monitor storm development and track their movements. SUVI products available in both NetCDF and FITS. ## Contact:

NOTICE: As of January 10th 2023, GOES-18 assumed the GOES-West position and all data files are deemed both operational and provisional, so no ‘preliminary, non-operational’ caveat is needed. GOES-17 is now offline, shifted approximately 105 degree West, where it will be in on-orbit storage. GOES-17 data will no longer flow into the GOES-17 bucket. Operational GOES-West products can be found in the GOES-18 bucket.

NEW GOES-18 Data!!! GOES-18 is now provisional and data has began streaming. Data files will be available between Provisional and the Operational Declaration of the satellite, however, data will have the caveat GOES-18 Preliminary, Non-Operational Data. The exception is during the interleave period when ABI Radiances and Cloud and Moisture Imagery data will be shared operationally via the NOAA Open Data Dissemination Program.

GOES satellites (GOES-16, GOES-17, & GOES-18) provide continuous weather imagery and monitoring of meteorological and space environment data across North America. GOES satellites provide the kind of continuous monitoring necessary for intensive data analysis. They hover continuously over one position on the surface. The satellites orbit high enough to allow for a full-disc view of the Earth. Because they stay above a fixed spot on the surface, they provide a constant vigil for the atmospheric "triggers" for severe weather conditions such as tornadoes, flash floods, hailstorms, and hurricanes. When these conditions develop, the GOES satellites are able to monitor storm development and track their movements. SUVI products available in both NetCDF and FITS. ## Update Frequency: New data is added as soon as it's available ## Managed By: http://www.noaa.gov/ ## Collabs: - ASDI: - Tags: satellite imagery ## Resources: 1. resource: - Description: GOES-18 imagery and metadata - ARN: arn:aws:s3:::noaa-goes18 - Region: us-east-1 - Type: S3 Bucket - Explore: [Browse Bucket](https://noaa-goes18.s3.amazonaws.com/index.html) 2. resource: - Description: New data notifications for GOES-18, only Lambda and SQS protocols allowed - ARN: arn:aws:sns:us-east-1:123901341784:NewGOES18Object - Region: us-east-1 - Type: SNS Topic

3. resource:

   • Description: GOES-16 imagery and metadata
   • ARN: arn:aws:s3:::noaa-goes16
   • Region: us-east-1
   • Type: S3 Bucket
   • Explore: Browse Bucket

4. resource:

   • Description: New data notifications for GOES-16, only Lambda and SQS protocols allowed
   • ARN: arn:aws:sns:us-east-1:123901341784:NewGOES16Object
   • Region: us-east-1
   • Type: SNS Topic

5. resource:

   • Description: GOES-17 imagery and metadata
   • ARN: arn:aws:s3:::noaa-goes17
   • Region: us-east-1
   • Type: S3 Bucket
   • Explore: Browse Bucket

6. resource:

   • Description: New data notifications for GOES-17, only Lambda and SQS protocols allowed
   • ARN: arn:aws:sns:us-east-1:123901341784:NewGOES17Object
   • Region: us-east-1
   • Type: SNS Topic

Tags:

aws-pds, agriculture, geospatial, weather, earth observation, meteorological, sustainability, disaster response, satellite imagery

Tutorials:

1. tutorial:

   • Title: Visualize GOES-16 in Python using Xarray
   • URL: https://github.com/HamedAlemo/visualize-goes16
   • AuthorName: Hamed Alemohammad
   • AuthorURL: https://www.linkedin.com/in/hamedalemohammad/

2. tutorial:

   • Title: Comparison reading GOES-R data from AWS S3 in netCDF versus zarr
   • URL: https://nbviewer.jupyter.org/github/oceanhackweek/ohw-tutorials/blob/OHW20/10-satellite-data-access/goes-cmp-netcdf-zarr.ipynb
   • AuthorName: Chelle Gentemann
   • AuthorURL: http://www.faralloninstitute.org/chelle

3. tutorial:

   • Title: NOAA GOES16 Julia Jupyter Notebook Example
   • URL: https://github.com/awslabs/amazon-asdi/tree/master/examples/goes16-precip-julia
   • AuthorName: Peter Schmiedeskamp
   • Services: CloudFormation, EC2, SageMaker

4. tutorial:

   • Title: Processing GOES-16 data with Dask & AWS Fargate
   • URL: https://nbviewer.jupyter.org/github/awslabs/amazon-asdi/blob/main/examples/dask/notebooks/goes16_dask.ipynb
   • AuthorName: Zac Flamig
   • Services: CloudFormation, Fargate, SageMaker

5. tutorial:

   • Title: Forecasting Hurricane Tracks with TensorFlow and data from AWS S3
   • URL: https://github.com/M00NSH0T/Hurricanes/tree/master/2021%20update
   • AuthorName: Kyle Archie

Tools & Applications:

1. tools & applications:
   • Title: GOES-2-go is a python package for downloading and plotting plotting GOES data.
   • URL: https://github.com/blaylockbk/goes2go
   • AuthorName: Brian K. Blaylock
   • AuthorURL: https://www.linkedin.com/in/blaylockbk/

Publication:

1. publication:

   • Title: Observations of lightning in relation to transitions in volcanic activity during the 3 June 2018 Fuego Eruption
   • URL: https://www.nature.com/articles/s41598-020-74576-x
   • AuthorName: Christopher J. Schultz, Virginia P. Andrews, Kimberly D. Genareau, and Aaron R. Naeger

2. publication:

   • Title: Comparison of Lightning Forecasts from the High-Resolution Rapid Refresh Model to Geostationary Lightning Mapper Observations
   • URL: https://doi.org/10.1175/WAF-D-19-0141.1
   • AuthorName: Brian K. Blaylock, and John D. Horel

3. publication:

   • Title: Billions of Birds Migrate. Where Do They Go?
   • URL: https://www.nationalgeographic.com/magazine/2018/03/bird-migration-interactive-maps/
   • AuthorName: National Geographic

4. publication:

   • Title: Embracing the cloud for climate research
   • URL: https://aws.amazon.com/blogs/publicsector/embracing-the-cloud-for-climate-research/
   • AuthorName: North Carolina State University’s North Carolina Institute for Climate Studies

5. publication:

   • Title: Solar irradiance forecasting for the solar powered future
   • URL: https://aws.amazon.com/blogs/publicsector/solcast-solar-irradiance-forecasting-for-the-solar-powered-future/
   • AuthorName: Solcast

6. publication:

   • Title: Beginner’s Guide to GOES-R Series Data
   • URL: https://noaa-goes16.s3.amazonaws.com/Beginners_Guide_to_GOES-R_Series_Data.pdf
   • AuthorName: Danielle Losos

7. publication:

   • Title: GOES Quick Guides (Spanish)
   • URL: https://github.com/NOAA-Big-Data-Program/bdp-data-docs/tree/main/GOES/QuickGuides/Spanish
   • AuthorName: Anthony Segura García

8. publication:

   • Title: SunCast: Solar Irradiance Nowcasting from Geosynchronous Satellite Data
   • URL: https://arxiv.org/pdf/2201.06173.pdf
   • AuthorName: Dhileeban Kumaresan, Richard Wang, Ernesto Martinez, Richard Cziva, Alberto Todeschini, Colorado J Reed, Hossein Vahabi

9. publication:

   • Title: The Use of Composite GOES-R Satellite Imagery to Evaluate a TC Intensity and Vortex Structure Forecast by an FV3GFS-Based Hurricane Forecast Model
   • URL: https://doi.org/10.3390/atmos13010126
   • AuthorName: Shaowu Bao, Zhan Zhang, Evan Kalina, and Bin Liu

10. publication:

    • Title: Imaging Considerations From a Geostationary Orbit Using the Short Wavelength Side of the Mid-Infrared Water Vapor Absorption Band
    • URL: https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2021EA002080
    • AuthorName: N.B. Miller, M.M. Gunshor, A.J. Merrelli, T.S. L'Ecuyer, T.J. Schmit, J.J. Gerth, N.J. Gordillo

11. publication:

    • Title: Identifying the Causes of Pyrocumulonimbus (PyroCb)
    • URL: https://arxiv.org/pdf/2211.08883.pdf
    • AuthorName: Emiliano Díaz Salas-Porras, Kenza Tazi, Ashwin Braude, Daniel Okoh, Kara D. Lamb, Duncan Watson-Parris, Paula Harder, and Nis Meinert