Coupled Model Intercomparison Project 6

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/cmip6-dataset")

fs.listdir("s3://cmip6-pds")

Description:

The sixth phase of global coupled ocean-atmosphere general circulation model ensemble.

Contact:

The sixth phase of global coupled ocean-atmosphere general circulation model ensemble.

Update Frequency:

Core CMIP6 datasets are added as soon as they are available.

Managed By:

ESGF and Pangeo

Collabs:

• ASDI:
  • Tags: climate

Resources:

1. resource:
   • Description: Zarr formatted data
   • ARN: arn:aws:s3:::cmip6-pds
   • Region: us-west-2
   • Type: S3 Bucket
   • Explore: Browse Bucket, Data Catalog
2. resource:
   • Description: Netcdf formatted data managed by the Earth System Grid Federation
   • ARN: arn:aws:s3:::esgf-world
   • Region: us-east-2
   • Type: S3 Bucket
   • Explore: Browse Bucket, Data Catalog

Tags:

aws-pds, agriculture, atmosphere, climate, earth observation, environmental, model, oceans, simulations, weather

Tutorials:

1. tutorial:

   • Title: Processing CMIP6 data in Zarr format with Dask & AWS Fargate
   • URL: https://nbviewer.jupyter.org/github/awslabs/amazon-asdi/blob/main/examples/dask/notebooks/cmip6_zarr.ipynb
   • AuthorName: Zac Flamig
   • Services: CloudFormation, Fargate, SageMaker

2. tutorial:

   • Title: Finding CMIP6 data using intake-esm and plotting time series for points
   • URL: https://nbviewer.jupyter.org/github/awslabs/amazon-asdi/blob/main/examples/cmip6/notebooks/cmip6_airtemperature.ipynb
   • AuthorName: Zac Flamig
   • Services: CloudFormation, SageMaker

3. tutorial:

   • Title: Getting Started with CMIP6 Data
   • URL: https://github.com/aradhakrishnanGFDL/gfdl-aws-analysis/blob/community/doc/quickstartdoc.md
   • AuthorName: Aparna Radhakrishnan

4. tutorial:

   • Title: Comparing CMIP6 Zarr vs NetCDF Holdings
   • URL: https://nbviewer.jupyter.org/github/aradhakrishnanGFDL/gfdl-aws-analysis/blob/master/examples/a1r-CompareAWS-NCvsZarr.ipynb
   • AuthorName: Aparna Radhakrishnan
   • Services: S3

5. tutorial:

   • Title: Analyze terabyte-scale geospatial datasets with Dask and Jupyter on AWS
   • URL: https://aws.amazon.com/blogs/publicsector/analyze-terabyte-scale-geospatial-datasets-with-dask-and-jupyter-on-aws/
   • AuthorName: Ethan Fahy and Zac Flamig
   • Services: EC2, EKS, S3, CloudFormation

Publication:

1. publication:

   • Title: CMIP6 Data Informational Session Video Recording
   • URL: https://www.youtube.com/watch?v=C0UhiiGgbWA
   • AuthorName: ASDI

2. publication:

   • Title: Special issue | Coupled Model Intercomparison Project Phase 6 (CMIP6) Experimental Design and Organization
   • URL: https://gmd.copernicus.org/articles/special_issue590.html
   • AuthorName: V. Eyring