OpenAQ

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/openaq-dataset")

fs.listdir("s3://openaq-fetches")

Description:

Global, aggregated physical air quality data from public data sources provided by government, research-grade and other sources. These awesome groups do the hard work of measuring these data and publicly sharing them, and our community makes them more universally-accessible to both humans and machines.

Contact:

Global, aggregated physical air quality data from public data sources provided by government, research-grade and other sources. These awesome groups do the hard work of measuring these data and publicly sharing them, and our community makes them more universally-accessible to both humans and machines.

Update Frequency:

Minutely

Managed By:

https://openaq.org

Collabs:

• ASDI:
  • Tags: air quality

Resources:

1. resource:

   • Description: Minutely CSVs of global air quality fetched from sources all over the world
   • ARN: arn:aws:s3:::openaq-fetches
   • Region: us-east-1
   • Type: S3 Bucket
   • Explore: Browse Bucket

2. resource:

   • Description: Rich SNS topic for new measurements, 1 notification per measurement, more details here
   • ARN: arn:aws:sns:us-east-1:470049585876:OPENAQ_NEW_MEASUREMENT
   • Region: us-east-1
   • Type: SNS Topic

3. resource:

   • Description: SNS topic for new objects in the openaq-fetches bucket, roughly 6 objects per hour, more details here
   • ARN: arn:aws:sns:us-east-1:470049585876:NewFetchObject
   • Region: us-east-1
   • Type: SNS Topic

4. resource:

   • Description: OpenAQ API
   • Host: api.openaq.org
   • Region: us-east-1
   • Type: CloudFront Distribution

Tags:

air quality, cities, environmental, geospatial, sustainability

Tutorials:

1. tutorial:

   • Title: Access OpenAQ data via a filterable SNS topic
   • URL: https://medium.com/@openaq/get-faster-access-to-real-time-air-quality-data-from-around-the-world-c6f9793d5242
   • AuthorName: OpenAQ
   • AuthorURL: https://openaq.org
   • Services: SNS

2. tutorial:

   • Title: Using Athena to access the whole archive
   • URL: https://medium.com/@openaq/how-in-the-world-do-you-access-air-quality-data-older-than-90-days-on-the-openaq-platform-8562df519ecd
   • AuthorName: OpenAQ
   • AuthorURL: https://openaq.org
   • Services: Athena, Glue

3. tutorial:

   • Title: Analyze Global Air Pollution Using Apache Spark & BigQuery
   • URL: https://kapilsreed.medium.com/how-to-analyze-global-air-quality-using-apache-spark-bigquery-7743fd54e634
   • AuthorName: Kapil Sreedharan
   • AuthorURL: https://kapilsreed.medium.com/

4. tutorial:

   • Title: Build your own Air Quality Monitor with OpenAQ and EMR on EKS
   • URL: https://dacort.dev/posts/emr-eks-custom-images-with-openaq/
   • AuthorName: Damon Cortesi
   • AuthorURL: https://dacort.dev/
   • Services: EMR, EKS

5. tutorial:

   • Title: ML Demo: Predicting Air Quality w/ ASDI NOAA + OpenAQ Datasets in SageMaker Studio Lab (SMSL)
   • URL: https://github.com/aws-samples/aws-smsl-predict-airquality-via-weather/
   • NotebookURL: https://github.com/aws-samples/aws-smsl-predict-airquality-via-weather/blob/main/aq_by_weather.ipynb
   • AuthorName: Aaron Soto
   • Services: SageMaker Studio Lab

6. tutorial:

   • Title: Investigating environmental characteristics of US cities using publicly available ASDI datasets using SageMaker Studio Lab (SMSL)
   • URL: https://github.com/aws-samples/aws-asdi-cities-smsl-notebook/
   • NotebookURL: https://github.com/aws-samples/aws-asdi-cities-smsl-notebook/blob/main/ASDI_Cities_Demo.ipynb
   • AuthorName: Darren Ko
   • Services: SageMaker Studio Lab

Tools & Applications:

1. tools & applications:

   • Title: Smokey: Air Quality Bot
   • URL: https://www.facebook.com/smokeybot/
   • AuthorName: Amrit Sharma
   • AuthorURL: https://twitter.com/amrit_sharma

2. tools & applications:

   • Title: ropenaq R package
   • URL: https://github.com/ropensci/ropenaq
   • AuthorName: Maëlle Salmon
   • AuthorURL: https://github.com/maelle

3. tools & applications:

   • Title: hackAIR
   • URL: http://www.hackair.eu/
   • AuthorName: hackAir

4. tools & applications:

   • Title: ARISense
   • URL: https://arisense.io/
   • AuthorName: Aerodyne Research, Inc.
   • AuthorURL: http://www.aerodyne.com/

5. tools & applications:

   • Title: OpenAQ Aggregator
   • URL: https://github.com/ksree/world-air-quality
   • AuthorName: Kapil Sreedharan
   • AuthorURL: https://github.com/ksree

Publication:

1. publication:
   • Title: Enabling rapid COVID-19 and air pollution analysis across the globe with OpenAQ and AWS
   • URL: https://aws.amazon.com/blogs/publicsector/enabling-rapid-covid-19-air-pollution-analysis-across-globe-openaq/
   • AuthorName: Christa Hasenkopf
   • AuthorURL: https://openaq.org