Daylight Map Distribution of OpenStreetMap

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/daylight-osm-dataset")

fs.listdir("s3://daylight-map-distribution/release/")

Description:

Daylight is a complete distribution of global, open map data that’s freely available with support from community and professional mapmakers. Meta combines the work of global contributors to projects like OpenStreetMap with quality and consistency checks from Daylight mapping partners to create a free, stable, and easy-to-use street-scale global map.

The Daylight Map Distribution contains a validated subset of the OpenStreetMap database. In addition to the standard OpenStreetMap PBF format, Daylight is available in two parquet formats that are optimized for AWS Athena including geometries (Points, LineStrings, Polygons, or MultiPolygons). First, Daylight OSM Features contains the nearly 1B renderable OSM features. Second, Daylight OSM Elements contains all of OSM, including all 7B nodes without attributes, and relations that do not contain geometries, such as turn restrictions.

Daylight Earth Table is a new data schema that classifies OpenStreetMap-style tags into a 3-level ontology (theme, class, subclass) and is the result of running the earth table classification over the latest release (v1.18) of the Daylight Map Distribution. The Daylight Earth Table is available as parquet files on Amazon S3.

Contact:

Daylight is a complete distribution of global, open map data that’s freely available with support from community and professional mapmakers. Meta combines the work of global contributors to projects like OpenStreetMap with quality and consistency checks from Daylight mapping partners to create a free, stable, and easy-to-use street-scale global map.

The Daylight Map Distribution contains a validated subset of the OpenStreetMap database. In addition to the standard OpenStreetMap PBF format, Daylight is available in two parquet formats that are optimized for AWS Athena including geometries (Points, LineStrings, Polygons, or MultiPolygons). First, Daylight OSM Features contains the nearly 1B renderable OSM features. Second, Daylight OSM Elements contains all of OSM, including all 7B nodes without attributes, and relations that do not contain geometries, such as turn restrictions.

Daylight Earth Table is a new data schema that classifies OpenStreetMap-style tags into a 3-level ontology (theme, class, subclass) and is the result of running the earth table classification over the latest release (v1.18) of the Daylight Map Distribution. The Daylight Earth Table is available as parquet files on Amazon S3.

Update Frequency:

Quarterly

Managed By:

https://dataforgood.fb.com/

Collabs:

• ASDI:
  • Tags: disaster response

Resources:

1. resource:

   • Description: Daylight OSM PBF Files
   • ARN: arn:aws:s3:::daylight-map-distribution/release/
   • Region: us-west-1
   • Type: S3 Bucket

2. resource:

   • Description: New OSM PBF Notification
   • ARN: arn:aws:sns:us-west-1:632571768781:Daylight
   • Region: us-west-1
   • Type: SNS Topic

3. resource:

   • Description: Daylight OSM Features (Parquet)
   • ARN: arn:aws:s3:::daylight-openstreetmap/parquet/osm_features
   • Region: us-west-2
   • Type: S3 Bucket

4. resource:

   • Description: Daylight OSM Elements (Parquet)
   • ARN: arn:aws:s3:::daylight-openstreetmap/parquet/osm_elements
   • Region: us-west-2
   • Type: S3 Bucket

5. resource:

   • Description: New Parquet File Notification
   • ARN: arn:aws:sns:us-west-2:632571768781:Analysis_Ready_Daylight
   • Region: us-west-2
   • Type: SNS Topic

6. resource:

   • Description: Daylight Earth Table (Parquet)
   • ARN: arn:aws:s3:::daylight-openstreetmap/earth
   • Region: us-west-2
   • Type: S3 Bucket

Tags:

geospatial, osm, mapping, disaster response, aws-pds, sustainability

Tutorials:

1. tutorial:
   • Title: Loading the Daylight Map Distribution OpenStreetMap Features into AWS Athena
   • URL: https://gist.github.com/jenningsanderson/3e42a99dcb8f760038ad8aa47ea38ce8
   • AuthorName: Jennings Anderson
   • AuthorURL: http://jenningsanderson.com
   • Services: Athena
2. tutorial:
   • Title: Daylight Earth Tables
   • URL: https://daylightmap.org/earth/
   • AuthorName: Daylight Contributors
   • Services: Athena

Publication:

1. publication:

   • Title: Increasing OpenStreetMap Data Accessibility with the Analysis-Ready Daylight Distribution of OpenStreetMap: A Demonstration of Cloud-Based Assessments of Global Building Completeness
   • URL: https://www.youtube.com/watch?v=rVBGLCFKAtw&t=161s
   • AuthorName: Jennings Anderson and Timmera Whaley Omidire

2. publication:

   • Title: Daylight Earth Tables (NACIS 2022)
   • URL: https://daylightmap.org/assets/nacis_2022_daylight_earth_table.pdf
   • AuthorName: Jennings Anderson, Jonah Adkins, Jacob Wasserman