Registry of Open Data on AWS

Stream data with DDA:

import os, git
from dagshub.streaming import DagsHubFilesystem
url = 'https://<username>:<token>@dagshub.com/DagsHub-Datasets/registry-open-data-dataset.git'
git.Git("./").clone(url)
fs = DagsHubFilesystem("registry-open-data-dataset")
print(list(fs.scandir("registry-open-data-dataset")))
print(list(fs.listdir("registry-open-data-dataset/s3://registry.opendata.aws/roda/ndjson/")))

Description:

The Registry of Open Data on AWS contains publicly available datasets that are available for access from AWS resources. Note that datasets in this registry are available via AWS resources, but they are not provided by AWS; these datasets are owned and maintained by a variety of government organizations, researchers, businesses, and individuals. This dataset contains derived forms of the data in https://github.com/awslabs/open-data-registry that have been transformed for ease of use with machine interfaces. Currently, only the ndjson form of the registry is populated here.

Contact:

The Registry of Open Data on AWS contains publicly available datasets that are available for access from AWS resources. Note that datasets in this registry are available via AWS resources, but they are not provided by AWS; these datasets are owned and maintained by a variety of government organizations, researchers, businesses, and individuals. This dataset contains derived forms of the data in https://github.com/awslabs/open-data-registry that have been transformed for ease of use with machine interfaces. Currently, only the ndjson form of the registry is populated here.

Update Frequency:

Automatically when new datasets are added

Managed By:

https://aws.amazon.com/

Resources:

1. resource:

   • Description: Registry of Open Data on AWS
   • ARN: arn:aws:s3:::registry.opendata.aws/roda/ndjson/
   • Region: us-east-1
   • Type: S3 Bucket

2. resource:

   • Description: SNS topic for object create events
   • ARN: arn:aws:sns:us-east-1:652627389412:roda-object_created
   • Region: us-east-1
   • Type: SNS Topic

Tags:

json, metadata