COVID-19 Data Lake

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/aws-covid19-lake-dataset")

fs.listdir("s3://covid19-lake")

Description:

A centralized repository of up-to-date and curated datasets on or related to the spread and characteristics of the novel corona virus (SARS-CoV-2) and its associated illness, COVID-19. Globally, there are several efforts underway to gather this data, and we are working with partners to make this crucial data freely available and keep it up-to-date. Hosted on the AWS cloud, we have seeded our curated data lake with COVID-19 case tracking data from Johns Hopkins and The New York Times, hospital bed availability from Definitive Healthcare, and over 45,000 research articles about COVID-19 and related coronaviruses from the Allen Institute for AI.

Contact:

A centralized repository of up-to-date and curated datasets on or related to the spread and characteristics of the novel corona virus (SARS-CoV-2) and its associated illness, COVID-19. Globally, there are several efforts underway to gather this data, and we are working with partners to make this crucial data freely available and keep it up-to-date. Hosted on the AWS cloud, we have seeded our curated data lake with COVID-19 case tracking data from Johns Hopkins and The New York Times, hospital bed availability from Definitive Healthcare, and over 45,000 research articles about COVID-19 and related coronaviruses from the Allen Institute for AI.

Update Frequency:

Periodically

Managed By:

https://aws.amazon.com/

Resources:

1. resource:
   • Description: Collected COVID-19 related datasets
   • ARN: arn:aws:s3:::covid19-lake
   • Region: us-east-2
   • Type: S3 Bucket
   • Explore: Browse Bucket

Tags:

bioinformatics, biology, coronavirus, COVID-19, health, life sciences, MERS, medicine, SARS

Tutorials:

1. tutorial:
   • Title: A public data lake for analysis of COVID-19 data
   • URL: https://aws.amazon.com/blogs/big-data/a-public-data-lake-for-analysis-of-covid-19-data/
   • AuthorName: AWS Data Lake Team
   • AuthorURL: https://aws.amazon.com/big-data/datalakes-and-analytics/
   • Services: Glue, Athena, Comprehend, Kendra, QuickSight
2. tutorial:
   • Title: Exploring the public AWS COVID-19 data lake
   • URL: https://aws.amazon.com/blogs/big-data/exploring-the-public-aws-covid-19-data-lake/
   • AuthorName: AWS Data Lake Team
   • AuthorURL: https://aws.amazon.com/big-data/datalakes-and-analytics/
   • Services: Athena, Glue, SageMaker
3. tutorial:
   • Title: How to use SQL to query data in S3 Bucket with Amazon Athena and AWS SDK for .NET
   • URL: https://github.com/aws-samples/query-data-in-s3-with-amazon-athena-and-aws-sdk-for-dotnet
   • AuthorName: AWS ProServe US West Applications Team
   • AuthorURL: https://github.com/orgs/aws-samples/teams/aws-proserve-us-west-applications
   • Services: Athena, Glue, S3, CloudFormation

Tools & Applications:

1. tools & applications:

   • Title: Explore the COVID-19 data lake public S3 bucket
   • URL: https://go.aws/covid-19-data-lake
   • AuthorName: AWS Data Lake Team
   • AuthorURL: https://aws.amazon.com/big-data/datalakes-and-analytics/

2. tools & applications:

   • Title: CloudFormation template for Glue Catalog table definitions
   • URL: https://us-east-2.console.aws.amazon.com/cloudformation/home?region=us-east-2#/stacks/create/review?templateURL=https://covid19-lake.s3.us-east-2.amazonaws.com/cfn/CovidLakeStack.template.json&stackName=CovidLakeStack
   • AuthorName: AWS Data Lake Team
   • AuthorURL: https://aws.amazon.com/big-data/datalakes-and-analytics/