Global Database of Events, Language and Tone (GDELT)

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/gdelt-dataset")

fs.listdir("s3://gdelt-open-data")

Description:

This project monitors the world's broadcast, print, and web news from nearly every corner of every country in over 100 languages and identifies the people, locations, organizations, counts, themes, sources, emotions, quotes, images and events driving our global society every second of every day.

Contact:

This project monitors the world's broadcast, print, and web news from nearly every corner of every country in over 100 languages and identifies the people, locations, organizations, counts, themes, sources, emotions, quotes, images and events driving our global society every second of every day.

Update Frequency:

Not currently being updated

Managed By:

Unmanaged

Resources:

1. resource:

   • Description: Project data files
   • ARN: arn:aws:s3:::gdelt-open-data
   • Region: us-east-1
   • Type: S3 Bucket

2. resource:

   • Description: Notifications for new data
   • ARN: arn:aws:sns:us-east-1:928094251383:gdelt-csv
   • Region: us-east-1
   • Type: SNS Topic

Tags:

aws-pds, events, disaster response

Tutorials:

1. tutorial:

   • Title: Exploring GDELT with Athena
   • URL: http://blog.julien.org/2017/03/exploring-gdelt-data-set-with-amazon.html
   • AuthorName: Julien Simon
   • AuthorURL: https://twitter.com/julsimon

2. tutorial:

   • Title: Running R on Amazon Athena
   • URL: https://aws.amazon.com/blogs/big-data/running-r-on-amazon-athena/
   • AuthorName: Gopal Wunnava
   • AuthorURL: https://www.linkedin.com/in/gopal-wunnava-b11a77/

3. tutorial:

   • Title: Bootstrapping GeoMesa HBase on AWS S3
   • URL: http://www.geomesa.org/documentation/tutorials/geomesa-hbase-s3-on-aws.html
   • AuthorName: Commonwealth Computer Research, Inc.
   • AuthorURL: https://www.ccri.com

4. tutorial:

   • Title: Creating PySpark DataFrame from CSV in AWS S3 in EMR
   • URL: https://gist.github.com/jakechen/6955f2de51212163312b6430555b8e0b
   • AuthorName: Jake Chen
   • AuthorURL: https://github.com/jakechen

5. tutorial:

   • Title: Analysing Brexit Coverage In The Media Over Time
   • URL: https://www.linkedin.com/pulse/media-brexit-story-so-far-may-corbyn-less-shambles-than-mark-chopping/
   • AuthorName: Mark Chopping
   • AuthorURL: https://www.kognitio.com

6. tutorial:

   • Title: How to partition your geospatial data lake for analysis with Amazon Redshift
   • URL: https://aws.amazon.com/blogs/publicsector/how-partition-geospatial-data-lake-analysis-amazon-redshift/
   • AuthorName: Jeff DeMuth, Luke Wells, and Nemanja Boric

Tools & Applications:

1. tools & applications:
   • Title: Globe Events
   • URL: http://live.thermobook.net/globe-events/
   • AuthorName: thermobook
   • AuthorURL: http://www.thermobook.net