OpenAlex dataset

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/openalex-dataset")

fs.listdir("s3://openalex")

Description:

An open, comprehensive index of scolarly papers, citations, authors, institutions, and journals.

Contact:

An open, comprehensive index of scolarly papers, citations, authors, institutions, and journals.

Update Frequency:

Approximately monthly

Managed By:

https://ourresearch.org/

Resources:

1. resource:
   • Description: OpenAlex Entities in JSON Lines format
   • ARN: arn:aws:s3:::openalex
   • Region: us-east-1
   • Type: S3 Bucket
   • Explore: Browse Bucket
2. resource:
   • Description: Openalex Entities decomposed to tab-separated columnar files for backward compatibility with Microsoft Academic Graph
   • ARN: arn:aws:s3:::openalex-mag-format
   • Region: us-east-1
   • Type: S3 Bucket
   • Explore: Browse Bucket

Tags:

graph, json, metadata, scholarly communication, aws-pds

Tutorials:

1. tutorial:

   • Title: Download snapshot
   • URL: https://docs.openalex.org/download-snapshot
   • AuthorName: OurResearch
   • AuthorURL: https://ourresearch.org

2. tutorial:

   • Title: Getting citation data from OpenAlex by DOI (Jupyter notebook)
   • URL: https://twitter.com/ipoga/status/1521604494592782336
   • AuthorName: Jens Peter Anderson
   • AuthorURL: https://twitter.com/ipoga

3. tutorial:

   • Title: Data Analysis and Knowledge Graph with OpenAlex dataset
   • URL: https://github.com/aws-samples/aws-openalex-knowledge-graph
   • NotebookURL: https://github.com/aws-samples/aws-openalex-knowledge-graph/blob/main/eda-knowledge-graph-with-openalex-dataset.ipynb
   • AuthorName: Gabriel Bella Martini
   • Services: SageMaker Studio Lab

Publication:

1. publication:
   • Title: OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts
   • URL: https://arxiv.org/abs/2205.01833
   • AuthorName: Jason Priem, Heather Piwowar, Richard Orr