Install DagsHub:
pip install dagshub
To stream this data directly on DagsHub
from dagshub.streaming import DagsHubFilesystem
fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/lowcontext-ner-gaz-dataset")
fs.listdir("s3://lowcontext-ner-gaz")