Install DagsHub:
pip install dagshubTo stream this data directly on DagsHub
from dagshub.streaming import DagsHubFilesystem
fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/dcc-dataset")
fs.listdir("s3://mit-supercloud-dataset")Description
Collection of parsed datacenter logs and time series data of hardware utilization from the MIT Supercloud system.
Additional information
Update frequency
Data will be updated annually
Managed by
Siddharth Samsi
