DagsHub

DAGsHub ❤️ Reproducibility

Welcome to the Machine Learning Reproducibility Challenge – Fall 2021 Edition

Supporting the challenge

Machine learning reproducibility is what originally got us started with DAGsHub, and we care deeply about promoting it. When research is reproducible, everyone benefits – that is why the Papers with Code reproducibility challenge is such an important and positive effort. We're excited to support participants taking on this challenge, with the hope that it will encourage more teams to participate and move the field forward.

We're supporting efforts to make all papers from NeurIPS, ICML, ICLR, ACL-IJCNLP, EMNLP, CVPR, ICCV, AAAI, and IJCAI reproducible, in a verifiable and reliable way, by having the code, data, models, and experiments tracked in DAGsHub.

What you'll get

To incentivize community members to spend their time on this challenge, and since many papers require expensive compute resources to reproduce, we're offering participants $500 per paper reproduced, as long as it meets the guidelines.

Here are a few reasons you should consider participating:

Everlasting glory of having reproduced a real scientific paper's results
A great project to showcase on your resumé
$500 per paper reproduced according to the guidelines

Read the full info & guidelines

Join the reproducibility challenge Discord!

How to participate

Choose

Choose an accepted paper from the supported conferences.

Join

Join our Discord community's #ml-reproducibility channel.

Reproduce

Use DAGsHub to track your code, data, models, and experiments.

Report

Write a summary of your findings and ablation studies on DAGsHub.

Not sure what to do next?

If you're not a DAGsHub user yet, start by signing up for free.
Join our Discord community's #ml-reproducibility channel.
Choose the paper you want to reproduce and let the games begin!

Reproducibility Challenge