APILASTRI/reformer_fastai

exploration

26a68801d2

switches prenorm default to True for Reversible and Reformer (#121)

3 years ago

images

eee77f9b31

memory-and-timing doc upd

3 years ago

00_core.ipynb

3357e29823

fixes add_eos

3 years ago

01_layers.ipynb

f263088ecb

lm notebooks upd (#92)

3 years ago

02_attention.ipynb

e71ae5ee4d

docs and cleanup

3 years ago

03_transformer.ipynb

f24c24679a

docs upd

3 years ago

04_reformer.ipynb

f24c24679a

docs upd

3 years ago

05_tokenizers.ipynb

a533a4e0d6

fixes error message

3 years ago

06_data.ipynb

ef0da7a7e9

small fix to deterministic synthtic dataset (#69)

3 years ago

07_metrics.ipynb

f24c24679a

docs upd

3 years ago

08_optimizers.ipynb

74f853ed1b

adds adagin

3 years ago

09_tracking.ipynb

742a906f45

Adds wandb condiation for rank 0 only and fixes model params tracking

3 years ago

10_experiment.synthetic-task.ipynb

b2f723d9f6

lsh comparison (#47)

3 years ago

10a_experiment.synthetic-task-comparison.ipynb

b2f723d9f6

lsh comparison (#47)

3 years ago

10b_experiment.synthetic-task-minimal.ipynb

8f21e25d0a

synt (#59)

3 years ago

10c_experiment.synthetic-task-analysis.ipynb

7dad7ecef4

updateds to synthetic task analysis (#85)

3 years ago

11a_experiment.enwik8_baseline.ipynb

f263088ecb

lm notebooks upd (#92)

3 years ago

11b_experiment.enwik8_sharedQK.ipynb

f263088ecb

lm notebooks upd (#92)

3 years ago

11c_experiment.enwik8_reversible.ipynb

f263088ecb

lm notebooks upd (#92)

3 years ago

12_experiment.speed-lsh_synthetic-task.ipynb

e3a3ee8f88

exp-nb 12 upd

3 years ago

13_experiment.enwik8-n_hashes.ipynb

f24c24679a

docs upd

3 years ago

14_experiment.enwik8-n_layers.ipynb

f24c24679a

docs upd

3 years ago

14b_experiment.wikitext2-n_layers.ipynb

3a83242047

wikitext2 training

3 years ago

20_experiment-script.ipynb

78b3b8c468

Adds Experiment Commands docs, re-arranged side bar, added einops>=0.3 requirement, small docs additions

3 years ago

21_experiment-configs.ipynb

78b3b8c468

Adds Experiment Commands docs, re-arranged side bar, added einops>=0.3 requirement, small docs additions

3 years ago

22_experiment.experiment-commands.ipynb

38587071cf

tidies up docs

3 years ago

50_exploration.LSH.ipynb

054e37adee

added LSH exploration notebook (#39)

3 years ago

51_exploration.LSH-report.ipynb

26cafbfaa7

update docs (#115)

3 years ago

52_exploration.memory_and_timing.ipynb

eee77f9b31

memory-and-timing doc upd

3 years ago

60_model-upload.ipynb

f64afe857a

models (#130)

3 years ago

61_evaluation.ipynb

212ab02817

model evaluation nb (#133)

3 years ago

_04_reformer.ipynb

c803602a18

n_hashes experiment (#104)

3 years ago

index.ipynb

38587071cf

tidies up docs

3 years ago

Comments

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

APILASTRI / reformer_fastai forked from Dean/reformer_fastai

Comments

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

APILASTRI
/
reformer_fastai
forked from Dean/reformer_fastai