marcelomata/fairseq

Message	Author	SHA1	Date
Commit wmt14_en_de_token.dvc	Tolstoyevsky	a223dac19d	5 years ago
Merge branch 'dvc' into dvc-train-single-batch	Tolstoyevsky	a851fa5c00	5 years ago
Fixed reference to resume checkpoint	Tolstoyevsky	38a68f542d	5 years ago
Skipped the unzipping stage completely	Tolstoyevsky	f2db784947	5 years ago
Created a training and validation set that should fit in a single batch, to try to overfit it to validate the model is working	Tolstoyevsky	5daf57765b	5 years ago
Gave better names to the tokenization stage, and moved the prep command to a script	Tolstoyevsky	9737e7b55a	5 years ago
Fix path names in resume-checkpoint.dvc	Tolstoyevsky	cf108ce72b	5 years ago
Removed the unzipped files cache	Tolstoyevsky	189ca2d3b4	5 years ago
Refactored the checkpoint moving stage	Tolstoyevsky	4d4157b01b	5 years ago
Training iteration	Guy	c7c8158854	5 years ago
Added training step stub	Tolstoyevsky	e759a87b56	5 years ago
Ran data prep dvc stage	Guy	d67b3d242d	5 years ago
Change logo size	Dean	7d7f706f0c	5 years ago
Calculated BPE using DVC	Guy	95e6328f05	5 years ago
Added missing commoncrawl dependency	Tolstoyevsky	4d3af97b40	5 years ago
Refactor data preparation a bit	Tolstoyevsky	91ba772189	5 years ago
Universal encoder seems ready	Tolstoyevsky	b5fee3ac3e	5 years ago
Small things - hyperparam yaml, script to clean corrupted unicode	Tolstoyevsky	f1c69c3245	5 years ago
Finished preprocessing	Tolstoyevsky	ff2d491493	5 years ago
Setup the stub of the preprocessing dvc stage	Tolstoyevsky	f0e342fadb	5 years ago
Fixed commoncrawl yet again	Tolstoyevsky	79c9b105f7	5 years ago
Fixed training.dvc	Tolstoyevsky	7a3ccdb770	5 years ago
Reorganized dvc	Tolstoyevsky	c48c5c59bb	5 years ago
Working on the prepare script, tokenization looks like it's working	Tolstoyevsky	009aadfb6b	5 years ago
Switched to the correct dataset (nc-12 instead of nc-13)	Tolstoyevsky	0c4498c7ec	5 years ago
Unzipped raw data	Tolstoyevsky	bd93330821	5 years ago
Moved data into data folder	Tolstoyevsky	ce5ed4de73	5 years ago
Init DVC + downloaded and tracking data	Tolstoyevsky	48ca497c9d	5 years ago
stitch preprocessing pipeline	Ruty Rinott	cea0e4b9ea	5 years ago
Add CheckpointManager to keep avg checkpoint weights in memory to reduce disk read when averaging + various checkpoint refactoring	Wei Ho	c49c292c79	5 years ago

Newer Older

marcelomata / fairseq forked from Guy/fairseq

marcelomata
/
fairseq
forked from Guy/fairseq