fairseq/examples/conv_lm/README.md

Language Modeling with Gated Convolutional Networks (Dauphin et al., 2017)

Pre-trained models

Description	Dataset	Model	Test set(s)
Convolutional (Dauphin et al., 2017)	Google Billion Words	download (.tar.bz2)	download (.tar.bz2)
Convolutional (Dauphin et al., 2017)	WikiText-103	download (.tar.bz2)	download (.tar.bz2)

Example usage

See the language modeling README for instructions on reproducing results for WikiText-103 using the fconv_lm_dauphin_wikitext103 model architecture.

Citation

@inproceedings{dauphin2017language,
  title={Language Modeling with Gated Convolutional Networks},
  author={Dauphin, Yann N and Fan, Angela and Auli, Michael and Grangier, David},
  booktitle={Proceedings of the 34th International Conference on Machine Learning-Volume 70},
  pages={933--941},
  year={2017},
  organization={JMLR}
}