Convolutions are competitive with transformers for protein sequence pretraining

Kevin Yang, Alex X. Lu, Nicolò FusiZenodo 2022 · DOI · OpenAlex

Abstract

- Pretrained models of protein sequences. See https://github.com/microsoft/protein-sequence-models for instructions on how to load models. - IDR datasets used for evaluation. - March 2020 version of UniRef50 with splits used for training.
BibTeX
@inproceedings{yang2022convolutions,
  author = {Kevin Yang and Alex X. Lu and Nicolò Fusi and Alex Xijie Lu},
  title = {{Convolutions are competitive with transformers for protein sequence pretraining}},
  booktitle = {Zenodo},
  year = {2022},
  doi = {10.5281/zenodo.6368483},
}

Loading related content...

Figure