Open AccessDOI
RichJackson/pytorch-transformers: supporting ablation paper v3
Thomas Wolf,Lysandre Debut,Victor Sanh,Denis,erenup,Matt,Julien Chaumond,Grégory Châtel,Tim Rault,Catalin Voss,Fei Wang,Davide Fiocco,Malte Pietsch,Ananya Harsh Jha,Stefan Schweter,Dhanajit Brahma,Guillem García Subies,Shijie Wu,Yongbo Wang,yzy,Jade Abbott,Joel Grus,Nikolay Korolev,Liu Chi-Liang,Zeyao Du,Weixin Wang,Abhishek Rao,Ailing,Clement,matej-svejda +29 more
About:
The article was published on 2020-06-15 and is currently open access. It has received 1 citations till now.read more
Citations
More filters
Journal ArticleDOI
Ablations over transformer models for biomedical relationship extraction
Richard J. Jackson,Erik T. Jansson,Aron Lagerberg,Elliot Ford,Vladimir Poroshin,Timothy Scrivener,Mats Axelsson,Martin Johansson,Lesly Arun Franco,Eliseo Papa +9 more
TL;DR: A recent general domain pretrained model performs approximately the same as a biomedical specific one, suggesting that domain specific models may be of limited use given the tendency of recent model pretraining regimes to incorporate ever broader sets of data.
References
More filters
Journal ArticleDOI
Ablations over transformer models for biomedical relationship extraction
Richard J. Jackson,Erik T. Jansson,Aron Lagerberg,Elliot Ford,Vladimir Poroshin,Timothy Scrivener,Mats Axelsson,Martin Johansson,Lesly Arun Franco,Eliseo Papa +9 more
TL;DR: A recent general domain pretrained model performs approximately the same as a biomedical specific one, suggesting that domain specific models may be of limited use given the tendency of recent model pretraining regimes to incorporate ever broader sets of data.