Szymon Tworkowski

Machine Learning Master’s student at the University of Warsaw, advised by Yuhuai Wu and Piotr Miłoś

Interested in improving language models (efficient Transformers) and investigating their implications via topics like in-context learning or OOD generalization in reasoning tasks.

Publication

Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Provers Albert Q. Jiang, Wenda Li, Szymon Tworkowski, Konrad Czechowski, Tomasz Odrzygóźdź, Piotr Miłoś, Yuhuai Wu, Mateja Jamnik

arXiv, 2022

Hierarchical Transformers Are More Efficient Language Models Piotr Nawrot, Szymon Tworkowski, Michał Tyrolski, Łukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski

NAACL 2022, Findings.