By Year By Type

Preprints

  1. Causal Mediation Analysis for Interpreting NLP Models: The Case of Gender Bias. Jesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian, Daniel Nevo, Yaron Singer, Stuart Shieber [Arxiv]
  2. Memory-Augmented Recurrent Neural Networks Can Learn Generalized Dyck Languages. Mirac Suzgun, Sebastian Gehrmann, Yonatan Belinkov, Stuart Shieber [Arxiv]
  3. Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?. Abhilasha Ravichander, Yonatan Belinkov, Eduard Hovy [Arxiv]

2020

  1. Investigating Gender Bias in Language Models Using Causal Mediation Analysis. Jesse Vig*, Sebastian Gehrmann*, Yonatan Belinkov*, Sharon Qian, Daniel Nevo, Yaron Singer, Stuart Shieber In Advances in Neural Information Processing Systems (NeurIPS, Spotlight presentation) 2020 [Abstract] [PDF] [Code]
  2. Analyzing Redundancy in Pretrained Transformer Models. Fahim Dalvi, Hassan Sajjad, Nadir Durrani, Yonatan Belinkov In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) 2020 [Abstract] [Arxiv]
  3. Analyzing Individual Neurons in Pre-trained Language Models. Nadir Durrani, Hassan Sajjad, Fahim Dalvi, Yonatan Belinkov In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) 2020 [Abstract] [Arxiv]
  4. Similarity Analysis of Contextual Word Representation Models. John M. Wu*, Yonatan Belinkov*, Hassan Sajjad, Nadir Durrani, Fahim Dalvi, James Glass In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL) 2020 [Abstract] [PDF] [Code] [Arxiv]
  5. Probing Neural Dialog Models for Conversational Understanding. Abdelrhman Saleh, Tovly Deutsch, Stephen Casper, Yonatan Belinkov, Stuart Shieber In Proceedings of the Second Workshop on NLP for Conversational AI (NLP4ConvAI) 2020 [Abstract] [PDF]
  6. End-to-End Bias Mitigation by Modelling Biases in Corpora. Rabeeh Karimi Mahabadi, Yonatan Belinkov, James Henderson In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL) 2020 [Abstract] [PDF] [Arxiv]
  7. The Sensitivity of Language Models and Humans to Winograd Schema Perturbations. Mostafa Abdou, Vinit Ravishankar, Maria Barrett, Yonatan Belinkov, Desmond Elliott, Anders Søgaard In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL) 2020 [Abstract] [PDF] [Arxiv]
  8. A Constructive Prediction of the Generalization Error Across Scales. Jonathan S. Rosenfeld, Amir Rosenfeld, Yonatan Belinkov, Nir Shavit In International Conference on Learning Representations (ICLR) 2020 [Abstract] [PDF] [Arxiv] [Media: MIT CSAIL News, The Batch]
  9. On the Linguistic Representational Power of Neural Machine Translation Models. Yonatan Belinkov*, Nadir Durrani*, Fahim Dalvi, Hassan Sajjad, James Glass Computational Linguistics 2020 [Abstract] [PDF] [Arxiv]

2019

  1. Analyzing Phonetic and Graphemic Representations in End-to-End Automatic Speech Recognition. Yonatan Belinkov, Ahmed Ali, James Glass In Proceedings of Interspeech 2019 [Abstract] [PDF] [Arxiv]
  2. Analyzing the Structure of Attention in a Transformer Language Model. Jesse Vig, Yonatan Belinkov In Proceedings of the Second BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP at ACL 2019 [Abstract] [PDF] [Arxiv]
  3. Findings of the First Shared Task on Machine Translation Robustness. Xian Li, Paul Michel, Antonios Anastasopoulos, Yonatan Belinkov, Nadir Durrani, Orhan Firat, Philipp Koehn, Graham Neubig, Juan Pino, Hassan Sajjad In Proceedings of the Fourth Conference on Machine Translation 2019 [Abstract] [PDF] [URL]
  4. LSTM Networks Can Perform Dynamic Counting. Mirac Suzgun, Sebastian Gehrmann, Yonatan Belinkov, Stuart Shieber In Proceedings of the First Workshop on Deep Learning and Formal Languages: Building Bridges 2019 [Abstract] [PDF] [Arxiv]
  5. Improving Neural Language Models by Segmenting, Attending, and Predicting the Future. Hongyin Luo, Lan Jiang, Yonatan Belinkov, James Glass In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL) 2019 [Abstract] [PDF] [Arxiv]
  6. Character-based Surprisal as a Model of Human Reading in the Presence of Errors. Michael Hahn, Frank Keller, Yonatan Bisk, Yonatan Belinkov In Proceedings of the 41st Annual Meeting of the Cognitive Science Society (CogSci, Oral presentation) 2019 [Abstract] [PDF] [Arxiv]
  7. Don’t Take the Premise for Granted: Mitigating Artifacts in Natural Language Inference. Yonatan Belinkov*, Adam Poliak*, Stuart M. Shieber, Benjamin Van Durme, Alexander M. Rush In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL) 2019 [Abstract] [PDF] [Slides] [Code] [Arxiv] [Talk] [Media: Havard News, TechXplore]
  8. Linguistic Knowledge and Transferability of Contextual Representations. Nelson F. Liu, Matt Gardner, Yonatan Belinkov, Matthew Peters, Noah A. Smith In Proceedings of the 17th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) 2019 [Abstract] [PDF] [Arxiv]
  9. Adversarial Regularization for Visual Question Answering: Strengths, Shortcomings, and Side Effects. Gabriel Grand, Yonatan Belinkov In Proceedings of the 2nd Workshop on Shortcomings in Vision and Language (SiVL) at NAACL-HLT 2019 Best paper award [Abstract] [PDF] [Arxiv]
  10. One Size Does Not Fit All: Comparing NMT Representations of Different Granularities. Nadir Durrani, Fahim Dalvi, Hassan Sajjad, Yonatan Belinkov, Preslav Nakov In Proceedings of the 17th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) 2019 [Abstract] [PDF]
  11. On Adversarial Removal of Hypothesis-only Bias in Natural Language Inference. Yonatan Belinkov*, Adam Poliak*, Stuart M. Shieber, Benjamin Van Durme, Alexander M. Rush In Proceedings of the Eighth Joint Conference on Lexical and Computational Semantics (*SEM, Oral presentation) 2019 [Abstract] [PDF] [Slides] [Code] [Arxiv] [Media: Havard News, TechXplore]
  12. Identifying and Controlling Important Neurons in Neural Machine Translation. D. Anthony Bau*, Yonatan Belinkov*, Hassan Sajjad, Nadir Durrani, Fahim Dalvi, James Glass In International Conference on Learning Representations (ICLR) 2019 [Abstract] [PDF] [Poster] [Arxiv]
  13. Studying the History of the Arabic Language: Language Technology and a Large-Scale Historical Corpus. Yonatan Belinkov, Alexander Magidow, Alberto Barrón-Cedeño, Avi Shmidman, Maxim Romanov Language Resources and Evaluation 2019 [Abstract] [PDF] [Code] [Arxiv] [URL]
  14. NeuroX: A Toolkit for Analyzing Individual Neurons in Neural Networks. Fahim Dalvi, Avery Nortonsmith, D. Anthony Bau, Yonatan Belinkov, Hassan Sajjad, Nadir Durrani, James Glass In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI): Demonstrations Track 2019 [Abstract] [PDF] [Code] [Arxiv] [Media: MIT News, ACM Tech News]
  15. On Evaluating the Generalization of LSTM Models in Formal Languages. Mirac Suzgun, Yonatan Belinkov, Stuart M. Shieber In Proceedings of the Society for Computation in Linguistics (SCiL) 2019 [Abstract] [PDF] [Code] [Arxiv]
  16. What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models. Fahim Dalvi, Nadir Durrani, Hassan Sajjad, Yonatan Belinkov, D. Anthony Bau, James Glass In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI, Oral presentation) 2019 [Abstract] [PDF] [Poster] [Arxiv] [Media: MIT News, ACM Tech News]
  17. Analysis Methods in Neural Language Processing: A Survey. Yonatan Belinkov, James Glass Transactions of the Association for Computational Linguistics (TACL) 2019 [Abstract] [PDF] [Poster] [Arxiv] [URL]

2018

  1. On the Evaluation of Semantic Phenomena in Neural Machine Translation Using Natural Language Inference. Adam Poliak, Yonatan Belinkov, James Glass, Benjamin Van Durme In Proceedings of the 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) 2018 [Abstract] [PDF] [Code] [Arxiv]
  2. On Internal Language Representations in Deep Learning: An Analysis of Machine Translation and Speech Recognition. Yonatan Belinkov PhD Thesis, Massachusetts Institute of Technology 2018 [PDF]
  3. Synthetic and Natural Noise Both Break Neural Machine Translation. Yonatan Belinkov*, Yonatan Bisk* In International Conference on Learning Representations (ICLR, Oral presentation) 2018 [Abstract] [PDF] [Code] [Arxiv] [Media: Taiwanese Tech news, The Gradient]

2017

  1. Analyzing Hidden Representations in End-to-End Automatic Speech Recognition Systems. Yonatan Belinkov, James Glass In Advances in Neural Information Processing Systems (NIPS) 2017 [Abstract] [PDF] [Poster] [Code] [Arxiv] [Media: MIT News, ACM Tech News]
  2. Neural Machine Translation Training in a Multi-Domain Scenario. Hassan Sajjad, Nadir Durrani, Fahim Dalvi, Yonatan Belinkov, Stephan Vogel In Proceedings of the International Workshop on Spoken Language Translation (IWSLT) 2017 [Abstract] [PDF] [Arxiv]
  3. Understanding and Improving Morphological Learning in the Neural Machine Translation Decoder. Fahim Dalvi, Nadir Durrani, Hassan Sajjad, Yonatan Belinkov, Stephan Vogel In Proceedings of the 8th International Joint Conference on Natural Language Processing (IJCNLP) 2017 [Abstract] [PDF] [Code] [Media: MIT News]
  4. Evaluating Layers of Representation in Neural Machine Translation on Part-of-Speech and Semantic Tagging Tasks. Yonatan Belinkov, Lluís Màrquez, Hassan Sajjad, Nadir Durrani, Fahim Dalvi, James Glass In Proceedings of the 8th International Joint Conference on Natural Language Processing (IJCNLP) 2017 [Abstract] [PDF] [Code] [Arxiv] [Media: MIT News, ACM Tech News]
  5. Analysis of sentence embedding models using prediction tasks in natural language processing. Yossi Adi, Einat Kermany, Yonatan Belinkov, Ofer Lavi, Yoav Goldberg IBM Journal of Research and Development 2017 [Abstract] [URL]
  6. Language processing and learning models for community question answering in Arabic. Salvatore Romeo, Giovanni Da San Martino, Yonatan Belinkov, Alberto Barrón-Cedeño, Mohamed Eldesouki, Kareem Darwish, Hamdy Mubarak, James Glass, Alessandro Moschitti Information Processing & Management 2017 [Abstract] [PDF]
  7. QMDIS: QCRI-MIT Advanced Dialect Identification System. Sameer Khurana, Maryam Najafian, Ahmed Ali, Tuka Al Hanai, Yonatan Belinkov, James Glass In Proceedings of Interspeech 2017 [Abstract] [PDF]
  8. What do Neural Machine Translation Models Learn about Morphology?. Yonatan Belinkov, Nadir Durrani, Fahim Dalvi, Hassan Sajjad, James Glass In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL) 2017 [Abstract] [PDF] [Poster] [Code] [Arxiv] [Talk] [Media: NLP Highlights]
  9. Challenging Language-Dependent Segmentation for Arabic: An Application to Machine Translation and Part-of-Speech Tagging. Hassan Sajjad, Fahim Dalvi, Nadir Durrani, Ahmed Abdelali, Yonatan Belinkov, Stephan Vogel In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL) 2017 [Abstract] [PDF] [Arxiv]
  10. Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks. Yossi Adi, Einat Kermany, Yonatan Belinkov, Ofer Lavi, Yoav Goldberg In International Conference on Learning Representations (ICLR) 2017 [Abstract] [PDF] [Arxiv]

2016

  1. Shamela: A Large-Scale Historical Arabic Corpus. Yonatan Belinkov, Alexander Magidow, Maxim Romanov, Avi Shmidman, Moshe Koppel In Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH at Coling) 2016 [Abstract] [PDF] [Slides] [Arxiv]
  2. Neural Attention for Learning to Rank Questions in Community Question Answering. Salvatore Romeo, Giovanni Da San Martino, Alberto Barrón-Cedeño, Alessandro Moschitti, Yonatan Belinkov, Wei-Ning Hsu, Yu Zhang, Mitra Mohtarami, James Glass In Proceedings of the 26th International Conference on Computational Linguistics: Technical Papers (Coling) 2016 [Abstract] [PDF]
  3. A Character-level Convolutional Neural Network for Distinguishing Similar Languages and Dialects. Yonatan Belinkov, James Glass In Proceedings of the Third Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial at Coling) 2016 [Abstract] [PDF] [Poster] [Code] [Arxiv]
  4. Large-Scale Machine Translation between Arabic and Hebrew: Available Corpora and Initial Results. Yonatan Belinkov, James Glass In Proceedings of the Workshop on Semitic Machine Translation (SeMaT at AMTA) 2016 [Abstract] [PDF] [Slides] [Arxiv]
  5. Improving Sequence to Sequence Learning for Morphological Inflection Generation: The BIU-MIT Systems for the SIGMORPHON 2016 Shared Task for Morphological Reinflection. Roee Aharoni, Yoav Goldberg, Yonatan Belinkov In Proceedings of the 14th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology (SIGMORPHON at ACL) 2016 [Abstract] [PDF]
  6. SLS at SemEval-2016 Task 3: Neural-based Approaches for Ranking in Community Question Answering. Mitra Mohtarami, Yonatan Belinkov, Wei-Ning Hsu, Yu Zhang, Tao Lei, Kfir Bar, Scott Cyphers, Jim Glass In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval) 2016 [Abstract] [PDF]

2015

  1. Arabic Diacritization with Recurrent Neural Networks. Yonatan Belinkov, James Glass In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP) 2015 [Abstract] [PDF] [Poster] [Code]
  2. Answer Selection in Arabic Community Question Answering: A Feature-Rich Approach. Yonatan Belinkov, Alberto Barrón-Cedeño, Hamdy Mubarak In Proceedings of the Second Workshop on Arabic Natural Language Processing (ANLP) 2015 [Abstract] [PDF]
  3. VectorSLU: A Continuous Word Vector Approach to Answer Selection in Community Question Answering Systems. Yonatan Belinkov, Mitra Mohtarami, Scott Cyphers, James Glass In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval) 2015 [Abstract] [PDF]

2014

  1. Exploring Compositional Architectures and Word Vector Representations for Prepositional Phrase Attachment. Yonatan Belinkov, Tao Lei, Regina Barzilay, Amir Globerson Transactions of the Association for Computational Linguistics (TACL) 2014 [Abstract] [PDF] [Slides] [Code] [Talk]
  2. arTenTen: Arabic Corpus and Word Sketches. Tressy Arts, Yonatan Belinkov, Nizar Habash, Adam Kilgarriff, Vit Suchomel Journal of King Saud University - Computer and Information Sciences 2014 [Abstract] [PDF] [URL]
  3. The Arabic Dialect of Ǧisir izZarga: Linguistic description and a preliminary classification, with sample texts. Yonatan Belinkov Master's Thesis, Tel Aviv University 2014 [PDF]
  4. Neural Network Architectures for Prepositional Phrase Attachment Disambiguation. Yonatan Belinkov Master's Thesis, Massachusetts Institute of Technology 2014 [PDF]

2013

  1. Translating Dialectal Arabic to English. Hassan Sajjad, Kareem Darwish, Yonatan Belinkov In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL) 2013 [Abstract] [PDF]
  2. arTenTen: a new, vast corpus for Arabic. Yonatan Belinkov, Nizar Habash, Adam Kilgarriff, Noam Ordan, Ryan Roth, Vít Suchomel In Proceedings of the Second Workshop on Arabic Corpus Linguistics (WACL) 2013 [PDF]