Publications

or
WebQA: Multihop and Multimodal QA
ArXiv
Yingshan Chang, Mridu Narang, Hisami Suzuki, Guihong Cao, Jianfeng Gao,
Yonatan Bisk

Dependency Induction Through the Lens of Visual Perception
The SIGNLL Conference on Computational Natural Language Learning
Ruisi Su, Shruti Rijhwani, Hao Zhu, Junxian He, Xinyu Wang,
Yonatan Bisk
, Graham Neubig
Language Grounding with 3D Objects
Conference on Robot Learning (CoRL)
Jesse Thomason, Mohit Shridhar,
Yonatan Bisk
, Chris Paxton, Luke Zettlemoyer
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
International Conference on Computer Vision
Jianwei Yang,
Yonatan Bisk
, Jianfeng Gao
KB-VLP: Knowledge Based Vision and Language Pretraining
ICML21 Workshop on Self-Supervised Learning
Kezhen Chen, Qiuyuan Huang,
Yonatan Bisk
, Daniel McDuff, Jianfeng Gao
Few-shot Language Coordination by Modeling Theory of Mind
The Thirty-eighth International Conference on Machine Learning
Hao Zhu, Graham Neubig,
Yonatan Bisk

Grounding `Grounding' in NLP
Findings of The 2021 Conference of the Association for Computational Linguistics
Khyathi Raghavi Chandu,
Yonatan Bisk
, Alan W Black
Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models
ArXiv
Tejas Srinivasan,
Yonatan Bisk

An Empirical Study on the Generalization Power of Neural Representations Learned via Visual Guessing Games
The 2021 Conference of the European Chapter of the Association for Computational Linguistics
Alessandro Suglia,
Yonatan Bisk
, Ioannis Konstas, Antonio Vergari, Emanuele Bastianelli, Andrea Vanzo, Oliver Lemon
Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering
35th AAAI Conference on Artificial Intelligence
Kaixin Ma, Filip Ilievski, Jonathan Francis,
Yonatan Bisk
, Eric Nyberg, Alessandro Oltramari
  Code
ALFWorld: Aligning Text and Embodied Environments for Interactive Learning
Proceedings of the International Conference on Learning Representations
Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté,
Yonatan Bisk
, Adam Trischler, Matthew Hausknecht
Imagining Grounded Conceptual Representations from Perceptual Information in Situated Guessing Games
The 28th International Conference on Computational Linguistics
Alessandro Suglia, Antonio Vergari, Ioannis Konstas,
Yonatan Bisk
, Emanuele Bastianelli, Andrea Vanzo, Oliver Lemon
The Return of Lexical Dependencies: Neural Lexicalized PCFGs
Transactions of the Association for Computational Linguistics
Hao Zhu,
Yonatan Bisk
, Graham Neubig
  Code
Experience Grounds Language
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Yonatan Bisk
, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Chai, Mirella Lapata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, Joseph Turian
  Video  Slides
RMM: A Recursive Mental Model for Dialog Navigation
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings
Homero Roman Roman,
Yonatan Bisk
, Jesse Thomason, Asli Celikyilmaz, Jianfeng Gao
  Code
A Benchmark for Structured Procedural Knowledge Extraction from Cooking Videos
Workshop on NLP Beyond Text
Frank F. Xu, Lei Ji, Botian Shi, Junyi Du, Graham Neubig,
Yonatan Bisk
, Nan Duan
  Code
Multi-View Learning for Vision-and-Language Navigation
ArXiv
Qiaolin Xia, Xiujun Li, Chunyuan Li,
Yonatan Bisk
, Zhifang Sui, Jianfeng Gao, Yejin Choi, Noah A. Smith
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Mohit Shridhar, Jesse Thomason, Daniel Gordon,
Yonatan Bisk
, Winson Han, Roozbeh Mottaghi, Luke Zettlemoyer, Dieter Fox
PIQA: Reasoning about Physical Commonsense in Natural Language
Thirty-Fourth AAAI Conference on Artificial Intelligence
Yonatan Bisk
, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, Yejin Choi
  Slides
Robust Navigation with Language Pretraining and Stochastic Sampling
Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing
Xiujun Li, Chunyuan Li, Qiaolin Xia,
Yonatan Bisk
, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi
Defending Against Neural Fake News
Thirty-third Conference on Neural Information Processing Systems
Rowan Zellers, Ari Holtzman, Hannah Rashkin,
Yonatan Bisk
, Ali Farhadi, Franziska Roesner, Yejin Choi
  Demo  Models
FIND: Identifying Functionally and Structurally Important Features in Protein Sequences with Deep Neural Networks
bioRxiv
Ranjani Murali, James Hemp, Victoria Orphan,
Yonatan Bisk

Improving Robot Success Detection using Static Object Data
Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems
Rosario Scalise, Jesse Thomason,
Yonatan Bisk
, Siddhartha Srinivasa
  Video
Early Fusion for Goal Directed Robotic Vision
Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems
Aaron Walsman,
Yonatan Bisk
, Saadia Gabriel, Dipendra Misra, Yoav Artzi, Yejin Choi, Dieter Fox
HellaSwag: Can a Machine Really Finish Your Sentence?
Proceedings of the Association for Computational Linguistics
Rowan Zellers, Ari Holtzman,
Yonatan Bisk
, Ali Farhadi, Yejin Choi
From Recognition to Cognition: Visual Commonsense Reasoning
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Rowan Zellers,
Yonatan Bisk
, Ali Farhadi, Yejin Choi
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Liyiming Ke, Xiujun Li,
Yonatan Bisk
, Ari Holtzman, Zhe Gan, Jingjing Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
  Video
Prospection: Interpretable Plans From Language By Predicting the Future
Proceedings of the International Conference on Robotics and Automation (ICRA)
Chris Paxton,
Yonatan Bisk
, Jesse Thomason, Arunkumar Byravan, Dieter Fox
Shifting the Baseline: Single Modality Performance on Visual Navigation & QA
Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics
Jesse Thomason, Daniel Gordon,
Yonatan Bisk

Benchmarking Hierarchical Script Knowledge
Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics
Yonatan Bisk
, Jan Buys, Karl Pichotta, Yejin Choi
  Code
Character-based Surprisal as a Model of Reading Difficulty in the Presence of Errors
The 41st Annual Meeting of the Cognitive Science Society
Michael Hahn, Frank Keller,
Yonatan Bisk
, Yonatan Belinkov
SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Rowan Zellers,
Yonatan Bisk
, Roy Schwartz, Yejin Choi
  Talk
Inducing Grammars with and for Neural Machine Translation
Proceedings of the 2nd Workshop on Neural Machine Translation
Ke Tran,
Yonatan Bisk

Bridging HMMs and RNNs through Architectural Transformations
32nd Conference on Neural Information Processing Systems (NIPS 2018), IRASL workshop
Jan Buys,
Yonatan Bisk
, Yejin Choi
Synthetic and Natural Noise Both Break Neural Machine Translation
Proceedings of the 6th International Conference on Learning Representations
Yonatan Belinkov,
Yonatan Bisk

CHALET: Cornell House Agent Learning Environment
ArXiv Preprint 1801.07357
Claudia Yan, Dipendra Misra, Andrew Bennett, Aaron Walsman,
Yonatan Bisk
, Yoav Artzi
  Simulator
Learning Interpretable Spatial Operations in a Rich 3D Blocks World 
Proceedings of the Thirty-Second Conference on Artificial Intelligence (AAAI-18)
Yonatan Bisk
, Kevin Shih, Yejin Choi, Daniel Marcu
  Data  Poster
Natural Language Inference from Multiple Premises
Proceedings of the Eighth International Joint Conference on Natural Language Processing
Alice Lai,
Yonatan Bisk
, Julia Hockenmaier
Natural Language Communication with Robots
Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics
Yonatan Bisk
, Deniz Yuret, Daniel Marcu
  Data  Slides
Supertagging with LSTMs
Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics (Short Papers)
Ashish Vaswani,
Yonatan Bisk
, Kenji Sagae, Ryan Musa
Towards a Dataset for Human Computer Communication via Grounded Language Acquisition
Proceedings of the AAAI 2016 Workshop on Symbiotic Cognitive Systems
Yonatan Bisk
, Daniel Marcu, William Wong
Unsupervised Neural Hidden Markov Models
Proceedings of the Workshop on Structured Prediction for NLP
Ke Tran,
Yonatan Bisk
, Ashish Vaswani, Daniel Marcu, Kevin Knight
  Slides
Evaluating Induced CCG Parsers on Grounded Semantic Parsing
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing
Yonatan Bisk
, Siva Reddy, John Blitzer, Julia Hockenmaier, Mark Steedman
Unsupervised Grammar Induction with Combinatory Categorial Grammars
University of Illinois at Urbana-Champaign
Yonatan Bisk

Probing the Linguistic Strengths and Limitations of Unsupervised Grammar Induction
Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Yonatan Bisk
, Julia Hockenmaier
Labeled Grammar Induction with Minimal Supervision
Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)
Yonatan Bisk
, Christos Christodoulopoulos, Julia Hockenmaier
  Poster
An HDP Model for Inducing Combinatory Categorial Grammars
Transactions of the Association for Computational Linguistics
Yonatan Bisk
, Julia Hockenmaier
  Slides
Simple Robust Grammar Induction with Combinatory Categorial Grammar
Proceedings of the Twenty-Sixth Conference on Artificial Intelligence (AAAI-12)
Yonatan Bisk
, Julia Hockenmaier
Document-Topic Hierarchies from Document Graphs
Proceedings of the 21st ACM international conference on Information and knowledge management (CIKM 2012)
Tim Weninger,
Yonatan Bisk
, Jiawei Han
Induction of Linguistic Structure with Combinatory Categorial Grammars
NAACL HLT Workshop on Induction of Linguistic Structure
Yonatan Bisk
, Julia Hockenmaier
Normal-form parsing for CCGs with generalized composition and type-raising
Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010)
Julia Hockenmaier,
Yonatan Bisk