CLAW Lab

Connecting Language to Actions & the World

Our research focuses on

grounding

action taking

small robot giving a gift to another robot

and theory-of-mind

All of our current work assumes the importance of perception and/or world building as crucial to constructing semantic representations for and with language. The categories above correspond roughly to WS3, WS4, and WS5 in Experience Grounds Language

PhD Students

Yingshan Chang

@_Yingshanshe/her

Reasoning

LTI PhD

WebQA: Multihop and Multimodal QA

Jared Fernandez

@FernJaredhe/him

Efficiency

LTI & NSF GRFP

(co- Emma Strubell)

Vidhi Jain

@viddivjshe/her

Control

RI & FAIR AI resident

Tiffany Min

@SoYeonTiffMinshe/her

Embodiment

MLD

(co- Rus Salakhutdinov)

FILM: Following Instructions in Language with Modular Methods

Hao Zhu

@_Hao_Zhuhe/him/他

Theory-of-mind

LTI

(co- Graham Neubig)

Few-shot Language Coordination by Modeling Theory of Mind

MS Students

Josh Zhanson

@jzhansonhe/him

Self-Supervision

LTI MLT & NSF GRFP

MRSD Teleop

(co- Zackory Erickson)

Jashkumar Diyora he/him

Shruti Gangopadhyay she/her

Jigar Patel
he/him

Prakhar Pradeep he/him

Shivani Sivakumar she/her

Alumni, Undergraduates, and Visitors

2022	Xiaoyu (Erin) Zhang	5th year MS	Robot Collaboration	PhD @ UIUC
2021	Feiyu (Gavin) Zhu	Undergraduate	Video Summarization	co-Chris Paxton
2021	Blessing Bassey	Summer Intern	TextVQA
2021	Melanie Sclar	Summer Intern	Symmetric Theory-of-Mind	PhD @ UWashington