Connecting Language to Actions & the World

Our research focuses on
small robot watching TV grounding   small robot building a rocket action taking   small robot giving a gift to another robot and theory-of-mind
All of our current work assumes the importance of perception and/or world building as crucial to constructing semantic representations for and with language. The categories above correspond roughly to WS3, WS4, and WS5 in Experience Grounds Language

PhD Students

Jared Fernandez
Jared Fernandez
@FernJaredhe/him
small robot watching TV


Efficiency

LTI & NSF GRFP
(co- Emma Strubell)

Coming soon
small robot giving a gift to another robot





MRSD Teleopsmall robot building a rocket

(co- Zackory Erickson)

Jigar Patel
Jigar Patel
he/him



Alumni, Undergraduates, and Visitors

2022 Josh Zhanson MLT Embodied Vision Data & Applied Sci @ MSFT small robot watching TV
2022 Xiaoyu (Erin) Zhang 5th year MS Robot Collaboration PhD @ UIUC small robot watching TV
2021 Feiyu (Gavin) Zhu Undergrad Video Summarization co-Chris Paxton small robot watching TV
2021 Blessing Bassey Intern TextVQA small robot watching TV
2021 Melanie Sclar Intern Theory-of-Mind PhD @ UWashington small robot giving a gift to another robot