Connecting Language to Actions & the World

Our research focuses on
small robot watching TV grounding   small robot building a rocket action taking   small robot giving a gift to another robot and theory-of-mind
All of our current work assumes the importance of perception and/or world building as crucial to constructing semantic representations for and with language. The categories above correspond roughly to WS3, WS4, and WS5 in Experience Grounds Language

PhD Students

Jared Fernandez
Jared Fernandez
@FernJaredhe/him
small robot watching TV


Efficiency

LTI & NSF GRFP
(co- Emma Strubell)

Vidhi Jain
Vidhi Jain
@viddivjshe/her
small robot building a rocket


Control

RI & FAIR AI resident

Coming soon
small robot giving a gift to another robot





MS Students

Josh Zhanson
Josh Zhanson
@jzhansonhe/him
small robot building a rocket


Self-Supervision

LTI MLT & NSF GRFP



MRSD Teleopsmall robot building a rocket

(co- Zackory Erickson)

Jigar Patel
Jigar Patel
he/him



Alumni, Undergraduates, and Visitors

2022 Xiaoyu (Erin) Zhang 5th year MS Robot Collaboration PhD @ UIUC small robot watching TV
2021 Feiyu (Gavin) Zhu Undergraduate Video Summarization co-Chris Paxton small robot watching TV
2021 Blessing Bassey Summer Intern TextVQA small robot watching TV
2021 Melanie Sclar Summer Intern Symmetric Theory-of-Mind PhD @ UWashington small robot giving a gift to another robot