Sean Hardesty Lewis
I am a predoctoral researcher at MIT working on embodied AI, world models, and scene understanding for large-scale physical and virtual environments.
Previously, I completed my M.S. in Information Science at Cornell Tech, where I was advised by Wendy Ju and Anthony Townsend. There, I created Searchable.City, a semantic world model built from over 50 million street-view images that enables natural-language search of the world.
I also created Human Operator, a vision-language decision support system for embodied AI that explored AI-guided human embodiment, reaching over 30 million views online.
Before Cornell, I received my B.S. in Mathematics from UT Austin, where I worked with Junfeng Jiao on AI systems for city-scale sensing and simulation.
I am interested in building AI systems that allow agents to understand, simulate, and act within complex 3D environments.

email:
end@mit.edu
selected publications
Searchable.City: An Open-Vocabulary Semantic Atlas
Sean Hardesty Lewis
In Proceedings of SIGGRAPH 2026
Minecraft to 3D: A Pipeline for High‑Fidelity Reconstruction of Minecraft Worlds
Sean Hardesty Lewis
In Proceedings of SIGGRAPH 2025
A Decentralized Digital Twin via Crowdsourced Sensing and Browser-Based Edge Computation
Sean Hardesty Lewis, Junfeng Jiao, Yiming Xu, Jihyung Park, Connor Phillips
Presented at AAAI 2026 Deployable AI Workshop
news
- Mar 2026
Won the MIT Media Lab HARD MODE hackathon with Human Operator, using VLMs and EMS to control human bodies.
- Feb 2026
Searchable.City is finally city-scale. Proud to turn this massive solo engineering challenge into a public reality.
- Oct 2025
Happy that StreamTwin was accepted to the Deployable AI Workshop at AAAI 2026. See you in Singapore! 🇸🇬
- Sep 2025
Thrilled to share that OpenCityCorpus was accepted to the NeurIPS AI4Science workshop. See you in San Diego! 🇺🇸
- Sep 2025
Proud of my identical twin brother Ryan on starting his PhD at MIT!
- Aug 2025Presented Minecraft to 3D at SIGGRAPH 2025 in Vancouver. 🇨🇦
- Aug 2024Started my M.S. at Cornell Tech in New York City.
- May 2024Graduated from UT Austin with a B.S. in Mathematics.
- Feb 2024Our work on emergency AI, SafeMate, was funded by the City of Austin.