Sean Hardesty Lewis

I am a predoctoral researcher at MIT working on embodied AI, world models, and scene understanding for large-scale physical and virtual environments.

Previously, I completed my M.S. in Information Science at Cornell Tech, where I was advised by Wendy Ju and Anthony Townsend. There, I created Searchable.City, a semantic world model built from over 50 million street-view images that enables natural-language search of the world.

I also created Human Operator, a vision-language decision support system for embodied AI that explored AI-guided human embodiment, reaching over 30 million views online.

Before Cornell, I received my B.S. in Mathematics from UT Austin, where I worked with Junfeng Jiao on AI systems for city-scale sensing and simulation.

I am interested in building AI systems that allow agents to understand, simulate, and act within complex 3D environments.

Sean Hardesty Lewis profile picture

email:

end@mit.edu

selected publications

AI

Searchable.City: An Open-Vocabulary Semantic Atlas

Sean Hardesty Lewis

In Proceedings of SIGGRAPH 2026

DOIPDFCode
AI

Minecraft to 3D: A Pipeline for High‑Fidelity Reconstruction of Minecraft Worlds

Sean Hardesty Lewis

In Proceedings of SIGGRAPH 2025

DOIPDFCodePoster
Computer Vision

A Decentralized Digital Twin via Crowdsourced Sensing and Browser-Based Edge Computation

Sean Hardesty Lewis, Junfeng Jiao, Yiming Xu, Jihyung Park, Connor Phillips

Presented at AAAI 2026 Deployable AI Workshop

PDFCode

news

  • Mar 2026

    Won the MIT Media Lab HARD MODE hackathon with Human Operator, using VLMs and EMS to control human bodies.

  • Feb 2026

    Searchable.City is finally city-scale. Proud to turn this massive solo engineering challenge into a public reality.

  • Oct 2025

    Happy that StreamTwin was accepted to the Deployable AI Workshop at AAAI 2026. See you in Singapore! 🇸🇬

  • Sep 2025

    Thrilled to share that OpenCityCorpus was accepted to the NeurIPS AI4Science workshop. See you in San Diego! 🇺🇸

  • Sep 2025

    Proud of my identical twin brother Ryan on starting his PhD at MIT!

  • Aug 2025
    Presented Minecraft to 3D at SIGGRAPH 2025 in Vancouver. 🇨🇦
  • Aug 2024
    Started my M.S. at Cornell Tech in New York City.
  • May 2024
    Graduated from UT Austin with a B.S. in Mathematics.
  • Feb 2024
    Our work on emergency AI, SafeMate, was funded by the City of Austin.