Shenlong Wang  

Email / Google Scholar / Twitter / CV

I am an Assistant Professor at the UIUC Department of Computer Science, affiliated with Computer Vision @ UIUC, Illinois Robotics Group and Center for Immersive Computing @ UIUC. I finished my PhD at Department of Computer Science, University of Toronto and worked as a research scientist at Uber, advised by Raquel Urtasun.

I work at the intersection of 3D vision and robotics. My group builds (a) spatial intelligence—algorithms that perceive, reconstruct, and reason about the 3D physical world; and (b) digital twins—physics-informed models that faithfully replicate the real world, simulate its dynamics, and even predict how it will evolve. We use these world models to power real-world decision-making in robotics, autonomous systems, immersive computing, and agricultural and ecological applications.

Positions


We are always looking for motivated students to join us.

Group Members


Tianhang Cheng
Tianhang Cheng
CS PhD(w/ Kaiyu Guan)
Hanxiao Jiang
Hanxiao Jiang
CS PhD(w/ Yunzhu Li)
Chih-Hao Lin
Chih-Hao Lin
CS PhD
Shaowei Liu
Shaowei Liu
CS PhD(w/ Saurabh Gupta)
Jing Wen
Jing Wen
CS PhD(w/ Alex Schwing)
Hongchi Xia
Hongchi Xia
CS PhD
Albert Zhai
Albert J. Zhai
CS PhD
Vlas Zyrianov
Vlas Zyrianov
CS PhD
Henry Che
Henry Che
CS MS
Jason Mei
Jason Mei
ECE MS
Gloria Wang
Gloria Wang
CS BS
Sydney Yu
Sydney Yu
CS BS

News Show Recent Show All


Publications Show Selected Show by Date


CropCraft: Complete Structural Characterization of Crop Plants from Images
Albert J. Zhai, Xinlei Wang, Kaiyuan Li, Zhao Jiang, Junxiong Zhou, Sheng Wang, Zhenong Jin, Kaiyu Guan, Shenlong Wang
3DV, 2026 (Oral)
[Paper] [Project] [Code]

Ada Thumbnail

Ada: A Distributed, Power-Aware, Real-Time Scene Provider for XR
Yihan Pang, Sushant Kondguli, Shenlong Wang, Sarita Adve
ISMAR, 2025 (Best Paper Award)
[Paper] [Project] [Code]

HoloScene: Simulation-Ready Interactive 3D Worlds from a Single Video
Hongchi Xia, Chih-Hao Lin, Hao-Yu Hsu, Quentin Leboutet, Katelyn Gao, Michael Paulitsch, Benjamin Ummenhofer, Shenlong Wang
NeurIPS, 2025
[Paper] [Project] [Code]

NoPo-Avatar: Generalizable and Animatable Avatars from Sparse Inputs without Human Poses
Jing Wen, Alex Schwing, Shenlong Wang
NeurIPS, 2025
[Paper] [Project] [Code]

Visual Sync Thumbnail

Visual Sync: Multi-Camera Synchronization via Cross-View Object Motion
Shaowei Liu*, David Yifan Yao*, Saurabh Gupta+, Shenlong Wang+
NeurIPS, 2025
[Paper] [Project] [Code]

Demeter Thumbnail

Demeter: A Parametric Model of Crop Plant Morphology from the Real World
Tianhang Cheng, Albert J. Zhai, Evan Z. Chen, Rui Zhou, Yawen Deng, Zitong Li, Kejie Zhao, Janice Shiu, Qianyu Zhao, Yide Xu, Xinlei Wang, Yuan Shen, Sheng Wang, Lisa Ainsworth, Kaiyu Guan, Shenlong Wang
ICCV, 2025
[Paper] [Project] [Code]

Controllable Weather Simulation and Removal with Video Diffusion Models
Chih-Hao Lin, Zian Wang, Ruofan Liang, Yuxuan Zhang, Sanja Fidler, Shenlong Wang, Zan Gojcic
ICCV, 2025
[Paper] [Project] [Data]

InvRGB+L Thumbnail

InvRGB+L: Inverse Rendering of Complex Scenes with Unified Color and LiDAR Reflectance Modeling
Xiaoxue Chen, Bhargav Chandaka, Chih-Hao Lin, Ya-Qin Zhang, David Forsyth, Hao Zhao, Shenlong Wang
ICCV, 2025
[Paper] [Project] [Code]

AD-GS Thumbnail

AD-GS: Object-Aware B-Spline Gaussian Splatting for Self-Supervised Autonomous Driving
Jiawei Xu, Kai Deng, Zexin Fan, Shenlong Wang, Jin Xie, Jian Yang
ICCV, 2025
[Paper] [Project] [Code]

PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos
Hanxiao Jiang, Hao-Yu Hsu, Kaifeng Zhang, Hsin-Ni Yu, Shenlong Wang, Yunzhu Li
ICCV, 2025
[Paper] [Project] [Code]

Human-like Navigation in a World Built for Humans
Bhargav Chandaka, Gloria X. Wang, Haozhe Chen, Henry Che, Albert J. Zhai, Shenlong Wang
CoRL, 2025
[Paper] [Project] [Code]

Map Space Belief Prediction Thumbnail

Map Space Belief Prediction for Manipulation-Enhanced Mapping
Joao Marcos Correia Marques, Nils Dengler, Jesper Mücke, Tobias Zaenker, Shenlong Wang, Maren Bennewitz, Kris Hauser
RSS, 2025
[Paper] [Project] [Code]

Uni4D: Unifying Large Vision Models for 4D Modeling from a Single Video
David Yifan Yao, Albert J. Zhai, Shenlong Wang
CVPR, 2025 (Highlight)
[Paper] [Project] [Code]

IRIS: Inverse Rendering of Indoor Scenes from Low Dynamic Range Images
Chih-Hao Lin, Jia-Bin Huang, Zhengqin Li, Zhao Dong, Christian Richardt, Michael Zollhöfer, Johannes Kopf, Shenlong Wang, Changil Kim
CVPR, 2025
[Paper] [Project] [Code]

DRAWER: Digital Reconstruction and Articulation With Environment Realism
Hongchi Xia, Entong Su, Marius Memmel, Arhan Jain, Raymond Yu, Numfor Mbiziwo-Tiapo, Ali Farhadi, Abhishek Gupta, Shenlong Wang, Wei-Chiu Ma
CVPR, 2025
[Paper] [Project] [Code]

PhysGen3D: Crafting a Miniature Interactive World from a Single Image
Boyuan Chen, Hanxiao Jiang, Shaowei Liu, Saurabh Gupta, Yunzhu Li, Hao Zhao, Shenlong Wang
CVPR, 2025
[Paper] [Project] [Code]

VoxelSplats Thumbnail

VoxelSplat: Dynamic Gaussian Splatting as an Effective Loss for Occupancy and Flow Prediction
Ziyue Zhu, Shenlong Wang, Jin Xie, Jiang-Jiang Liu, Jingdong Wang, Jian Yang
CVPR, 2025
[Paper] [Project] [Code]

Life-GOM: Generalizable Human Rendering with Learned Iterative Feedback Over Multi-Resolution Gaussians-on-Mesh
Jing Wen, Alex Schwing, Shenlong Wang
ICLR, 2025
[Paper] [Project] [Code]

LidarDM: Generative LiDAR Simulation in a Generated World
Vlas Zyrianov*, Henry Che*, Zhijian Liu, Shenlong Wang
ICRA, 2025
[Paper] [Project] [Code]

AutoVFX: Physically Realistic Video Editing from Natural Language Instructions
Hao-Yu Hsu, Chih-Hao Lin, Albert J. Zhai, Hongchi Xia, Shenlong Wang
3DV, 2025
[Paper] [Project] [Code]

MonoPatchNeRF: Improving Neural Radiance Fields with Patch-based Monocular Guidance
Yuqun Wu*, Jae Yong Lee*, Chuhang Zou, Shenlong Wang, Derek Hoiem
3DV, 2025
[Paper] [Project] [Code]

Plenoptic PNG: Real-Time Neural Radiance Fields in 150 KB
Jae Yong Lee, Yuqun Wu, Chuhang Zou, Derek Hoiem, Shenlong Wang
3DV, 2025
[Paper] [Project] [Code]

UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Video
Chih-Hao Lin, Bohan Liu, Yi-Ting Chen, Kuan Sheng Chen, David Forsyth, Jia-Bin Huang, Anand Bhattad, Shenlong Wang
3DV, 2025
[Paper] [Project] [Code]

RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulation
Hanxiao Jiang, Binghao Huang, Ruihai Wu, Zhuoran Li, Shubham Garg, Hooshang Nayyeri, Shenlong Wang, Yunzhu Li
CoRL, 2024
[Paper] [Project] [Code]

PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation
Shaowei Liu, Zhongzheng Ren, Saurabh Gupta*, Shenlong Wang*
ECCV, 2024
[Paper] [Project] [Code]

SuperGaussian: Repurposing Video Models for 3D Super Resolution
Yuan Shen, Duygu Ceylan, Paul Guerrero, Zexiang Xu, Niloy J. Mitra, Shenlong Wang, Anna Früshtück
ECCV, 2024
[PDF] [Project] [Code]

DiffTune: Auto-Tuning through Auto-Differentiation
Sheng Cheng, Minkyung Kim*, Lin Song*, Chengyu Yang, Yiquan Jin, Shenlong Wang, Naira Hovakimyan
TRO, 2024
[Paper] [Project] [Code]

Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video
Hongchi Xia, Chih-Hao Lin, Wei-Chiu Ma, Shenlong Wang
CVPR, 2024
[Paper] [Project] [Code]

NeRF2Physics: Physical Property Understanding from Language-Embedded Feature Fields
Albert J. Zhai, Yuan Shen, Emily Chen, Gloria Wang, Xinlei Wang, Sheng Wang, Kaiyu Guan, Shenlong Wang
CVPR, 2024
[Paper] [Project] [Code]

GoMAvatar: Efficient Animatable Human Modeling from Monocular VideoUsing Gaussians-on-Mesh
Jing Wen, Xiaoming Zhao, Zhongzheng Ren, Alex Schwing, Shenlong Wang
CVPR, 2024
[Paper] [Project] [Code]

Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relighting
Benjamin Ummenhofer, Sanskar Agrawal, Rene Sepulveda, Yixing Lao, Kai Zhang, Tianhang Cheng, Stephen Richter, Shenlong Wang, German Ros
3DV, 2024 (Oral)
[Paper] [Project] [Code]

On the Overconfidence Problem in Semantic 3D Mapping
Joao M C Marques, Albert J. Zhai, Shenlong Wang, Kris Hauser
ICRA, 2024
[Paper] [Project] [Code]

Sim-on-Wheels: Physical World in the Loop Simulation for Autonomous Driving
Yuan Shen*, Bhargav Chandaka*, Chih-Hao Lin, Albert J. Zhai, Hang Cui, David Forsyth, Shenlong Wang
RAL, 2023
[Paper] [Project] [Code]

Structure from Duplicates: Neural Inverse Graphics from a Pile of Objects
Tianhang Cheng, Wei-Chiu Ma, Kaiyu Guan, Antonio Torralba, Shenlong Wang
NeurIPS, 2023
[Paper] [Project] [Code]

ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field
Yuan Li*, Chih-Hao Lin*, Jia-Bin Huang, David Forsyth, Shenlong Wang
ICCV, 2023
[Paper] [Project] [Code]

PEANUT: Predicting and Navigating to Unseen Targets
Albert J. Zhai, Shenlong Wang
ICCV, 2023
[Paper] [Project] [Code]

MapPrior: Bird's-Eye View Map Layout Estimation with Generative Models
Xiyue Zhu, Vlas Zyrianov, Chihjian Liu, Shenlong Wang
ICCV, 2023
[Paper] [Project] [Code]

ContactGen: Generative Contact Modeling for Grasp Generation
Shaowei Liu, Yang Zhou, Jimei Yang, Saurabh Gupta*, Shenlong Wang*
ICCV, 2023
[Paper] [Project] [Code]

Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Clouds
Shaowei Liu, Saurabh Gupta*, Shenlong Wang*
CVPR, 2023
[Paper] [Project] [Code]

DiffTune+: Hyperparameter-Free Auto-Tuning using Auto-Differentiation
Sheng Cheng, Lin Song, Minkyung Kim, Shenlong Wang, Naira Hovakimyan
L4DC, 2023 (Oral)
[Paper] [Code]

CASA: Category-agnostic Skeletal Animal Reconstruction
Yuefan Wu*, Zeyuan Chen*, Shaowei Liu, Zhongzheng Ren, Shenlong Wang
NeurIPS, 2022
[Paper] [Project] [Code]

SGAM: Building a Virtual 3D World through Simultaneous Generation and Mapping
Yuan Shen, Wei-Chiu Ma, Shenlong Wang
NeurIPS, 2022
[Paper] [Project] [Code] [Video]

Learning to Generate Realistic LiDAR Point Cloud
Vlas Zyrianov, Xiyue Zhu, Shenlong Wang
ECCV, 2022
[Paper] [Project] [Code] [Video]

Virtual Correspondence
Wei-Chiu Ma, Joyce Yang, Shenlong Wang, Raquel Urtasun, Antonio Torralba
CVPR, 2022
[Paper] [Project] [Media] [Video]

NeurMiPs: Neural Mixture of Planar Experts for View Synthesis
Chih-Hao Lin, Wei-Chiu Ma, Yu-Chiang Frank Wang, Hao-Yu Max Hsu, Shenlong Wang
CVPR, 2022
[Paper] [Project] [Code] [Video]

Mending Neural Implicit Modeling for 3D Vehicle Reconstruction in the Wild
Shivam Duggal*, Zihao Wang, Wei-Chiu Ma, Siva Manivasagam, Justin Liang*, Shenlong Wang Raquel Urtasun
WACV, 2022
[Paper] [Video]

GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Driving
Yun Chen*, Frieda Rong*, Shivam Duggal*, Shenlong Wang, Xinchen Yan, Siva Manivasagam, Shangjie Xue, Ersin Yumer, Raquel Urtasun
CVPR, 2021 (Oral, Best Paper Candidate)
[Paper] [Poster] [Video] [Project]

SceneGen: Learning to Generate Realistic Traffic Scenes
Shuhan Tan*, Kelvin Wong*, Shenlong Wang, Siva Manivasagam, Mengye Ren, Raquel Urtasun
CVPR, 2021
[Paper] [Video]

S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modeling
Ze Yang, Shenlong Wang, Siva Manivasagam, Zeng Huang, Wei-Chiu Ma, Xinchen Yan, Ersin Yumer, Raquel Urtasun
CVPR, 2021
[Paper] [Video]

Asynchronous Multi-View SLAM
Joyce Yang*, Can Cui*, Ioan Andrei Bârsan*, Raquel Urtasun, Shenlong Wang
ICRA, 2021
[Paper] [Supp] [Video] [Project]

MuSCLE: Multi Sweep Compression of LiDAR using Deep Entropy Models
Sourav Biswas, Jerry Liu, Kelvin Wong*, Shenlong Wang, Raquel Urtasun
NeurIPS, 2020
[Paper] [Video] [Project]

Pit30M: A Benchmark for Global Localization in the Age of Self-Driving Cars
Julieta Martinez, Sasha Doubov, Jack Fan, Ioan Andrei Bârsan, Shenlong Wang
Gellert Mattyus, Raquel Urtasun
IROS, 2020 (Best Application Paper Runner-up)
[Paper] [Video] [Project] [Code & Data]

Deep Feedback Inverse Problem Solver
Wei-Chiu Ma, Shenlong Wang, Jiayuan Gu, Sivabalan Manivasagam, Antonio Torralba, Raquel Urtasun
ECCV, 2020 (Spotlight)
[Paper] [Video] [Project]

Conditional Entropy Coding for Efficient Video Compression
Jerry Liu, Shenlong Wang, Wei-Chiu Ma, Meet Shah, Rui Hu, Pranaab Dhawan, Raquel Urtasun
ECCV, 2020
[Paper] [Video]

Deep Structured self-Driving Network
Wenyuan Zeng, Shenlong Wang, Renjie Liao, Yun Chen, Bin Yang, Raquel Urtasun
ECCV, 2020
[Paper]

LidarSIM: Realistic LiDAR Simulation by Leveraging the Real World
Sivabalan Manivasagam, Shenlong Wang, Kelvin Wong, Wenyuan Zeng, Bin Yang, Shuhan Tan, Mikita Sazanovich, Wei-Chiu Ma and Raquel Urtasun
CVPR, 2020 (Oral)
[Paper]

OctSqueeze: Octree-Structured Entropy Model for LiDAR Compression
Lila Huang, Shenlong Wang, Kelvin Wong, Jerry Liu, and Raquel Urtasun
CVPR, 2020 (Oral)
[Paper]

Identifying Unknown Instances for Autonomous Driving
Kelvin Wong, Shenlong Wang, Mengye Ren, and Raquel Urtasun
CoRL, 2019 (Spotlight)
[Paper]

Efficient Graph Generation with Graph Recurrent Attention Networks
Renjie Liao, Yujia Li, Yang Song, Shenlong Wang, Charlie Nash, Yujia Li, William L. Hamilton, David Duvenaud, Raquel Urtasun, and Richard Zemel
NeurIPS, 2019
[Paper] [Code]

DSIC: Deep Stereo Image Compression
Jerry Liu, Shenlong Wang, and Raquel Urtasun
ICCV, 2019 (Oral)
[Paper]

DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatch
Shivam Duggal, Shenlong Wang, Wei-Chiu Ma, Rui Hu, and Raquel Urtasun
ICCV, 2019
[Paper] [Code]

Exploiting Sparse Semantic HD Maps for Self-Driving Vehicle Localization
Wei-Chiu Ma*, Ignacio Tartavull*, Ioan Andrei Bârsan*, Shenlong Wang*, Gellert Mattyus, Min Bai, Namdar Homayounfar, Shrinidhi K. Lakshmikanth, Andrei Pokrovsky, Raquel Urtasun
IROS, 2020
[Paper] [Video]

Deep Rigid Instance Scene Flow
Wei-Chiu Ma, Shenlong Wang, Rui Hu, Yuwen Xiong, and Raquel Urtasun
CVPR, 2019 (1st place on KITTI Scene Flow)
[Paper]

Learning to Localize through Compressed Binary Maps
Xinkai Wei*, Ioan Andrei Barsan*, Shenlong Wang*, Julieta Martinez, and Raquel Urtasun
CVPR, 2019
[Paper]

Convolutional Recurrent Network for Road Boundary Extraction
Justin Liang*, Namdar Homayounfar*, Wei-Chiu Ma, Shenlong Wang, and Raquel Urtasun
CVPR, 2019
[Paper]

Learning to Localize Using a LiDAR Intensity Map
Ioan Andrei Barsan*, Shenlong Wang*, Andrei Pokrovsky, and Raquel Urtasun
CORL, 2018 (Spotlight)
[Paper][Video]

Deep Multi-Sensor Lane Detection
Min Bai*, Gellert Mattyus*,Namdar Homayounfar,Shrinidhi Kowshika Lakshmikanth, Shenlong Wang, and Raquel Urtasun
IROS, 2018
[Paper]

Deep Continuous Fusion for Multi-Sensor 3D Object Detection
Ming Liang, Bin Yang, Shenlong Wang, and Raquel Urtasun
ECCV, 2018 (1st place on KITTI BEV Detection)
[Paper]

Deep Parameteric Continuous Convolutional Neural Networks
Shenlong Wang*, Simon Suo*, Wei-Chiu Ma, Andrei Pokrovsky, and Raquel Urtasun
CVPR, 2018 (Spotlight)
[Paper]

TorontoCity: Seeing the World with a Million Eyes
Shenlong Wang, Min Bai*, Gellert Mattyus*, Hang Chu*, Wenjie Luo, Bin Yang, Justin Liang, Joel Cheverie, Sanja Fidler, Raquel Urtasun
ICCV, 2017 (Spotlight)
[Paper] [Update]

AutoScaler: Scale-Attention Networks for Visual Correspondence
Shenlong Wang, Linjie Luo, Ning Zhang and Jia Li
BMVC, 2017 (Oral)
[Paper]

Find Your Way by Observing the Sun and Other Semantic Cues
Wei-Chiu Ma, Shenlong Wang, Sanja Fidler and Raquel Urtasun
ICRA, 2017
[Paper] [Video]

Proximal Deep Structured Models
Shenlong Wang, Sanja Fidler and Raquel Urtasun
NeurIPS, 2016
[Paper][Supp][Code] [Data] [Update]

HouseCraft: Building Houses from Rental Ads and Street Views
Hang Chu, Shenlong Wang, Sanja Fidler and Raquel Urtasun
ECCV, 2016
[Paper] [Code] [Data]

Holoportation: Virtual 3D Teleportation in Real-time
Sergio Orts-Escolano et al.
UIST, 2016 (Oral)
[Paper] [Video]

The Global Patch Collider
Shenlong Wang, Sean Fanello, Christoph Rhemann, Shahram Izadi and Pushmeet Kohli
CVPR, 2016 (Oral)
[Paper] [OpenCV]

HD Maps: Fine-grained Road Segmentation by Parsing Ground and Aerial Images
Gellert Mattyus, Shenlong Wang, Sanja Fidler and Raquel Urtasun
CVPR, 2016
[Paper] [Data][Video]

Lost Shopping! Monocular Localization in Large Indoor Spaces
Shenlong Wang, Sanja Fidler and Raquel Urtasun
ICCV, 2015 (Oral)
[Paper] [Data]

Enhancing World Maps by Parsing Aerial Images
Gellert Mattyus, Shenlong Wang, Sanja Fidler and Raquel Urtasun
ICCV, 2015 [Paper] [Code] [Data][Video]

Holistic 3D Scene Understanding from a Single Geo-tagged Image
Shenlong Wang, Sanja Fidler and Raquel Urtasun
CVPR, 2015 (Oral)
[Paper] [Code]

Efficient Inference for Contiuous Markov Random Fields with Polynomial Potentials
Shenlong Wang, Alex Schwing and Raquel Urtasun
NeurIPS, 2014
[Paper] [Code]

Transductive Gaussian Process on Image Denoising
Shenlong Wang, Lei Zhang and Raquel Urtasun
ICCP, 2014 (Oral)
[Paper] [Bibtex]

Semi-Coupled Dictionary Learning with Applications in Image Super-resolution and Photo-Sketch Synthesis
Shenlong Wang, Lei Zhang and Yan Liang
CVPR, 2012
[Paper] [Code]

Nonlocal Spectral Prior Model for Low-level Vision
Shenlong Wang, Lei Zhang and Yan Liang
ACCV, 2012
[Paper] [Bibtex]

Relaxed Collaborative Representation for Pattern Classification
Meng Yang, Lei Zhang, David Zhang and Shenlong Wang
CVPR, 2012
[Paper] [Bibtex]


Services


Selected Honors and Awards


Teaching


Talks Show Recent Show All