Shenlong Wang  

Email / CV / Git / Google Scholar

I am an Assistant Professor at the UIUC Department of Computer Science, affiliated with Computer Vision @ UIUC, Illinois Robotics Group and Center for Immersive Computing @ UIUC. Before joining UIUC, I was a visiting scholar at the Intel Intelligent Systems Lab, working with Vladlen Koltun. I finished my PhD at Department of Computer Science, University of Toronto and worked as a research scientist at Uber ATG, working with Raquel Urtasun.

My research interests focus on the intersection of 3D computer vision and robotics, particularly in two areas: (a) developing computational algorithms to sense and perceive the 3D environments, and (b) creating accurate, realistic and physics-informed digital twins of objects and scenes. Our research group is exploring various topics within this field, such as robust and uncertainty-aware robot perception, modeling articulated objects from videos, generating 3D scenes and sensors through machine learning, developing certifiable and realistic simulations for autonomous driving, and creating physics-informed simulations for immersive computing and climate change.

News


Positions


We are always looking for motivated students to join us.

Current Group Members


PhD Students: Master Students: Visiting Students: Undergraduate Students: Past Members:

Teaching


Publications


Sim-on-Wheels: Physical World in the Loop Simulation for Autonomous Driving
Yuan Shen*, Bhargav Chandaka*, Zhi-Hao Lin, Albert Jianqiao Zhai, Hang Cui, David Forsyth, Shenlong Wang
Robotics and Automation Letters (RAL), 2023
[Paper] [Project] [Code]

Structure from Duplicates: Neural Inverse Graphics from a Pile of Objects
Tianhang Cheng, Wei-Chiu Ma, Kaiyu Guan, Antonio Torralba, Shenlong Wang
Neural Information Processing Systems (NeurIPS), 2023
[Paper] [Project] [Code]

ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field
Yuan Li*, Zhi-Hao Lin*, Jia-Bin Huang, David Forsyth, Shenlong Wang
International Conference on Computer Vision (ICCV), 2023
[Paper] [Project] [Code]

PEANUT: Predicting and Navigating to Unseen Targets
Albert Jianqiao Zhai, Shenlong Wang
International Conference on Computer Vision (ICCV), 2023
[Paper] [Project] [Code]

MapPrior: Bird's-Eye View Map Layout Estimation with Generative Models
Xiyue Zhu, Vlas Zyrianov, Zhijian Liu, Shenlong Wang
International Conference on Computer Vision (ICCV), 2023
[Paper] [Project] [Code]

ContactGen: Generative Contact Modeling for Grasp Generation
Shaowei Liu, Yang Zhou, Jimei Yang, Saurabh Gupta*, Shenlong Wang*
International Conference on Computer Vision (ICCV), 2023
[Paper] [Project] [Code]

Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Clouds
Shaowei Liu, Saurabh Gupta*, Shenlong Wang*
International Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[Paper] [Project] [Code]

DiffTune+: Hyperparameter-Free Auto-Tuning using Auto-Differentiation
Sheng Cheng, Lin Song, Minkyung Kim, Shenlong Wang, Naira Hovakimyan
Annual Learning for Dynamics and Control Conference (L4DC), 2023 (Oral)
[Paper] [Code]

CASA: Category-agnostic Skeletal Animal Reconstruction
Yuefan Wu*, Zeyuan Chen*, Shaowei Liu, Zhongzheng Ren, Shenlong Wang
Neural Information Processing Systems (NeurIPS), 2022
[Paper] [Project] [Code]

SGAM: Building a Virtual 3D World through Simultaneous Generation and Mapping
Yuan Shen, Wei-Chiu Ma, Shenlong Wang
Neural Information Processing Systems (NeurIPS), 2022
[Paper] [Project] [Code] [Video]

Learning to Generate Realistic LiDAR Point Cloud
Vlas Zyrianov, Xiyue Zhu, Shenlong Wang
European Conference on Computer Vision (ECCV), 2022
[Paper] [Project] [Code] [Video]

Virtual Correspondence
Wei-Chiu Ma, Joyce Yang, Shenlong Wang, Raquel Urtasun, Antonio Torralba
International Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[Paper] [Project] [Media] [Video]

NeurMiPs: Neural Mixture of Planar Experts for View Synthesis
Zhi-Hao Lin, Wei-Chiu Ma, Yu-Chiang Frank Wang, Hao-Yu Max Hsu, Shenlong Wang
International Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[Paper] [Project] [Code] [Video]

Mending Neural Implicit Modeling for 3D Vehicle Reconstruction in the Wild
Shivam Duggal*, Zihao Wang, Wei-Chiu Ma, Siva Manivasagam, Justin Liang*, Shenlong Wang Raquel Urtasun
Winter Conference on Applications of Computer Vision(WACV), 2022
[Paper] [Video]

GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Driving
Yun Chen*, Frieda Rong*, Shivam Duggal*, Shenlong Wang, Xinchen Yan, Siva Manivasagam, Shangjie Xue, Ersin Yumer, Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), 2021 (Oral, Best Paper Candidate)
[Paper] [Poster] [Video] [Project]

SceneGen: Learning to Generate Realistic Traffic Scenes
Shuhan Tan*, Kelvin Wong*, Shenlong Wang, Siva Manivasagam, Mengye Ren, Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), 2021
[Paper] [Video]

S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modeling
Ze Yang, Shenlong Wang, Siva Manivasagam, Zeng Huang, Wei-Chiu Ma, Xinchen Yan, Ersin Yumer, Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), 2021
[Paper] [Video]

Asynchronous Multi-View SLAM
Joyce Yang*, Can Cui*, Ioan Andrei Bârsan*, Raquel Urtasun, Shenlong Wang
International Conference on Robotics and Automation (ICRA), Xi'an, 2021
[Paper] [Supp] [Video] [Project]

MuSCLE: Multi Sweep Compression of LiDAR using Deep Entropy Models
Sourav Biswas, Jerry Liu, Kelvin Wong*, Shenlong Wang, Raquel Urtasun, Neural Information Processing Systems (NeurIPS), 2020
[Paper] [Video] [Project]

Pit30M: A Benchmark for Global Localization in the Age of Self-Driving Cars
Julieta Martinez, Sasha Doubov, Jack Fan, Ioan Andrei Bârsan, Shenlong Wang
Gellert Mattyus, Raquel Urtasun, International Conference on Intelligent Robots and Systems (IROS), 2020
[Paper] [Video] [Project] [Code & Data]

Deep Feedback Inverse Problem Solver
Wei-Chiu Ma, Shenlong Wang, Jiayuan Gu, Sivabalan Manivasagam, Antonio Torralba, Raquel Urtasun
European Conference on Computer Vision (ECCV), Glasgow, 2020 (Spotlight)
[Paper] [Video] [Project]

Conditional Entropy Coding for Efficient Video Compression
Jerry Liu, Shenlong Wang, Wei-Chiu Ma, Meet Shah, Rui Hu, Pranaab Dhawan, Raquel Urtasun
European Conference on Computer Vision (ECCV), Glasgow, 2020
[Paper] [Video]

Deep Structured self-Driving Network
Wenyuan Zeng, Shenlong Wang, Renjie Liao, Yun Chen, Bin Yang, Raquel Urtasun
European Conference on Computer Vision, Glasgow, 2020
[Paper]

 

LidarSIM: Realistic LiDAR Simulation by Leveraging the Real World
Sivabalan Manivasagam, Shenlong Wang, Kelvin Wong, Wenyuan Zeng, Bin Yang, Shuhan Tan, Mikita Sazanovich, Wei-Chiu Ma and Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 2020 (Oral)
[Paper]

 

OctSqueeze: Octree-Structured Entropy Model for LiDAR Compression
Lila Huang, Shenlong Wang, Kelvin Wong, Jerry Liu, and Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 2020 (Oral)
[Paper]

 

Identifying Unknown Instances for Autonomous Driving
Kelvin Wong, Shenlong Wang, Mengye Ren, and Raquel Urtasun
International Conference on Robot Learning (CoRL), Osaka, 2019 (Spotlight)
[Paper]

 

Efficient Graph Generation with Graph Recurrent Attention Networks
Renjie Liao, Yujia Li, Yang Song, Shenlong Wang, Charlie Nash, Yujia Li, William L. Hamilton, David Duvenaud, Raquel Urtasun, and Richard Zemel
Neural Information Processing Systems (NeurIPS), Vancouver, 2019
[Paper] [Code]

 

DSIC: Deep Stereo Image Compression
Jerry Liu, Shenlong Wang, and Raquel Urtasun
International Conference on Computer Vision (ICCV), Seoul, 2019 (Oral)
[Paper]

 

DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatch
Shivam Duggal, Shenlong Wang, Wei-Chiu Ma, Rui Hu, and Raquel Urtasun
International Conference on Computer Vision (ICCV), Seoul, 2019
[Paper] [Code]

 

Exploiting Sparse Semantic HD Maps for Self-Driving Vehicle Localization
Wei-Chiu Ma*, Ignacio Tartavull*, Ioan Andrei Bârsan*, Shenlong Wang*, Gellert Mattyus, Min Bai, Namdar Homayounfar, Shrinidhi K. Lakshmikanth, Andrei Pokrovsky Raquel Urtasun, International Conference on Intelligent Robots and Systems (IROS), 2020
[Paper] [Video]

Deep Rigid Instance Scene Flow
Wei-Chiu Ma, Shenlong Wang, Rui Hu, Yuwen Xiong, and Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 2019 (1st place on KITTI Scene Flow)
[Paper]

 

Learning to Localize through Compressed Binary Maps
Xinkai Wei*, Ioan Andrei Barsan*, Shenlong Wang*, Julieta Martinez, and Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 2019
[Paper]

 

Convolutional Recurrent Network for Road Boundary Extraction
Justin Liang*, Namdar Homayounfar*, Wei-Chiu Ma, Shenlong Wang, and Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 2019
[Paper]

 

Learning to Localize Using a LiDAR Intensity Map
Ioan Andrei Barsan*, Shenlong Wang*, Andrei Pokrovsky, and Raquel Urtasun
Conference on Robot Learning (CORL), Zurich, 2018 (Spotlight)
[Paper][Video]

 

Deep Multi-Sensor Lane Detection
Min Bai*, Gellert Mattyus*,Namdar Homayounfar,Shrinidhi Kowshika Lakshmikanth, Shenlong Wang, and Raquel Urtasun
International Conference on Intelligent Robots and Systems (IROS), Madrid, 2018
[Paper]

 

Deep Continuous Fusion for Multi-Sensor 3D Object Detection
Ming Liang, Bin Yang, Shenlong Wang, and Raquel Urtasun
European Conference on Computer Vision (ECCV), Munich, 2018 (1st place on KITTI BEV Detection)
[Paper]

 

Deep Parameteric Continuous Convolutional Neural Networks
Shenlong Wang*, Simon Suo*, Wei-Chiu Ma, Andrei Pokrovsky, and Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, 2018 (Spotlight)
[Paper]

 

TorontoCity: Seeing the World with a Million Eyes
Shenlong Wang, Min Bai*, Gellert Mattyus*, Hang Chu*, Wenjie Luo, Bin Yang, Justin Liang, Joel Cheverie, Sanja Fidler, Raquel Urtasun
International Conference on Computer Vision (ICCV), Venice, 2017 (Spotlight)
[Paper] [Update]

 

AutoScaler: Scale-Attention Networks for Visual Correspondence
Shenlong Wang, Linjie Luo, Ning Zhang and Jia Li
British Machine Vision Conference (BMVC), London, 2017 (Oral)
[Paper]

 

Find Your Way by Observing the Sun and Other Semantic Cues
Wei-Chiu Ma, Shenlong Wang, Sanja Fidler and Raquel Urtasun
International Conference on Robotics and Automation (ICRA), Singapore, 2017
[Paper] [Video]

 

Proximal Deep Structured Models
Shenlong Wang, Sanja Fidler and Raquel Urtasun
Neural Information Processing Systems (NeurIPS), Barcelona, 2016
[Paper][Supp][Code] [Data] [Update]

 

HouseCraft: Building Houses from Rental Ads and Street Views
Hang Chu, Shenlong Wang, Sanja Fidler and Raquel Urtasun
European Conference on Computer Vision (ECCV), Amsterdam, 2016
[Paper] [Code] [Data]

 

Holoportation: Virtual 3D Teleportation in Real-time
Sergio Orts-Escolano et al.
User Interface Software and Technology Symposium European (UIST), Tokyo, 2016 (Oral)
[Paper] [Video]

 

The Global Patch Collider
Shenlong Wang, Sean Fanello, Christoph Rhemann, Shahram Izadi and Pushmeet Kohli
International Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, 2016 (Oral)
[Paper] [OpenCV]

 

HD Maps: Fine-grained Road Segmentation by Parsing Ground and Aerial Images
Gellert Mattyus, Shenlong Wang, Sanja Fidler and Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, 2016
[Paper] [Data][Video]

 

Lost Shopping! Monocular Localization in Large Indoor Spaces
Shenlong Wang, Sanja Fidler and Raquel Urtasun
International Conference on Computer Vision (ICCV), Santiago, 2015 (Oral)
[Paper] [Data]

 

Enhancing World Maps by Parsing Aerial Images
Gellert Mattyus, Shenlong Wang, Sanja Fidler and Raquel Urtasun
International Conference on Computer Vision (ICCV), Santiago, 2015 [Paper] [Code] [Data][Video]

 

Holistic 3D Scene Understanding from a Single Geo-tagged Image
Shenlong Wang, Sanja Fidler and Raquel Urtasun
International Conference on Computer Vision and Pattern Recognition (CVPR), Boston, 2015 (Oral)
[Paper] [Code]

 
     

Efficient Inference for Contiuous Markov Random Fields with Polynomial Potentials
Shenlong Wang, Alex Schwing and Raquel Urtasun
Neural Information Processing Systems (NeurIPS), Montreal, 2014
[Paper] [Code]

 
     

Transductive Gaussian Process on Image Denoising
Shenlong Wang, Lei Zhang and Raquel Urtasun
International Conference on Computational Photography (ICCP), Santa Clara, 2014 (Oral)
[Paper] [Bibtex]

 
     

Semi-Coupled Dictionary Learning with Applications in Image Super-resolution and Photo-Sketch Synthesis
Shenlong Wang, Lei Zhang and Yan Liang
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, 2012
[Paper] [Code]

 
     
Nonlocal Spectral Prior Model for Low-level Vision
Shenlong Wang, Lei Zhang and Yan Liang
Asian Conference on Computer Vision (ACCV), Korea, 2012
[Paper] [Bibtex]
 
     
Relaxed Collaborative Representation for Pattern Classification
Meng Yang, Lei Zhang, David Zhang and Shenlong Wang
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, 2012
[Paper] [Bibtex]
 

Services


Honors and Awards


Talks


Miscs


I take photos in my spare time: I have a lovely daughter, Dorie.