Fangyin Wei

fwei@princeton.edu

I am a research scientist in the Deep Imagination Research Group at NVIDIA. My research lies at the intersection of computer vision, computer graphics, and machine learning. I am currently interested in 3D modeling, synthesis, and editing through the lens of machine learning.

I received my Ph.D. at Princeton University, where I was co-advised by Szymon Rusinkiewicz and Thomas Funkhouser. Prior to joining Princeton, I got my Bachelor's in Computer Science and Economy from Peking University. I was a research intern at Meta Reality Labs, Uber ATG R&D, Google Research, Microsoft Research Asia, and Stanford University.

/


News / Invited Talks



Publications

4d-rotor gaussian splatting

VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstruction

Hanlin Chen, Fangyin Wei, Chen Li, Tianxin Huang, Yunsong Wang, Gim Hee Lee
Conference on Neural Information Processing Systems (NeurIPS), 2024  
paper / webpage / code / bibtex
@inproceedings{chen:2024:vcrgaus,
   author = "Hanlin Chen and Fangyin Wei and Chen Li and Tianxing Huang and Yunsong Wang and Gim Hee Lee",
   title = "VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstruction",
   booktitle = "Advances in Neural Information Processing Systems",
   year = "2024"
}
            

4d-rotor gaussian splatting

4D-Rotor Gaussian Splatting: Towards Efficient Novel-View Synthesis for Dynamic Scenes

Yuanxing Duan*, Fangyin Wei*, Qiyu Dai, Yuhang He, Wenzheng Chen, Baoquan Chen
Proc. SIGGRAPH, 2024  
paper / webpage / code / bibtex
@inproceedings{duan:2024:4drotorgs,
   author = "Yuanxing Duan and Fangyin Wei and Qiyu Dai and Yuhang He and Wenzheng Chen and Baoquan Chen",
   title = "4D-Rotor Gaussian Splatting: Towards Efficient Novel-View Synthesis for Dynamic Scenes",
   booktitle = "Proc. SIGGRAPH",
   year = "2024",
   month = July
}
            

clutter removal

Clutter Detection and Removal in 3D Scenes with View-Consistent Inpainting

Fangyin Wei, Thomas Funkhouser, Szymon Rusinkiewicz
International Conference on Computer Vision (ICCV), 2023  
paper (full) / webpage / bibtex
@inproceedings{Wei:2023:CDA,
   author = "Fangyin Wei and Thomas Funkhouser and Szymon Rusinkiewicz",
   title = "Clutter Detection and Removal in {3D} Scenes with View-Consistent Inpainting",
   booktitle = "International Conference on Computer Vision (ICCV)",
   year = "2023",
   month = oct
}
            

Uni-3D

Uni-3D: A Universal Model for Panoptic 3D Scene Reconstruction

Xiang Zhang*, Zeyuan Chen*, Fangyin Wei, Zhuowen Tu
International Conference on Computer Vision (ICCV), 2023  
paper / code / bibtex
@InProceedings{Zhang_2023_ICCV,
    author    = {Zhang, Xiang and Chen, Zeyuan and Wei, Fangyin and Tu, Zhuowen},
    title     = {Uni-3D: A Universal Model for Panoptic 3D Scene Reconstruction},
    booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
    month     = {October},
    year      = {2023},
    pages     = {9256-9266}
}
            

articulated object

Self-supervised Neural Articulated Shape and Appearance Models

Fangyin Wei, Rohan Chabra, Lingni Ma, Christoph Lassner, Michael Zollhöfer,
Szymon Rusinkiewicz, Chris Sweeney, Richard Newcombe, Mira Slavcheva
Computer Vision and Pattern Recognition (CVPR), 2022  
paper (full) / webpage / bibtex
@inproceedings{wei2022nasam,
    title = {Self-supervised Neural Articulated Shape and Appearance Models},
    author = {Fangyin Wei and Rohan Chabra and Lingni Ma and Christoph
              Lassner and Michael Zollhoefer and Szymon Rusinkiewicz and Chris
              Sweeney and Richard Newcombe and Mira Slavcheva},
    booktitle = {Proceedings IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    year={2022}
}
            

semantic edit

Learning to Infer Semantic Parameters for 3D Shape Editing

Fangyin Wei, Elena Sizikova, Avneesh Sud, Szymon Rusinkiewicz, Thomas Funkhouser
International Conference on 3D Vision (3DV), 2020  
paper / supplement / arXiv (full) / bibtex
@inproceedings{Wei:2020:LTI,
   author = "Fangyin Wei and Elena Sizikova and Avneesh Sud and Szymon Rusinkiewicz
      and Thomas Funkhouser",
   title = "Learning to Infer Semantic Parameters for {3D} Shape Editing",
   booktitle = "International Conference on 3D Vision (3DV)",
   year = "2020",
   month = nov
}
            

NLOS Imaging

Learned Feature Embeddings for Non-Line-of-Sight Imaging and Recognition

Wenzheng Chen*, Fangyin Wei*, Kyros Kutulakos, Szymon Rusinkiewicz, Felix Heide
ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2020  
paper / supplement / webpage / code / bibtex
@article{Chen:NLOS:2020,
title = {Learned Feature Embeddings for Non-Line-of-Sight Imaging and Recognition},
author = {Wenzheng Chen and Fangyin Wei and Kiriakos N. Kutulakos and Szymon Rusinkiewicz and Felix Heide},
year = {2020},
issue_date = {December 2020}, 
publisher = {Association for Computing Machinery}, 
volume = {39}, 
number = {6}, 
journal = {ACM Transactions on Graphics (Proc. SIGGRAPH Asia)}, 
}
            

NLOS Detection and Tracking

Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar

Nicolas Scheiner*, Florian Kraus*, Fangyin Wei*, Buu Phan, Fahim Mannan, Nils Appenrodt, Werner Ritter, Jürgen Dickmann, Klaus Dietmayer, Bernhard Sick, Felix Heide
Computer Vision and Pattern Recognition (CVPR), 2020  
paper / webpage / code / bibtex
@InProceedings{scheiner2019seeing,
author={Scheiner, Nicolas and Kraus, Florian and Wei, Fangyin and Phan, Buu and Mannan, Fahim and Appenrodt, Nils and Ritter, Werner and Dickmann, J{\"u}rgen and Dietmayer, Klaus and Sick, Bernhard and Heide, Felix},
title={Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2020}
}
            

RSA

ADA-Tucker: Compressing deep neural networks via adaptive dimension adjustment tucker decomposition

Zhisheng Zhong, Fangyin Wei, Zhouchen Lin, Chao Zhang
Neural Networks 110: 104-115, 2019  
paper / bibtex
@article{DBLP:journals/nn/ZhongWLZ19,
  author    = {Zhisheng Zhong and
               Fangyin Wei and
               Zhouchen Lin and
               Chao Zhang},
  title     = {ADA-Tucker: Compressing deep neural networks via adaptive dimension
               adjustment tucker decomposition},
  journal   = {Neural Networks},
  volume    = {110},
  pages     = {104--115},
  year      = {2019},
  url       = {https://doi.org/10.1016/j.neunet.2018.10.016},
}
            

integral regression

Integral Human Pose Regression

Xiao Sun, Bin Xiao, Fangyin Wei, Shuang Liang, Yichen Wei
European Conference of Computer Vision (ECCV), 2018  
paper / code / bibtex
@InProceedings{sun2017integral,
  author    = {Xiao Sun and
               Bin Xiao and
	       Fangyin Wei and
               Shuang Liang and
               Yichen Wei},
  title     = {Integral Human Pose Regression},
  booktitle = {ECCV},
  year      = {2018}
  }
            

D^2AE

Exploring Disentangled Feature Representation Beyond Face Identification

Yu Liu*, Fangyin Wei*, Jing Shao*, Lu Sheng, Junjie Yan, Xiaogang Wang
Computer Vision and Pattern Recognition (CVPR), 2018  
paper/ webpage / poster / bibtex
@InProceedings{liu2018exploring,
  title={Exploring Disentangled Feature Representation Beyond Face Identification},
  author={Liu, Yu and Wei, Fangyin and Shao, Jing and Sheng, Lu and Yan, Junjie and Wang, Xiaogang},
  booktitle={CVPR},
  year={2018}
}
            

RSA

Recurrent Scale Approximation for Object Detection in CNN

Yu Liu, Hongyang Li , Junjie Yan, Fangyin Wei, Xiaogang Wang, Xiaoou Tang
International Conference of Computer Vision (ICCV), 2017  
paper / code / bibtex
@InProceedings{liu2018rsa,
  title={Recurrent Scale Approximation for Object Detection in {CNN}},
  author={Yu Liu and
          Hongyang Li and
          Junjie Yan and
          Fangyin Wei and
          Xiaogang Wang and
          Xiaoou Tang},
  booktitle={ICCV},
  year={2017}
}
            



Professional Services



Teaching


Teaching Assistant

Princeton University COS 526: Neural Rendering, Spring 2023

Princeton University COS 302: Mathematics for Numerical Computing and Machine Learning, Fall 2020

Princeton University COS 302: Mathematics for Numerical Computing and Machine Learning, Spring 2020

Princeton University COS 429: Computer Vision, Fall 2019

Web design stolen from Jon Barron