Xiaoming Zhao

Publications
[10]		GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh. Jing Wen, Xiaoming Zhao, Zhongzheng Ren, Alexander G. Schwing, and Shenlong Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024 [Paper] [Code] [Website] [bibtex] GoMAvatar introduces Gaussians-on-Mesh (GoM) representation for real-time, memory-efficient, and high-quality animatable human modeling. Is Generalized Dynamic Novel View Synthesis from Monocular Videos Possible Today? @inproceedings{wen2024GoM, title={{GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh}}, author={Jing Wen and Xiaoming Zhao and Zhongzheng Ren and Alex Schwing and Shenlong Wang}, booktitle={CVPR}, year={2024}, }
[9]		NeRFDeformer: NeRF Transformation from a Single View via 3D Scene Flows. Zhenggang Tang, Zhongzheng Ren, Xiaoming Zhao, Bowen Wen, Jonathan Tremblay, Stan Birchfield, and Alexander G. Schwing IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024 [bibtex] NeRFDeformer automatically modifies a NeRF representation based on a single RGB-D observation of a non-rigid transformed version of the original scene. Is Generalized Dynamic Novel View Synthesis from Monocular Videos Possible Today? @inproceedings{tang2024nerfdeformer, title={{NeRFDeformer: NeRF Transformation from a Single View via 3D Scene Flows}}, author={Zhenggang Tang and Zhongzheng Ren and Xiaoming Zhao and Bowen Wen and Jonathan Tremblay and Stan Birchfield and Alex Schwing}, booktitle={CVPR}, year={2024}, }
[8]		Pseudo-Generalized Dynamic View Synthesis from a Video. Xiaoming Zhao, Alex Colburn, Fangchang Ma, Miguel Angel Bautista, Joshua M. Susskind, and Alexander G. Schwing International Conference on Learning Representations (ICLR), 2024 [Paper] [Code] [Website] [bibtex] PGDVS provides an analysis framework for generalized dynamic view synthesis and finds with consistent depth estimations, scene-specific appearance optimization is NOT required. Is Generalized Dynamic Novel View Synthesis from Monocular Videos Possible Today? @inproceedings{Zhao2024PGDVS, title={{Pseudo-Generalized Dynamic View Synthesis from a Video}}, author={Xiaoming Zhao and Alex Colburn and Fangchang Ma and Miguel Angel Bautista and Joshua M. Susskind and Alexander G. Schwing}, booktitle={ICLR}, year={2024}, }
[7]		Occupancy Planes for Single-view RGB-D Human Reconstruction. Xiaoming Zhao, Yuan-Ting Hu, Zhongzheng Ren, and Alexander G. Schwing AAAI Conference on Artificial Intelligence (AAAI), 2023 [Paper] [Code] [bibtex] OPlanes provides more flexibility than voxel grids and enables to better leverage correlations than per-point classification. Occupancy Planes for Single-view RGB-D Human Reconstruction @inproceedings{Zhao2023Oplanes, title={{Occupancy Planes for Single-view RGB-D Human Reconstruction}}, author={Xiaoming Zhao and Yuan-Ting Hu and Zhongzheng Ren and Alexander G. Schwing}, booktitle={AAAI}, year={2023}, }
[6]		Generative Multiplane Images: Making a 2D GAN 3D-Aware. Xiaoming Zhao, Fangchang Ma, David Güera, Zhile Ren, Alexander G. Schwing, and Alex Colburn European Conference on Computer Vision (ECCV), 2022 (Oral Presentation) [Paper] [Code] [Website] [bibtex] Media: 机器之心 (Chinese) / MarkTechPost GMPI guarantees to be view-consistent and enables fast training (in less than half a day at a resolution of 1024²) and high FPS during inference. Generative Multiplane Images: Making a 2D GAN 3D-Aware @inproceedings{zhao2022gmpi, title = {Generative Multiplane Images: Making a 2D GAN 3D-Aware}, author = {Xiaoming Zhao and Fangchang Ma and David Güera and Zhile Ren and Alexander G. Schwing and Alex Colburn}, booktitle = {ECCV}, year = {2022}, }
[5]		Initialization and Alignment for Adversarial Texture Optimization. Xiaoming Zhao, Zhizhen Zhao, and Alexander G. Schwing European Conference on Computer Vision (ECCV), 2022 [Paper] [Code] [Website] [bibtex] Carefully designed initialization and alignment procedures enable benefiting from both classical and recent learning-based texture optimization techniques. Initialization and Alignment for Adversarial Texture Optimization @inproceedings{zhao2022tex, title = {Initialization and Alignment for Adversarial Texture Optimization}, author = {Xiaoming Zhao and Zhizhen Zhao and Alexander G. Schwing}, booktitle = {ECCV}, year = {2022}, }
[4]		Class-agnostic Reconstruction of Dynamic Objects from Videos. Zhongzheng Ren, Xiaoming Zhao, and Alexander G. Schwing (* denotes equal contribution) Neural Information Processing Systems (NeurIPS), 2021 [Paper] [Website] [bibtex] REDO enables class-agnostic geometry reconstruction for dynamic objects from RGB-D videos. Class-agnostic 4D Reconstruction from Videos @inproceedings{ren2021redo, title = {Class-agnostic Reconstruction of Dynamic Objects from Videos}, author = {Zhongzheng Ren$^\ast$ and Xiaoming Zhao$^\ast$ and Alexander G. Schwing}, booktitle = {NeurIPS}, year = {2021}, note = {$^\ast$ equal contribution}, }
[3]		The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation. Xiaoming Zhao, Harsh Agrawal, Dhruv Batra, and Alexander G. Schwing International Conference on Computer Vision (ICCV), 2021 [Paper] [Code] [Website] [bibtex] A well-trained visual odometry module can be a drop-in replacement for GPS and Compass sensor in PointGoal navigation. The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation @inproceedings{Zhao2021pointnav, title={{The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation}}, author={Xiaoming Zhao and Harsh Agrawal and Dhruv Batra and Alexander G. Schwing}, booktitle={ICCV}, year={2021}, }
[2]		Mitigating Data Scarcity in Protein Binding Prediction Using Meta-Learning. Yunan Luo, Jianzhu Ma, Xiaoming Zhao, Yufeng Su, Yang Liu, Trey Ideker, and Jian Peng (* denotes equal contribution) Research in Computational Molecular Biology (RECOMB), 2019 [Paper] [bibtex] Meta-learning and few-shot learning strategy can be utilized to mitigate the data scarcity issue in characterizing the specificity of less-studied kinases for protein-peptide binding prediction. Mitigating Data Scarcity in Protein Binding Prediction Using Meta-Learning @inproceedings{luo2019mitigating, title={{Mitigating Data Scarcity in Protein Binding Prediction Using Meta-Learning}}, author={Luo, Yunan and Ma, Jianzhu and Zhao, Xiaoming and Su, Yufeng and Liu, Yang and Ideker, Trey and Peng, Jian}, booktitle={Proc. RECOMB}, year={2019}, }
[1]		Integrating Thermodynamic and Sequence Contexts Improves Protein-RNA Binding Prediction. Yufeng Su, Yunan Luo, Xiaoming Zhao, Yang Liu, and Jian Peng PLOS Computational Biology, 2019 [Paper] [Code] [bibtex] A deep learning-based thermodynamic model is introduced for protein-RNA binding prediction. Integrating Thermodynamic and Sequence Contexts Improves Protein-RNA Binding Prediction @article{su2019integrating, title={{Integrating thermodynamic and sequence contexts improves protein-RNA binding prediction}}, author={Su, Yufeng and Luo, Yunan and Zhao, Xiaoming and Liu, Yang and Peng, Jian}, journal={PLOS Computational Biology}, year={2019}, }

Workshops
[2]		Learning from Synthesized Demonstrations. Xiaoming Zhao, Yang Liu, and Jian Peng International Conference on Machine Learning (ICML) Workshop on Learning in Artificial Open Worlds, 2020 [Poster] [bibtex] Learning from Synthesized Demonstrations @inproceedings{Zhao2020ICMLOpenWorldWS, title={{Learning from Synthesized Demonstrations}}, author={Xiaoming Zhao and Yang Liu and Jian Peng}, booktitle={Proc. ICML Workshop on Learning in Artificial Open Worlds}, year={2020}, }
[1]		Approximation Gradient Error Variance Reduced Optimization. Wei-Ye Zhao, Yang Liu, Xiaoming Zhao, Jie-Lin Qiu, and Jian Peng AAAI Conference on Artificial Intelligence (AAAI) Workshop on Reinforcement Learning in Games, 2019 [Paper] [bibtex] Approximation Gradient Error Variance Reduced Optimization @inproceedings{Zhao2019AAAIRLGameWS, title={{Approximation Gradient Error Variance Reduced Optimization}}, author={Wei-Ye Zhao and Yang Liu and Xiaoming Zhao and Jie-Lin Qiu and Jian Peng}, booktitle={Proc. AAAI Workshop on Reinforcement Learning in Games}, year={2019}, }

Publications

Workshops