I am a final-year undergraduate at Renmin University of China, working under the supervision of Prof. Jun He (Renmin University) and Prof. Hongyan Liu (Tsinghua University). During my visit to HKUST, I was supervised by Prof. Qifeng Chen researching about VideoDPO. Now I am working with Dr.Junliang Guo at ML Group, MSRA.
My research interests include generative models, AI-generated content, video generation, and talking head generation. I also keep up with a wide range of research in AI, having explored papers on topics such as MLLM, diffusion models, PEFT, and RLHF, which I have saved here and here.
I am actively I am actively seeking 25 fall PhD opportunities. If my work aligns with your interests, please feel free to reach out to me.
You can find my CV here.
🔥 News
- 2024.12.19: 🎉🎉 We make the VideoDPO paper and code public!
- 2024.11.01: 🎉🎉 We make the VideoTuna V0.1.0 public!
- 2023.07: 🎉🎉 Emotalk is accepted by ICCV23.
📝 Publications
EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation
Ziqiao Peng, Haoyu Wu, Zhenbo Song, Hao Xu, Xiangyu Zhu, Hongyan Liu, Jun He, Zhaoxin Fan Project
- We propose an end-to-end neural network for speech-driven emotion-enhanced 3D facial animation.
VideoDPO: Omni-Preference Alignment for Video Diffusion Generation
Runtao Liu*, Haoyu Wu*, Ziqiang Zheng, Chen Wei, Yingqing He, Renjie Pi, Qifeng Chen
- We propose a whole pipeline for DPO finetuning video diffusion models.
- [preprint] VGG-Tex: A Vivid Geometry-Guided Facial Texture Estimation Model for High Fidelity Monocular 3D Face Reconstruction Haoyu Wu, Ziqiao Peng, Xukun Zhou, Yunfei Cheng, Jun He, Hongyan Liu, Zhaoxin Fan
📖 Educations
- 2021.09 - 2025.07 (now), Undergraduate student at Renmin University of China, Beijing, China.
- 2024.07 - 2025.01 (now), Visiting student supervised by Prof. Qifeng Chen at HKUST, Hong Kong, China.
💻 Internships
- 2024.11, ML Group, Microsoft Research Asia
📕 Teaching Experiences
- 2024.09 - 2025.01, Teaching Assistant of Introduction to Computer System (I), Renmin University of China.
💬 Invited Talks
- 2023.01, “Introduction to Linux” of ”Missing Classes” series in RUC Computer Association
- 2023.08, AITIME Debate about 3D digital human development | [video]
🎖 Honors and Awards
- 2022.11 The Chinese Mathematical Competition,First Prize