👤 Biography

Rongyu is a second-year dual Ph.D. candidate at Nanjing University and The Hong Kong Polytechnic University, where he is co-supervised by Prof. Yuan Du and Prof. Dan Wang. He is now a visiting student at Peking University under the supervision of Prof. Shanghang Zhang. Previously, he received the M.Phil. degree from The Chinese University of Hong Kong, Shenzhen, supervised by Prof. Fangxin Wang, the B.Mang. and B.Eng. degree from the joint program of Beijing University of Posts and Telecommunications and Queen Mary University of London. He has published more than 10 papers in top conference journals such as CVPR, AAAI, TMC, and TCSVT, etc.

Feel free to reach out, or learn more from My CV.

🎓 Educations

• The Hong Kong Polytechnic University (2023.09-Present) Dual Ph.D. in Computing Science
• Nanjing University (2023.09-Present) Dual Ph.D. in Electrical Science and Technology
• The Chinese University of Hong Kong, Shenzhen (2021.09-2023.03) M.Phil. in Computer and Information Engineering
• Beijing University of Posts and Telecommunications (2017.09-2021.06) Dual B.Mang. in E-Commerce Engineering with Law
• Queen Mary University of London (2017.09-2021.06) Dual B.Eng. in Electrical Engineering and Computer Sciences

🔥 News

📝 Publications

📒 Selected publications

TMC'2025

RepCaM++: Exploring Transparent Visual Prompt with Inference-time Re-parameterization for Neural Video Delivery

• Rongyu Zhang, Xize Duan, Jiaming Liu, Li Du, Yuan Du, Dan Wang, Shanghang Zhang, Fangxin Wang
• IEEE Transactions on Mobile Computing
  (TMC|CCF-A), 2025.
• [Paper] [Code]

TCSVT'2025

BEVUDA++: Geometric-aware Unsupervised Domain Adaptation for Multi-View 3D Object Detection

• Rongyu Zhang, Jiaming Liu, Xiaoqi Li, Xiaowei Chi, Dan Wang, Li Du, Yuan Du, Shanghang Zhang
• IEEE Transactions on Circuits and Systems for Video Technology
  (TCSVT|CAS-Q1), 2025.
• [Paper] [Code]

MM'2024

VeCAF: Vision-language Collaborative Active Finetuning with Training Objective Awareness

• Rongyu Zhang, Zefan Cai, Huanrui Yang, Zidong Liu, Denis Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Kurt Keutzer, Baobao Chang, Yuan Du, Li Du, Shanghang Zhang
• ACM International Conference on Multimedia
  (MM|CCF-A), 2024.
• [Paper] [Code]

AAAI'2024

Efficient Deweather Mixture-of-Experts with Uncertainty-aware Feature-wise Linear Modulation

• Rongyu Zhang, Yulin Luo, Jiaming Liu, Huanrui Yang, Zhen Dong, Denis Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Kurt Keutzer, Yuan Du, Shanghang Zhang
• The 38th AAAI Conference on Artificial Intelligence
  (AAAI|CCF-A), 2024.
• [Paper] [Code]

TMC'2024

Multi-level Personalized Federated Learning on Heterogeneous and Long-Tailed Data

• Rongyu Zhang, Yun Chen, Chenrui Wu, Fangxin Wang, Bo Li
• IEEE Transactions on Mobile Computing
  (TMC|CCF-A), 2024.
• [Paper] [Code]

📚 Full publications

*: Equal Contribution.
CCF-A/CAS-Q1 as First-author: AAAIx 1, ACM MMx 1, TMCx 1, TCSVTx 1

All  First author  Efficiency  Generalization 

• TMC'25RepCaM++: Exploring Transparent Visual Prompt with Inference-time Re-parameterization for Neural Video Delivery
  Rongyu Zhang, Xize Duan, Jiaming Liu, Li Du, Yuan Du, Dan Wang, Shanghang Zhang, Fangxin Wang
  

  PDF Code

• TCSVT'25BEVUDA++: Geometric-aware Unsupervised Domain Adaptation for Multi-View 3D Object Detection
  Rongyu Zhang, Jiaming Liu, Xiaoqi Li, Xiaowei Chi, Dan Wang, Li Du, Yuan Du, Shanghang Zhang
  

  PDF Code

• AAAI‘24Efficient Deweather Mixture-of-Experts with Uncertainty-aware Feature-wise Linear Modulation
  Rongyu Zhang, Yulin Luo, Jiaming Liu, Huanrui Yang, Zhen Dong, Denis Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Kurt Keutzer, Yuan Du, Shanghang Zhang
  

  PDF Code

• MM'24VeCAF: Vision-language Collaborative Active Finetuning with Training Objective Awareness
  Rongyu Zhang*, Zefan Cai*, Huanrui Yang*, Zidong Liu, Denis Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Kurt Keutzer, Baobao Chang, Yuan Du, Li Du, Shanghang Zhang
  

  PDF Code

• TMC'24Multi-level Personalized Federated Learning on Heterogeneous and Long-Tailed Data
  Rongyu Zhang, Yun Chen, Chenrui Wu, Fangxin Wang, Bo Li
  

  PDF Code

• Network'23Optimizing Efficient Personalized Federated Learning with Hypernetworks at Edge
  Rongyu Zhang, Yun Chen, Chenrui Wu, Fangxin Wang, Jiangchuan Liu
  

  PDF Code

• Nossdav'23RepCaM: Re-parameterization Content-aware Modulation for Neural Video Delivery
  Rongyu Zhang*, Lixuan Du*, Jiaming Liu*, Congcong Song, Fangxin Wang, Xiaoqi Li, Ming Lu, Yandong Guo, Shanghang Zhang
  

  PDF Code [Oral Presentation]

• ICME'23Cluster-driven GNN-based Federated Recommendation System with Biased Message Dropout
  Rongyu Zhang*, Yun Chen*, Chenrui Wu, Fangxin Wang
  

  PDF Code

• ICRA'24BEVUDA: Multi-geometric Space Alignments for Domain Adaptive BEV 3D Object Detection
  Jiaming Liu*, Rongyu Zhang*, Xiaowei Chi, Xiaoqi Li, Ming Lu, Yandong Guo, Shanghang Zhang
  

  PDF Code

• AAAI'25PAT: Pruning-Aware Tuning for Large Language Models
  Yijiang Liu, Huanrui Yang, Youxin Chen, Rongyu Zhang, Miao Wang, Yuan Du, Li Du
  

  PDF Code

• CVPR'23Cloud-Device Collaborative Adaptation to Continual Changing Environments in the Real-world
  Yulu Gan, Mingjie Pan, Rongyu Zhang, Zijian Ling, Lingran Zhao, Jiaming Liu, Shanghang Zhang
  

  PDF Code

• CVPR'23BEV-SAN: Accurate BEV 3D Object Detection via Slice Attention Networks
  Xiaowei Chi, Jiaming Liu, Ming Lu, Rongyu Zhang, Zhaoqing Wang, Yandong Guo, Shanghang Zhang
  

  PDF Code

• IoTJ'23FedAB: Truthful Federated Learning with Auction-based Combinatorial Multi-armed Bandit
  Chenrui Wu, Yifei Zhu, Rongyu Zhang, Yun Chen, Fangxin Wang, Shuguang Cui
  

  PDF Code

• arXiv'25MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation
  Rongyu Zhang*, Menghang Dong, Yuan Zhang, Liang Heng, Xiaowei Chi, Gaole Dai, Li Du, Yuan Du, Yanbing Jiang, Shanghang Zhang
  

  PDF Code

• Arxiv'25FBQuant: FeedBack Quantization for Large Language Models
  Yijiang Liu, Hengyu Fang, Liulu He, Rongyu Zhang, Yichuan Bai, Yuan Du, Li Du
  

  PDF Code

• arXiv'24Decomposing the Neural: Activation Sparsity via Mixture of Experts for Continual Test Time Adaptation
  Rongyu Zhang*, Aosong Cheng, Yulin Luo, Gaole Dai, Huanrui Yang, Jiaming Liu, Ran Xu, Li Du, Yuan Du, Yanbing Jiang, Shanghang Zhang
  

  PDF Code

• arXiv'24Implicit Neural Image Field for Biological Microscopy Image Compression
  Rongyu Zhang*, Gaole Dai*, Cheng-Ching Tseng*, Qingpo Wuwu*, Shaokang Wan*, Ming Lu, Tiejun Huang, Yu Zhou, Ali Ata Tuz, Matthias Gunzer, Jianxu Chen, Shanghang Zhang
  

  PDF Code

• arXiv'24Intuition-aware Mixture-of-Rank-1-Experts for Parameter Efficient Finetuning
  Yijiang Liu*, Rongyu Zhang*, Huanrui Yang, Kurt Keutzer, Yuan Du, Li Du, Shanghang Zhang
  

  PDF Code

• arXiv'24M2Chat: Empowering VLM for Multimodal LLM Interleaved Text-Image Generation
  Xiaowei Chi*, Rongyu Zhang*, Zhengkai Jiang, Yijiang Liu, Yatian Wang, Xingqun Qi, Wenhan Luo, Peng Gao, Shanghang Zhang, Qifeng Liu, Yike Guo
  

  PDF Code

• arXiv'24EVA: An Embodied World Model for Future Video Anticipation
  Xiaowei Chi, Hengyuan Zhang, Chun-Kai Fan, Xingqun Qi, Rongyu Zhang, Anthony Chen, Chi-min Chan, Wei Xue, Wenhan Luo, Shanghang Zhang, Yike Guo
  

  PDF Code

• arXiv'24ViML: A Video, Music, Language Unified Dataset for Understanding and Generation
  Xiaowei Chi, Aosong Chen, Pengjun Fang, Yatian Wang, Zeyue Tian, Yingqing He, Zhaoyang Liu, Xingqun Qi, Rongyu Zhang, Mengfei Li, Jiahao Pan, Yanbing Jiang, Wei Xue, Wenhan Luo, Qifeng Chen, Shanghang Zhang, Qifeng Liu, Yike Guo
  

  PDF Code

• arXiv'23Unimodal Training-Multimodal Prediction: Cross-modal Federated Learning with Hierarchical Aggregation
  Rongyu Zhang, Xiaowei Chi, Wenyi Zhang, Guiliang Liu, Fangxin Wang
  

  PDF Code

🥇 Honors and Awards

• (2025.09):  Hong Kong Post-Graduate Scholarship (HKPGS) with 18,840¥/month, PolyU
• (2025.01):  The First “Young Elite Scientist Sponsorship Program (Ph.D.)” with 40,000¥ (Only 3226 students were selected in the first year), China Association for Science and Technology (CAST)
• (2024.12):  Outstanding Ph.D. Candidate with 2,000¥/year, NJU
• (2024.12):  “Bank of Jiangsu” Scholarship with 5,000¥, NJU
• (2024.05):  Jiangsu Province Graduate Research and Practical Innovation Project “Mixture-of-Activation-Sparsity-Experts for Continuous Test-time Adaptation” with 15,000¥, NJU
• (2023.10):  The 2nd place of the SHIFT Challenge 2023 - Continuous Test-time Adaptation for Semantic Segmentation in the challenges of VCL Workshop with 2,000$, ICCV

💼 Services

Journal reviewer

• IEEE Transaction on Mobile Computing
• IEEE Transaction on Computers
• IEEE Transaction on Neural Networks and Learning Systems
• IEEE Internet of Things Journal
• IEEE Network

Conference reviewer

• CVPR 2025
• ACM MM 2024, 2025
• ICCV 2023, 2025

💻 Internships

• Beijing Academy of Artificial Intelligence (2024.08-2024.11) Research Intern, supervised by Prof. Shanghang Zhang
• OPPO Research Institute (2022.09-2023.03) Research Intern, supervised by Dr. Yandong Guo
• LENOVO Research Institute (2020.11-2021.05) Research Intern, supervised by Prof. Jiangtao Gong

😄 Miscellaneous