Hello there! I’m Guodong Du, a PhD student at The Hong Kong Polytechnic University (PolyU). Before that, I was a research assistant at the Knowledge and Language Computing Lab @ Harbin Institute of Technology (Shenzhen), working with Prof. Jing Li. Earlier, I was a master’s student and research intern at the Learning and Vision Lab @ National University of Singapore, advised by Prof. Xinchao Wang and Jiashi Feng, and interned at Huawei Noah’s Ark Lab.
My research centers on large language models — model merging & knowledge fusion, post-training & alignment (RLHF / multi-objective), and training & inference efficiency (compression, pruning, quantization). More recently I also work on multimodal LLMs and embodied intelligence (Vision-Language-Action).
🔥 News
Good News Bad News.
- 2026.04: 🎉 One co-corresponding and one co-first author paper are accepted by ACL 2026 Findings.
- 2026.01: 🎉 One first author and one co-first author paper are accepted by ICLR 2026.
- 2025.08: 🎉 One co-corresponding paper is accepted by EMNLP 2025 main.
- 2025.05: 🎉 One first author and one co-first author paper are accepted by ACL 2025 main.
- 2024.09: 🎉 One first author paper is accepted by NeurIPS 2024.
- 2024.05: 🎉 One first author paper is accepted by ACL 2024 Findings.
📝 Recent Projects
- Knowledge Fusion: A Comprehensive Survey. Github Repo
- FuseVLA-benchmark — a systematic benchmark for VLA model merging.
- RoboMemPlan — memory-aware subtask planning for long-horizon embodied tasks.
📝 Publications
( bold: me · *: co-first author · †: corresponding author )
Model Merging & Knowledge Fusion
-
ICLR 2026Knowledge Fusion of Large Language Models Via Modular SkillPacks
Guodong Du, Xuanning Zhou, Junlin Lee, Zhuo Li, Wanyu Lin, Jing Li†
paper | code -
NeurIPS 2024Parameter Competition Balancing for Model Merging
Guodong Du, Junlin Lee, Jing Li†, Hanting Liu, Runhua Jiang, Shuyang Yu, Yifei Guo, Sim Kuan Goh, Ho-Kin Tang†, Min Zhang
paper | code -
EMNLP 2025 mainTo See a World in a Spark of Neuron: Disentangling Multi-task Interference for Training-free Model Merging
Zitao Fang, Guodong Du†, Jing Li, Ho-Kin Tang, Sim Kuan Goh†
paper | project -
ACL 2025 mainNeural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer
Guodong Du, Zitao Fang, Junlin Lee, Runhua Jiang, Jing Li†
paper | code -
ACL 2024 FindingsKnowledge Fusion By Evolving Weights of Language Models
Guodong Du, Jing Li, Hanting Liu, Runhua Jiang, Shuyang Yu, Yifei Guo, Sim Kuan Goh†, Ho-Kin Tang†
paper | code -
ACL 2026 FindingsSkill Weaving: Efficient LLM Improvement via Modular Skillpacks
Zhuo Li*, Guodong Du*, Zesheng Shi, Weiyang Guo, Jing Li†
paper -
PreprintDiDi-Merging: Dynamic Model Merging Made Slim
Guodong Du, Wanyu Lin†
paper
LLM Alignment & Post-training
ICLR 2026Multi-objective Large Language Model Alignment with Hierarchical Experts (HoE)
Zhuo Li, Guodong Du*, Wenya Wang, Min Zhang, Jing Li†
paper
Efficient & Compressed LLMs
ACL 2026 FindingsD-QReLO: Training- and Data-Free Delta Compression for LLMs via Quantization and Residual Low-Rank Approximation
Junlin Li, Guodong Du†, Ngai Wong, Min Zhang, Jing Li, Xuelong Li†
paper
Multimodal LLMs & Embodied Intelligence
ACL 2025 mainMulti-Modality Expansion and Retention for LLMs through Parameter Merging and Decoupling
Junlin Lee, Guodong Du*, Wenya Wang, Jing Li†
paper
Earlier Work (Low-level Vision & Evolutionary Methods)
IEEE SMC 2024Impacts of Darwinian Evolution on Pre-trained Deep Neural Networks, Guodong Du, et al.IEEE Cyber 2024MOESR: Multi-Objective Evolutionary Algorithm for Image Super-Resolution, Guodong Du, et al.CVPR 2021 WorkshopNTIRE 2021 challenge on video super-resolution, 3rd Place Award.ArXiv 2020End-to-end Rain Streak Removal with RAW Images, Guodong Du, et al.
🎖 Honors and Awards
- 2021.10 3rd Place Award in NTIRE 2021 Challenge on Video Super-resolution, Track I. (New Trends in Image Restoration and Enhancement Workshop, CVPR2021)
- 2017.09 National scholarship
- 2016.05 Honorable Award in MCM (The Mathematical Contest in Modeling)
- 2016.05 National Encouragement scholarship
- 2015.05 National Encouragement scholarship
📖 Educations
- 2025.08 - 2028.06 (expected), Ph.D. student, The Hong Kong Polytechnic University (PolyU)
- 2018.08 - 2019.05, M.S., National University of Singapore (NUS)
- 2016.07 - 2016.12, Visiting, City University of Hong Kong (CityU) (Non-degree Undergraduate Exchange)
- 2014.08 - 2018.06, B.S., University of Electronic Science and Technology of China (UESTC)
💻 Internships
- 2024.03 - 2024.09, Knowledge and Language Computing Lab, Shenzhen, China.
- 2023.03 - 2024.09, Harbin Institute of Technology (Shenzhen), China.
- 2019.09 - 2021.09, Learning and Vision Lab, Singapore.
- 2020.08 - 2021.04, Huawei Noah’s Ark Lab, Shenzhen, China.
- 2019.01 - 2019.09, Biomind, Singapore.
- 2018.01 - 2018.04, YoueData, Chengdu, China