Zhuo Li's Homepage

About Me

Hi, I am Zhuo Li. I obtained my PhD at The Chinese University of Hong Kong, Shenzhen, supervised by Dr. Xiang Wan and Prof. Tsung-Hui Chang in 2026. I obtained a B.E. degree in Data Science from Central South University in 2020. My research interests lie in data-centric machine learning and probabilistic methods. Currently, I am focused on aligning Large Language Models (LLMs) with downstream tasks and human preferences, including Reward Modeling and RLHF.

News

01/2026 One paper accepted by ICML 2026 Spotlight.
01/2026 Three paper accepted by ACL 2026.
01/2026 One paper accepted by ICLR 2026.
08/2025 One paper accepted by AAAI 2025.
08/2025 One paper accepted by NeurIPS 2025.
08/2025 Two papers accepted by EMNLP 2025.
07/2025 One paper accepted by TMLR 2025.
07/2025 One paper accepted by ACMMM 2025 Oral.
05/2025 One paper accepted by TMLR 2025.
05/2025 One paper accepted by ACL 2025 Oral.
02/2025 One paper accepted by TCSVT 2025.
01/2025 One paper accepted by NAACL 2025.

Selected Publications

Mitigating Reward Hacking in RLHF via Bayesian Non-negative Reward Modeling ICML 2026 Spotlight
Zhibin Duan, Guowei Rong, Zhuo Li, Bo Chen, Mingyuan Zhou, Dandan Guo
MARCH: Multi-Agent Reinforced Check for Hallucination ACL 2026
Zhuo Li*, Yupeng Zhang*, Pengyu Cheng, Jiajun Song, Mengyu Zhou, Hao Li, Shujie Hu, Yu Qin, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang
[Code]
Eliminating Inductive Bias in Reward Models with Information-Theoretic Guidance ICLR 2026
Zhuo Li, Pengyu Cheng, Zhechao Yu, Feifei Tong, Anningzhe Gao, Tsung-Hui Chang, Xiang Wan, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang.
[Code]
APLOT: Robust Reward Modeling via Adaptive Preference Learning with Optimal Transport EMNLP 2025
Zhuo Li, Yuege Feng, Dandan Guo, Jinpeng Hu, Anningzhe Gao, Xiang Wan.
[Code]
RLHF in an SFT Way: From Optimal Solution to Reward-Weighted Alignment TMLR
Yuhao Du*, Zhuo Li*, Pengyu Cheng*, Zhihong Chen, Yuejiao Xie, Xiang Wan, Anningzhe Gao.
[Code]
Add-One-In: Incremental Sample Selection for Large Language Models via a Choice-Based Greedy Paradigm EMNLP 2025
Zhuo Li, Yuhao Du, Xiaoqi Jiao, Steven Y. Guo, Yuege Geng, Xiang Wan, Anningzhe Gao, Jinpeng Hu.
[Code]

Safeguarding LLM Fine-tuning via Push-Pull Distributional Alignment ACL 2026
Haozhong Wang*, Zhuo Li*, Yibo Yang, He Zhao, Hongyuan Zha, Dandan Guo.
[Code]
Atoxia: Red-teaming Large Language Models with Target Toxic Answers NAACL 2025
Yuhao Du*, Zhuo Li*, Pengyu Cheng, Xiang Wan, Anningzhe Gao.
[Code]
Self-Instructed Derived Prompt Generation Meets In-Context Learning ACL 2025 Oral
Zhuo Li*, Yuhao Du*, Jinpeng Hu, Xiang Wan, Anningzhe Gao.
A Simple yet Effective Subsequence-Enhanced Approach for Cross-Domain NER AAAI 2023 Oral
Jinpeng Hu, Dandan Guo, Yang Liu, Zhuo Li, Zhihong Chen, Xiang Wan, Tsung-Hui Chang.
Graph Enhanced Contrastive Learning for Radiology Findings Summarization ACL 2022
Jinpeng Hu*, Zhuo Li*, Zhihong Chen, Zhen Li, Xiang Wan, Tsung-Hui Chang.
[Code]

Psyche-R1: Towards Reliable Psychological LLMs ACL 2026
Chongyuan Dai, Jinpeng Hu, Hongchang Shi, Zhuo Li, Xun Yang, Meng Wang.
[Code]
Beyond Emotion Recognition: A Multi-Turn Multimodal Emotion Understanding and Reasoning Benchmark ACMMM 2025
Jinpeng Hu, Hongchang Shi, Chongyuan Dai, Zhuo Li, Peipei Song, Meng Wang.
[Code]
AgentMental: An Interactive Multi-Agent Framework for Explainable and Adaptive Mental Health Assessment AAAI 2026
Jinpeng Hu, Ao Wang, Qianqian Xie, Hui Ma, Zhuo Li, Dan Guo.

Synthesizing Minority Samples for Long-tailed Classification via Distribution Matching TMLR 2025
Zhuo Li, He Zhao, Zhen Li, Dandan Guo, Xiang Wan, Hongyuan Zha.
[Code]
Prototype-oriented Clean Subset Extraction for Noisy Long-tailed Classification TCSVT 2025
Zhuo Li, He Zhao, Anningzhe Gao, Dandan Guo, Tsunghui Chang, Xiang Wan.
[Code]
Enhancing Minority Classes by Mixing: An Adaptive Optimal Transport Approach for Long-tailed Classification NeurIPS 2023
Jintong Gao, He Zhao, Zhuo Li, Dandan Guo.
[Code]
Learning to re-weight examples with optimal transport for imbalanced classification NeurIPS 2022
Dandan Guo, Zhuo Li, Meixi Zheng, He Zhao, Mingyuan Zhou, Hongyuan Zha.
[Code]
Diverse Condensed Data Generation via Class Preserving Distribution Matching TMLR
Dandan Guo, Zhuo Li, He Zhao, Mingyuan Zhou, Hongyuan Zha.

Rotary Position Embedding-Based Transformer Hawkes Process for Event-Type Big Data Big Data
Shan Dai, Anningzhe Gao, Zhuo Li, Yuhao Du.
Intermediate Domain Alignment and Morphology Analogy for Patent-Product Image Retrieval NeurIPS 2025
Haifan Gong, Xuanye Zhang, Ruifei Zhang, Yun Su, Zhuo Li, Yuhao Du, Xiang Wan, Anningzhe Gao, Haofeng Li.
[Code]
Toward Explainable and Fine-Grained 3D Grounding through Referring Textual Phrases TNNLS 2024
Zhihao Yuan*, Xu Yan*, Zhuo Li*, Xuhao Li, Yao Guo, Shuguang Cui, Zhen Li.
[Code]
Cognitive-Visual Fusion for Target Classification in Rapid SAR Image Series Visual Presentation Radar 2021
Wending Zhou*, Zhuo Li*, Xiang Wan, Ruimao Zhang, Liangcheng Qu, Zhen Li, Kuiying Yin.

Experience

Qwen, Alibaba | Jul. 2025 - Feb. 2026
Topic: Reward Hacking and RLHF. Mentor: Pengyu Cheng.
Noah's Ark Lab, Huawei | Apr. 2025 - Jun. 2025
Topic: Data Mixture for MLLM Pre-Training. Mentor: Lu Hou.
LIGHT STUDIO, Tencent | Dec. 2024 - Mar. 2025
Topic: LLM-Based Machine Translation. Mentor: Xiaoqi Jiao.

Teaching

TA, MFE5330 Regulatory Technology, Spring 2022-2025.
TA, MFE5231 Special Topic: Corporate Finance, Spring 2024-2025.
TA, MFE5190 Credit Risk Modeling, Summer 2023-2025.

Service

Reviewer: NeurIPS, ICML, ICLR, IJCAI, ECCV, AISTATS, CVPR, ICCV, ACMMM, TNNLS.

Awards

Gold Class of Shenzhen Research Institute of Big Data PhD Fellowship 2021-2025.
3rd Place Award in semantic segmentation track of Urban3D@ECCV2022.

Last update: 05/2026.