Publications

Jet-Long: Efficient Long-Context Extension with Dynamic Bifocal RoPE.
Haozhan Tang, Zerui Wang, Yuxian Gu, Song Han, Han Cai

In NeurIPS 2026 (accepted). PDF Cite Code DOI arXiv

Zeppelin: Balancing Variable-length Workloads in Data Parallel Large Model Training.
Chang Chen, Tiancheng Chen, Jiangfei Duan, Qianchao Zhu, Zerui Wang, Qinghao Hu, Peng Sun, Xiuhong Li, Chao Yang, Torsten Hoefler

In EuroSys 2026. PDF Cite DOI arXiv

Scaling Large Vision-Language Model RL Training via Efficient Load Balancing.
Zerui Wang, Qinghao Hu, Chang Chen, Jiecheng Zhou, Haojie Duanmu, Xingcheng Zhang, Peng Sun, Dahua Lin

In ICLR 2026. PDF Cite Proceedings

Semantic-Aware Scheduling for GPU Clusters with Large Language Models.
Zerui Wang, Qinghao Hu, Ana Klimovic, Tianwei Zhang, Yonggang Wen, Peng Sun, Dahua Lin

arXiv preprint, 2025. PDF Cite DOI

RL in the Wild: Characterizing RLVR Training in LLM Deployment.
Jiecheng Zhou, Qinghao Hu, Yuyang Jin, Zerui Wang, Peng Sun, Yuzhe Gu, Wenwei Zhang, Mingshu Zhai, Xingcheng Zhang, Weiming Zhang

arXiv preprint, 2025. PDF Cite DOI

PackMamba: Efficient Processing of Variable-Length Sequences in Mamba Training.
Haoran Xu, Ziqian Liu, Rong Fu, Zhongling Su, Zerui Wang, Zheng Cai, Zhilin Pei, Xingcheng Zhang

In ECCV 2024 Workshops. PDF Cite Code DOI arXiv

Efficient Training of Large Language Models on Distributed Infrastructures: A Survey.
Jiangfei Duan, Shuo Zhang, Zerui Wang, Lijuan Jiang, Wenwen Qu, Qinghao Hu, Guoteng Wang, Qizhen Weng, Hang Yan, Xingcheng Zhang, Xipeng Qiu, Dahua Lin, Yonggang Wen, Xin Jin, Tianwei Zhang, Peng Sun

arXiv preprint, 2024. PDF Cite DOI

SchedMate: Large Language Models are DL Scheduling Enhancers.
Zerui Wang, Qinghao Hu, Ana Klimovic, Xingcheng Zhang, Peng Sun

In NSDI 2024 Poster. PDF Cite

Characterization of Large Language Model Development in the Datacenter.
Qinghao Hu, Zhisheng Ye, Zerui Wang, Guoteng Wang, Meng Zhang, Qiaoling Chen, Peng Sun, Dahua Lin, Xiaolin Wang, Yingwei Luo

In NSDI 2024. PDF Cite Code Dataset