Zerui Wang

Zerui Wang

Ph.D. Student · Research Intern

Shanghai Jiao Tong University

NVIDIA Research

About Me

I am a Ph.D. student at Shanghai Jiao Tong University, supervised by Dahua Lin and Rong Chen. I also work closely with Peng Sun and Qinghao Hu.

Since May 2026, I have been a research intern at NVIDIA Research. My experience also includes LLM pretraining at Xiaohongshu, where I joined as a Redstar Intern (Top Talent) in October 2025.

My research focuses on machine learning systems, including distributed training and reinforcement learning for large models, GPU scheduling, and efficient sequence modeling.

Interests
  • Machine Learning Systems
  • Distributed Systems
  • Large-Scale Model Training and Reinforcement Learning
Education

  • Shanghai Jiao Tong University

    Ph.D. in Computer Science, Sep 2023 - Present

Publications

Jet-Long: Efficient Long-Context Extension with Dynamic Bifocal RoPE.
Haozhan Tang, Zerui Wang, Yuxian Gu, Song Han, Han Cai

In NeurIPS 2026 (accepted). PDF Cite Code DOI arXiv

Zeppelin: Balancing Variable-length Workloads in Data Parallel Large Model Training.
Chang Chen, Tiancheng Chen, Jiangfei Duan, Qianchao Zhu, Zerui Wang, Qinghao Hu, Peng Sun, Xiuhong Li, Chao Yang, Torsten Hoefler

In EuroSys 2026. PDF Cite DOI arXiv

Scaling Large Vision-Language Model RL Training via Efficient Load Balancing.
Zerui Wang, Qinghao Hu, Chang Chen, Jiecheng Zhou, Haojie Duanmu, Xingcheng Zhang, Peng Sun, Dahua Lin

In ICLR 2026. PDF Cite Proceedings

Semantic-Aware Scheduling for GPU Clusters with Large Language Models.
Zerui Wang, Qinghao Hu, Ana Klimovic, Tianwei Zhang, Yonggang Wen, Peng Sun, Dahua Lin

arXiv preprint, 2025. PDF Cite DOI

RL in the Wild: Characterizing RLVR Training in LLM Deployment.
Jiecheng Zhou, Qinghao Hu, Yuyang Jin, Zerui Wang, Peng Sun, Yuzhe Gu, Wenwei Zhang, Mingshu Zhai, Xingcheng Zhang, Weiming Zhang

arXiv preprint, 2025. PDF Cite DOI

PackMamba: Efficient Processing of Variable-Length Sequences in Mamba Training.
Haoran Xu, Ziqian Liu, Rong Fu, Zhongling Su, Zerui Wang, Zheng Cai, Zhilin Pei, Xingcheng Zhang

In ECCV 2024 Workshops. PDF Cite Code DOI arXiv

Efficient Training of Large Language Models on Distributed Infrastructures: A Survey.
Jiangfei Duan, Shuo Zhang, Zerui Wang, Lijuan Jiang, Wenwen Qu, Qinghao Hu, Guoteng Wang, Qizhen Weng, Hang Yan, Xingcheng Zhang, Xipeng Qiu, Dahua Lin, Yonggang Wen, Xin Jin, Tianwei Zhang, Peng Sun

arXiv preprint, 2024. PDF Cite DOI

SchedMate: Large Language Models are DL Scheduling Enhancers.
Zerui Wang, Qinghao Hu, Ana Klimovic, Xingcheng Zhang, Peng Sun

In NSDI 2024 Poster. PDF Cite

Characterization of Large Language Model Development in the Datacenter.
Qinghao Hu, Zhisheng Ye, Zerui Wang, Guoteng Wang, Meng Zhang, Qiaoling Chen, Peng Sun, Dahua Lin, Xiaolin Wang, Yingwei Luo

In NSDI 2024. PDF Cite Code Dataset

News

  • 2026: Jet-Long has been accepted to NeurIPS 2026.
  • Jul 2026: Our Jet-Long preprint and code are available.
  • May 2026: I joined NVIDIA Research as a research intern.
  • 2026: FlexRL appeared at ICLR 2026, and Zeppelin appeared at EuroSys 2026.

Experience

Research Intern

NVIDIA Research · May 2026 – Present

Redstar Intern (Top Talent)

Xiaohongshu · Started Oct 2025

Working on LLM pretraining.