I am a Ph.D. student at National University of Singapore, advised by Prof. Yang You. I received my B.Sc. in Computer Science from Nanjing University in 2021. I spent one year in iCyPy at UC Berkeley from Apr. 2020, supervised by Prof. Alberto L. Sangiovanni-Vincentelli and Dr. Xiangyu Yue.

My current research mainly focus on Video Generation, Efficient ML (machine learning) and Large-scale DL (Deep Learning) Optimization.

• Video Generation: large-scale video generation model, video control and alignment.
• Large-scale DL Optimization: optimizer design (faster, memory-efficient, robust, etc.), optimizer explanation, data-model-algorithm connections.
• Efficient ML: computation-efficient training (accelerated optimizer, large batch training, incremental learning), memory-efficient training, efficient inference.

I am always happy to chat about interesting research ideas.

• [2024.9] Got one paper accepted to EMNLP 2024. Congratulations to Yang Luo!
• [2024.9] VideoOcean is now online! Generate your own video with a few clicks.
• [2024.6] Got one paper accepted to ECCV 2024. Congratulations to Ziheng Qin!
• [2024.6] Open-Sora 1.2 released! A 1.1B models on >30M data with improved performance.
• [2024.5] Got one paper (Token Crisis) accepted to ICML 2024. Congratulations to Fuzhao Xue!
• [2024.4] Open-Sora 1.1 released! Support 0s~15s, 144p to 720p, various aspect ratios videos generation, plus a data processing pipeline.
• [2024.4] Got one paper (Helen optimizer ) accepted to WWW 2024. Congratulations to Zirui Zhu!
• [2024.3] Open-Sora 1.0 released! The first open-source Sora-like video generation model.
• [2024.1] Got one paper (InfoBatch ) accepted to ICLR 2024 (oral). Congratulations to Ziheng Qin and Kai Wang!
• [2023.9] Got two papers (one first-authored paper Sequence-Scheduling ) accepted to NeurIPS 2023. Cong to Fuzhao and myself. So many thanks to my collaborators!
• [2023.7] Got one first-authored paper (ZSCL ) accepted to ICCV 2023. Thanks to all my collaborators!
• [2023.7] The CAME paper won the ACL Outstanding Paper Award!
• [2023.5] Got one paper (CAME optimizer ) accepted to ACL 2023. Congratulations to Yang Luo!
• [2023.4] Got one paper accpeted to ICML 2023. Congratulations to Fuzhao Xue!
• [2023.3] ColossalChat has been released! Open-sourced LLM training framework for you to trian your own version of ChatGPT. Congratulations to colleges at HPC-AI-Tech!
• [2023.2] The CowClip paper won the AAAI Distinguished Paper Award!
• [2022.12] Passed the qualifying exam. Cong to myself :), and thanks for my supervisor and friends’ help!
• [2022.11] Got one first-authored paper (CowClip optimizer ) ) accepted to AAAI 2023. Thanks to all my collaborators!
• [2021.8] The NJU-CSE-Flyers Handbook 2021 has been published.
• [2021.7] Happy to start my intership in ByteDance.
• [2021.6] Graduated from Nanjing University！Thanks and good lucks to all my teachers and classmates.
• [2021.4] Got one first-authored paper accepted to ICMR'21 Challenge. Thanks to all my collaborators.
• [2021.3] I will join HPC-AI @ NUS to start my Ph.D. degree under the supervision of Presidential Young Prof. Yang You!
• [2021.2] Got one co-first-authored paper (PCS-FUDA ) accepted to CVPR'21. Thanks to all my collaborators.

See Google Scholar.

• CS 5242: Neural Networks and Deep Learning (NUS, Fall 2022)
• Algorithm Analysis & Design (NJU, Fall 2020)

• 2023, Research Achievement Award of NUS
• 2023, ACL 2023 Outstanding Paper Award
• 2023, AAAI 2023 Distinguished Paper Award
• 2022, Papers with Code Contributor Award
• 2021, Outstanding Graduates of Nanjing University
• 2020, Outstanding Student of Nanjing University
• 2019, 2018 (2 times), National Elite Program First-Class Scholarship
• 2019, Zheng Gang Overseas Study Scholarship

• Open-Sora: Open-source video generation model.
• ColossalChat: A chatbot developed with ColossalAI.
• Instruction in the Wild: 110K high-quailty user-based instructions.
• awesome-huge-models: Collection of huge AI models.
• hugo-theme-phd: Hugo theme for this page.
• Overview of the Evolution of the Universe and Related Disciplines