CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization [Paper] [Github] [Huggingface]

Zhongyuan Peng*, Yifan Yao*, Kaijing Ma*, Shuyue Guo, Yizhe Li, Yichi Zhang, Chenchen Zhang, Yifan Zhang, Zhouliang Yu, Luming Li, Minghao Liu, Yihang Xia, Jiawei Shen, Yuchen Wu, Yixin Cao, Zhaoxiang Zhang, Wenhao Huang, Jiaheng Liu†, Ge Zhang†

SCALER: Synthetic Scalable Adaptive Learning Environment for Reasoning [Paper] [Github]

Caijun Xu, Changyi Xiao, Zhongyuan Peng, Xinrun Wang, Yixin Cao†

IV-Bench: A Benchmark for Image-Grounded Video Perception and Reasoning in Multimodal LLMs [Paper] [Github]

M-A-P Team

SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines [Paper] [Github] [Huggingface]

M-A-P Team

NeurIPS Dataset and Benchmark Track 2025

Can Large Language Models Detect Errors in Long Chain-of-Thought Reasoning? [Paper] [Github]

Yancheng He*, Shilong Li*, Jiaheng Liu*†, Weixun Wang*, Xingyuan Bu, Ge Zhang, Zhongyuan Peng, Zhaoxiang Zhang, Wenbo Su, Bo Zheng

The Association for Computational Linguistics (ACL) 2025

A Comparative Study on Reasoning Patterns of OpenAI’s o1 Model [Paper] [Github]

Siwei Wu*, Zhongyuan Peng*, Xinrun Du*, Tuney Zheng*, Minghao Liu, Jialong Wu, Jiachen Ma, Yizhi Li, Jian Yang, Wangchunshu Zhou, Qunshu Lin, Junbo Zhao, Zhaoxiang Zhang, Wenhao Huang, Ge Zhang†, Chenghua Lin†, J.H. Liu†

The International Conference on Learning Representations (ICLR) 2025 Workshop on Open Science for Foundation Models (SCI-FM)

MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Models [Paper] [Github] [Huggingface]

Pei Wang*, Yanan Wu* Zekun Wang*, Jiaheng Liu†, Xiaoshuai Song, Zhongyuan Peng, Ken Deng, Chenchen Zhang, Jiakai Wang, Junran Peng, Ge Zhang, Hangyu Guo, Zhaoxiang Zhang, Wenbo Su, Bo Zheng

The International Conference on Learning Representations (ICLR) 2025

Mitigating Hallucinations in Large Vision-Language Models by Adaptively Constraining Information Flow [Paper] [Code]

Jiaqi Bai, Hongcheng Guo, Z.Y. Peng, Jian Yang, Zhoujun Li, Mohan Li, Zhihong Tian

The Association for the Advancement of Artificial Intelligence (AAAI) 2025

RoleAgent: Building, Interacting, and Benchmarking High-quality Role-Playing Agents from Scripts [Paper]

Jiaheng Liu*, Zehao Ni*, Haoran Que*, Tao Sun, Zekun Wang, Jian Yang, Jiakai Wang, Hongcheng Guo, Zhongyuan Peng, Ge Zhang, Jiayi Tian, Xingyuan Bu, Ke Xu, Wenge Rong, Junran Peng†, Zhaoxiang Zhang

NeurIPS Dataset and Benchmark Track 2024

RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models [Paper] [Code]

Zekun Moore Wang*, Zhongyuan Peng*, Haoran Que*, Jiaheng Liu†, Wangchunshu Zhou, Yuhan Wu, Hongcheng Guo, Ruitong Gan, Zehao Ni, Jian Yang, Man Zhang, Zhaoxiang Zhang†, Wanli Ouyang, Ke Xu, Stephen W. Huang, Jie Fu, Junran Peng

Findings of the Association for Computational Linguistics (Findings of ACL) 2024

CoDiQ: Test-Time Scaling for Controllable Difficult Question Generation [Paper] [Github] [Huggingface]

Zhongyuan Peng, Caijun Xu, Changyi Xiao, Shibo Hong, Eli Zhang†, Stephen Huang, Yixin Cao†

KAT-V1: Kwai-AutoThink Technical Report [Paper]

Zizheng Zhan*†, Ken Deng*, Huaixi Tang*, Wen Xiang*, Kun Wu*, Weihao Li, Wenqiang Zhu, Jingxuan Xu, Lecheng Huang, Zongxian Feng, Shaojie Wang, Shangpeng Yan, Xuxing Chen, Jiaheng Liu, Zhongyuan Peng, Zuchen Gao, Haoyang Huang, Xiaojiang Zhang, Jinghui Wang, Zheng Lin, Mengtong Li, Huiming Wang, Ziqi Zhan, Yanan Wu, Yuanxing Zhang, Jian Yang, Guang Chen, Haotian Zhang, Bin Chen, Bing Yu

FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models [Paper] [Github] [Huggingface]

Zhouliang Yu*, Ruotian Peng*, Keyi Ding*, Yizhe Li, Zhongyuan Peng, Minghao Liu, Yifan Zhang, Zheng Yuan, Huajian Xin, Wenhao Huang, Yandong Wen, Ge Zhang, Weiyang Liu†

CodeCriticBench: A Holistic Code Critique Benchmark for Large Language Models [Paper] [Github] [Huggingface]

Alexander Zhang*, Marcus Dong*, Jiaheng Liu*†, Wei Zhang, Yejie Wang, Jian Yang, Ge Zhang, Tianyu Liu, Zhongyuan Peng, Yingshui Tan, Yuanxing Zhang, Zhexu Wang, Weixun Wang, Yancheng He, Ken Deng, Wangchunshu Zhou, Wenhao Huang, Zhaoxiang Zhang

FullStack Bench: Evaluating LLMs as Full Stack Coders [Paper] [Github] [Huggingface]

Siyao Liu*, He Zhu*, Jerry Liu*, Shulin Xin*, Aoyan Li*, Rui Long, Li Chen, Jack Yang, Jinxiang Xia, Z.Y. Peng, Shukai Liu, Zhaoxiang Zhang, Jing Mai, Ge Zhang, Wenhao Huang, Kai Shen†, Liang Xiang†