/085713-3775.
URL
https://proceedings.neurips.cc/paper_files/paper/2025/hash/a4277440d50f1f15d2cb4c14f7e0c0d2-Abstract-Conference.html.
Yue et al. (2024)
Albert S. Yue, Lovish Madaan, Ted Moskovitz, DJ Strouse, and Aaditya K. Singh.
HARP: A challenging human-annotated math reasoning benchmark, 2024.
URL https://arxiv.org/abs/2412.08819.
Yukhymenko et al. (2026)
Hanna Yukhymenko, Anton Alexandrov, and Martin Vechev.
Recovered in translation: Efficient pipeline for automated
translation of benchmarks and datasets.
In Findings of the Association for Computational Linguistics:
ACL, pp. 41590–41609, 2026.
doi: 10.18653/v1/2026.findings-acl.2067.
URL https://aclanthology.org/2026.findings-acl.2067/.
Żelasko et al. (2021)
Piotr Żelasko, Daniel Povey, Jan Trmal, and Sanjeev Khudanpur.
Lhotse: A speech data representation library for the modern deep
learning ecosystem.
In Workshop on Data-Centric AI (DCAI @ NeurIPS), 2021.
URL https://arxiv.org/abs/2110.12561.
Zellers et al. (2019)
Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi.
HellaSwag: Can a machine really finish your sentence?
In Proceedings of the Annual Meeting of the Association for
Computational Linguistics (ACL), pp. 4791–4800, 2019.
doi: 10.18653/v1/p19-1472.
URL https://aclanthology.org/P19-1472/.
Zhan et al. (2024)
Jun Zhan, Junqi Dai, Jiasheng Ye, Yunhua Zhou, Dong Zhang, Zhigeng Liu, Xin
Zhang, Ruibin Yuan, Ge Zhang, Linyang Li, Hang Yan, Jie Fu, Tao Gui,
Tianxiang Sun, Yu-Gang Jiang, et al.
AnyGPT: Unified multimodal LLM with discrete sequence modeling.
In Proceedings of the Annual Meeting of the Association for
Computational Linguistics (ACL), pp. 9637–9662, 2024.
doi: 10.18653/v1/2024.acl-long.521.
URL https://aclanthology.org/2024.acl-long.521/.
Zhang et al. (2025)
Kaichen Zhang, Bo Li, Peiyuan Zhang, Fanyi Pu, Joshua Adrian Cahyono, Kairui
Hu, Shuai Liu, Yuanhan Zhang, Jingkang Yang, Chunyuan Li, and Ziwei Liu.
LMMs-Eval: Reality check on the evaluation of large multimodal
models.
In Findings of the Association for Computational Linguistics:
NAACL, pp. 881–916, 2025.
doi: 10.18653/v1/2025.findings-naacl.51.
URL https://aclanthology.org/2025.findings-naacl.51/.
Zhao et al. (2024)
Wenting Zhao, Xiang Ren, Jack Hessel, Claire Cardie, Yejin Choi, and Yuntian
Deng.
WildChat: 1M ChatGPT interaction logs in the wild.
In International Conference on Learning Representations
(ICLR), pp. 34590–34605, 2024.
URL
https://proceedings.iclr.cc/paper_files/paper/2024/hash/9421261e06f1a63a352b068f1ac90609-Abstract-Conference.html.
Zhao et al. (2023)
Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less
Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can
Balioglu, Pritam Damania, Bernard Nguyen, Geeta Chauhan, et al.
PyTorch FSDP: Experiences on scaling fully sharded data parallel.
Proceedings of the VLDB Endowment, 16(12):3848–3860, 2023.
doi: 10.14778/3611540.3611569.
URL https://www.vldb.org/pvldb/vol16/p3848-huang.pdf.
Zhao et al. (2022)
Yilun Zhao, Yunxiang Li, Chenying Li, and Rui Zhang.
MultiHiertt: Numerical reasoning over multi hierarchical tabular
and textual data.
In Proceedings of the Annual Meeting of the Association for
Computational Linguistics (ACL), pp. 6588–6600, 2022.
doi: 10.18653/v1/2022.acl-long.454.
URL https://aclanthology.org/2022.acl-long.454/.
Zheng et al. (2024)
Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Chuyue Sun, Jeff Huang, Cody Hao
Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark
Barrett, and Ying Sheng.
SGLang: Efficient execution of structured language model programs.
In Advances in Neural Information Processing Systems
(NeurIPS), pp. 62557–62583, 2024.
doi: 10.52202/079017-2000.
URL
https://proceedings.neurips.cc/paper_files/paper/2024/hash/724be4472168f31ba1c9ac630f15dec8-Abstract-Conference.html.
Zheng et al. (2025)
Qinyue Zheng, Salman Abdullah, Sam Rawal, Cyril Zakka, Sophie Ostmeier,
Maximilian Purk, Eduardo Reis, Eric J. Topol, Jure Leskovec, and Micha