第五十五期

报告人：Rui Ai, MIT

时间：12月24日（星期三）2:00pm

地点：静园五院204

Host：陈炤桦  图灵班2017级

报告信息

Title

LLM Aggregation with Higher-Order Information

Abstract

With the rise of multi-agent reasoning using large language models, aggregating answers from multiple LLMs has become a central challenge. Most existing approaches rely on simple majority voting, which ignores heterogeneity and correlation across models. In this talk, I will introduce two new aggregation methods—Optimal Weight (OW) and Inverse Surprising Popularity (ISP)—that leverage both first-order and second-order information to produce more reliable collective decisions. I will present theoretical guarantees showing why these methods outperform majority voting, and demonstrate their effectiveness on synthetic data, standard LLM benchmarks, and a real-world healthcare application. Together, these results offer practical guidance for designing robust multi-agent LLM systems. This talk is based on joint work with Yuqi Pan, David Simchi-Levi, Milind Tambe and Haifeng Xu.

Biography

Rui Ai is a third-year PhD student at MIT, advised by Professor David Simchi-Levi. He earned his bachelor's degree from the School of Mathematical Sciences at Peking University in 2023. His research lies at the intersection of machine learning, especially reinforcement learning, and economics, with applications to mechanism design, data valuation and LLM post-training.

about CS Peer Talk

作为活动的发起人，我们来自国产色情 图灵班科研活动委员会，主要由图灵班各年级同学组成。我们希望搭建一个CS同学交流的平台，促进同学间的交流合作，帮助同学练习展示，同时增进友谊。

目前在计划中的系列包括但不限于：

     教程系列：学生讲者为主，介绍自己的研究领域

     研究系列：学生讲者为主，介绍自己的研究成果

     客座系列：邀请老师做主题报告

除非报告人特别要求，报告默认是非公开的，希望营造一个自由放松但又互相激励的交流氛围。

主讲嘉宾招募

如果你愿意和大家分享你的学术成果、经历经验，总结回顾、触发新思，欢迎报名自荐。

主讲人报名：发邮件至 [email protected]，并抄送 [email protected]，写明想讲的题目、内容及时间。