COLM 2024 Conference Submissions

Pairwise Proximal Policy Optimization: Language Model Alignment with Comparative RL
Tianhao Wu, Banghua Zhu, Ruoyu Zhang, Zhaojin Wen, Kannan Ramchandran, Jiantao Jiao
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM
Chunqiu Steven Xia, Yinlin Deng, LINGMING ZHANG
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Beyond Relevance: Evaluate and Improve Retrievers on Perspective Awareness
Xinran Zhao, Tong Chen, Sihao Chen, Hongming Zhang, Tongshuang Wu
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Adaptive Quantization Error Reconstruction for LLMs with Mixed Precision
Lin Ou, Jinpeng Xia, Yuewei Zhang, Chuzhan Hao, Hao Henry Wang
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models
Haz Sameen Shahgir, Khondker Salman Sayeed, Abhik Bhattacharjee, Wasi Uddin Ahmad, Yue Dong, Rifat Shahriyar
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking
Jacob Eisenstein, Chirag Nagpal, Alekh Agarwal, Ahmad Beirami, Alexander Nicholas D'Amour, Krishnamurthy Dj Dvijotham, Adam Fisch, Katherine A Heller, Stephen Robert Pfohl, Deepak Ramachandran, Peter Shaw, Jonathan Berant
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
StyleTalker: Finetuning Audio Language Model and Style-Based Text-to-Speech Model for Fast Spoken Dialogue Generation
Yinghao Aaron Li, Xilin Jiang, Jordan Darefsky, Ge Zhu, Nima Mesgarani
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Hummer: Towards Limited Competitive Preference Dataset
Yusen Wu, Li Jiang, Junwu Xiong, Jingqing Ruan, Yichuan Ding, Qingpei Guo, zujie wen, JUN ZHOU, Xiaotie Deng
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalability
Zhuoyan Xu, Zhenmei Shi, Yingyu Liang
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
MambaByte: Token-free Selective State Space Model
Junxiong Wang, Tushaar Gangavarapu, Jing Nathan Yan, Alexander M Rush
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Decoupling Noise and Toxic Parameters for Language Model Detoxification by Task Vector Merging
Yongmin Kim, Takeshi Kojima, Yusuke Iwasawa, Yutaka Matsuo
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Are Language Models Robust Coreference Resolvers?
Nghia T. Le, Alan Ritter
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Certifying LLM Safety against Adversarial Prompting
Aounon Kumar, Chirag Agarwal, Suraj Srinivas, Aaron Jiaxun Li, Soheil Feizi, Himabindu Lakkaraju
- Published: 10 Jul 2024, Last Modified: 09 Sept 2024
- COLM
- Readers: Everyone
Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data
Matthias Gerstgrasser, Rylan Schaeffer, Apratim Dey, Rafael Rafailov, Tomasz Korbak, Henry Sleight, Rajashree Agrawal, John Hughes, Dhruv Bhandarkar Pai, Andrey Gromov, Dan Roberts, Diyi Yang, David L. Donoho, Sanmi Koyejo
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
A Reparameterized Discrete Diffusion Model for Text Generation
Lin Zheng, Jianbo Yuan, Lei Yu, Lingpeng Kong
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
CatCode: A Comprehensive Evaluation Framework for LLMs On the Mixture of Code and Text
Zhenru Lin, Yiqun Yao, Yang Yuan
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Characterizing Multimodal Long-form Summarization: A Case Study on Financial Reports
Tianyu Cao, Natraj Raman, Danial Dervovic, Chenhao Tan
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Measuring and Controlling Instruction (In)Stability in Language Model Dialogs
Kenneth Li, Tianle Liu, Naomi Bashkansky, David Bau, Fernanda Viégas, Hanspeter Pfister, Martin Wattenberg
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
LLM4Causal: Democratized Causal Tools for Everyone via Large Language Model
Haitao Jiang, Lin Ge, Yuhe Gao, Jianian Wang, Rui Song
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Let’s Think Dot by Dot: Hidden computation in transformer language models
Jacob Pfau, William Merrill, Samuel R. Bowman
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs
Yilun Hua, Yoav Artzi
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMs
Zeyi Liao, Huan Sun
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Hydra: Sequentially-Dependent Draft Heads for Medusa Decoding
Zachary Ankner, Rishab Parthasarathy, Aniruddha Nrusimha, Christopher Rinard, Jonathan Ragan-Kelley, William Brandon
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Instruction Mining: Instruction Data Selection for Tuning Large Language Models
Yihan Cao, Yanbin Kang, Chi Wang, Lichao Sun
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Long-Form Answers to Visual Questions from Blind and Low Vision People
Mina Huh, Fangyuan Xu, Yi-Hao Peng, Chongyan Chen, Hansika Murugu, Danna Gurari, Eunsol Choi, Amy Pavel
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone