COLM 2024 Conference Submissions

JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attacks
Weidi Luo, Siyuan Ma, Xiaogeng Liu, Xiaoyu Guo, Chaowei Xiao
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Best-of-Venom: Attacking RLHF by Injecting Poisoned Preference Data
Tim Baumgärtner, Yang Gao, Dana Alon, Donald Metzler
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
D2PO: Discriminator-Guided DPO with Response Evaluation Models
Prasann Singhal, Nathan Lambert, Scott Niekum, Tanya Goyal, Greg Durrett
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
A Long Way to Go: Investigating Length Correlations in RLHF
Prasann Singhal, Tanya Goyal, Jiacheng Xu, Greg Durrett
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP
François Remy, Pieter Delobelle, Hayastan Avetisyan, Alfiya Khabibullina, Miryam de Lhoneux, Thomas Demeester
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models
Haojie Duanmu, Zhihang Yuan, Xiuhong Li, Jiangfei Duan, Xingcheng ZHANG, Dahua Lin
- Published: 10 Jul 2024, Last Modified: 29 Aug 2024
- COLM
- Readers: Everyone
Personalized Collaborative Fine-Tuning for On-Device Large Language Models
Nicolas Wagner, Dongyang Fan, Martin Jaggi
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Generating Synthetic Datasets for Few-shot Prompt Tuning
Xu Guo, Zilin Du, Boyang Li, Chunyan Miao
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
MBBQ: A Dataset for Cross-Lingual Comparison of Stereotypes in Generative LLMs
Vera Neplenbroek, Arianna Bisazza, Raquel Fernández
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
LAMPO: Large Language Models as Preference Machines for Few-shot Ordinal Classification
Zhen Qin, Junru Wu, Jiaming Shen, Tianqi Liu, Xuanhui Wang
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Large Language Models are Capable of Offering Cognitive Reappraisal, if Guided
Hongli Zhan, Allen Zheng, Yoon Kyung Lee, Jina Suh, Junyi Jessy Li, Desmond Ong
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Compression Represents Intelligence Linearly
Yuzhen Huang, Jinghan Zhang, Zifei Shan, Junxian He
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
DeStein: Navigating Detoxification of Language Models via Universal Steering Pairs and Head-wise Activation Fusion
Yu Li, Han Jiang, Chuanyang Gong, Zhihua Wei
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Resolving Knowledge Conflicts in Large Language Models
Yike Wang, Shangbin Feng, Heng Wang, Weijia Shi, Vidhisha Balachandran, Tianxing He, Yulia Tsvetkov
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
SPEER: Sentence-Level Planning of Long Clinical Summaries via Embedded Entity Retrieval
Griffin Thomas Adams, Jason Zucker, Noémie Elhadad
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
CA-LoRA: Adapting Existing LoRA for Compressed LLMs to Enable Efficient Multi-Tasking on Personal Devices
Weilin Zhao, Yuxiang Huang, Xu Han, Zhiyuan Liu, Zhengyan Zhang, Kuai Li, Chen Chen, TAO YANG, Maosong Sun
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
LLM economicus? Mapping the Behavioral Biases of LLMs via Utility Theory
Jillian Ross, Yoon Kim, Andrew Lo
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities
Kazuki Fujii, Taishi Nakamura, Mengsay Loem, Hiroki Iida, Masanari Ohi, Kakeru Hattori, Hirai Shota, Sakae Mizuki, Rio Yokota, Naoaki Okazaki
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting
Olly Styles, Sam Miller, Patricio Cerda-Mardini, Tanaya Guha, Victor Sanchez, Bertie Vidgen
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
StructLM: Towards Building Generalist Models for Structured Knowledge Grounding
Alex Zhuang, Ge Zhang, Tianyu Zheng, Xinrun Du, Junjie Wang, Weiming Ren, Wenhao Huang, Jie Fu, Xiang Yue, Wenhu Chen
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Investigating Instruction Tuning Large Language Models on Graphs
Kerui Zhu, Bo-Wei Huang, Bowen Jin, Yizhu Jiao, Ming Zhong, Kevin Chang, Shou-De Lin, Jiawei Han
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
MileBench: Benchmarking MLLMs in Long Context
Song Dingjie, Shunian Chen, Guiming Hardy Chen, Fei Yu, Xiang Wan, Benyou Wang
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Unforgettable Generalization in Language Models
Eric Zhang, Leshem Choshen, Jacob Andreas
- Published: 10 Jul 2024, Last Modified: 03 Sept 2024
- COLM
- Readers: Everyone
Automata-based constraints for language model decoding
Terry Koo, Frederick Liu, Luheng He
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?
Urja Khurana, Eric Nalisnick, Antske Fokkens, Swabha Swayamdipta
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone