COLM 2024 Conference Submissions

BumbleBee: Dynamic KV-Cache Streaming Submodular Summarization for Infinite-Context Transformers
Lilly Kumari, Shengjie Wang, Tianyi Zhou, Nikhil Sarda, Anthony Rowe, Jeff Bilmes
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Transformer Circuit Evaluation Metrics Are Not Robust
Joseph Miller, Bilal Chughtai, William Saunders
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Do Membership Inference Attacks Work on Large Language Models?
Michael Duan, Anshuman Suri, Niloofar Mireshghallah, Sewon Min, Weijia Shi, Luke Zettlemoyer, Yulia Tsvetkov, Yejin Choi, David Evans, Hannaneh Hajishirzi
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Revenge of the Fallen? Recurrent Models Match Transformers at Predicting Human Language Comprehension Metrics
James Michaelov, Catherine Arnett, Ben Bergen
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Starling-7B: Improving Helpfulness and Harmlessness with RLAIF
Banghua Zhu, Evan Frick, Tianhao Wu, Hanlin Zhu, Karthik Ganesan, Wei-Lin Chiang, Jian Zhang, Jiantao Jiao
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Enhancing Language Models with Idiomatic Reasoning
Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language Models
Sicheng Zhu, Ruiyi Zhang, Bang An, Gang Wu, Joe Barrow, Zichao Wang, Furong Huang, Ani Nenkova, Tong Sun
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
From Strategic Narratives to Code-Like Cognitive Models: An LLM-Based Approach in A Sorting Task
Hanbo Xie, Hua-Dong Xiong, Robert Wilson
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Iteratively Prompting Multimodal LLMs to Reproduce Natural and AI-Generated Images
Ali Naseh, Katherine Thai, Mohit Iyyer, Amir Houmansadr
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Counting Like Transformers: Compiling Temporal Counting Logic Into Softmax Transformers
Andy Yang, David Chiang
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Task Success is not Enough: Investigating the Use of Video-Language Models as Behavior Critics for Catching Undesirable Agent Behaviors
Lin Guan, Yifan Zhou, Denis Liu, Yantian Zha, Heni Ben Amor, Subbarao Kambhampati
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generation
Harry Dong, Beidi Chen, Yuejie Chi
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Pack of LLMs: Model Fusion at Test-Time via Perplexity Optimization
Costas Mavromatis, Petros Karypis, George Karypis
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
Eric Zelikman, Eliana Lorch, Lester Mackey, Adam Tauman Kalai
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Training Language Models on the Knowledge Graph: Insights on Hallucinations and Their Detectability
Jiri Hron, Laura A Culp, Gamaleldin Fathy Elsayed, Rosanne Liu, Jasper Snoek, Simon Kornblith, Alex Rizkowsky, Isabelle Simpson, Jascha Sohl-Dickstein, Noah Fiedel, Aaron T Parisi, Alexander A Alemi, Azade Nova, Ben Adlam, Bernd Bohnet, Gaurav Mishra, Hanie Sedghi, Izzeddin Gur, Jaehoon Lee, John D Co-Reyes et al. (11 additional authors not shown)
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Does Collaborative Human–LM Dialogue Generation Help Information Extraction from Human–Human Dialogues?
Bo-Ru Lu, Nikita Haduong, Chia-Hsuan Lee, Zeqiu Wu, Hao Cheng, Paul Koester, Jean Utke, Tao Yu, Noah A. Smith, Mari Ostendorf
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
How Well Do LLMs Identify Cultural Unity in Diversity?
Jialin Li, Junli Wang, Junjie Hu, Ming Jiang
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Forklift: An Extensible Neural Lifter
Jordi Armengol-Estapé, Rodrigo C. O. Rocha, Jackson Woodruff, Pasquale Minervini, Michael O'Boyle
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Benchmarks as Microscopes: A Call for Model Metrology
Michael Saxon, Ari Holtzman, Peter West, William Yang Wang, Naomi Saphra
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations
Yize Zhao, Tina Behnia, Vala Vakilian, Christos Thrampoulidis
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Autonomous Evaluation and Refinement of Digital Agents
Jiayi Pan, Yichi Zhang, Nicholas Tomlin, Yifei Zhou, Sergey Levine, Alane Suhr
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Cookbook: A framework for improving LLM generative abilities via programmatic data generating templates
Avanika Narayan, Mayee F Chen, Kush Bhatia, Christopher Re
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Evaluating the Adversarial Robustness of Retrieval-Based In-Context Learning for Large Language Models
Simon Chi Lok Yu, Jie He, Pasquale Minervini, Jeff Z. Pan
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
How Multilingual are Large Language Models Fine-tuned for Translation?
Aquia Richburg, Marine Carpuat
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
PolygloToxicityPrompts: Multilingual Evaluation of Neural Toxic Degeneration in Large Language Models
Devansh Jain, Priyanshu Kumar, Samuel Gehman, Xuhui Zhou, Thomas Hartvigsen, Maarten Sap
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone