COLM 2024 Conference Submissions

SynerGPT: In-Context Learning for Personalized Drug Synergy Prediction and Drug Design
Carl Edwards, Aakanksha Naik, Tushar Khot, Martin D. Burke, Heng Ji, Tom Hope
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Prompting
Huihan Li, Liwei Jiang, Nouha Dziri, Xiang Ren, Yejin Choi
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
A Survey on Deep Learning for Theorem Proving
Zhaoyu Li, Jialiang Sun, Logan Murphy, Qidong Su, Zenan Li, Xian Zhang, Kaiyu Yang, Xujie Si
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
GPQA: A Graduate-Level Google-Proof Q&A Benchmark
David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, Samuel R. Bowman
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
From Narratives to Numbers: Valid Inference Using Language Model Predictions from Verbal Autopsies
Shuxian Fan, Adam Visokay, Kentaro Hoffman, Stephen Salerno, Li Liu, Jeffrey T. Leek, Tyler McCormick
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Understanding Retrieval Augmentation for Long-Form Question Answering
Hung-Ting Chen, Fangyuan Xu, Shane Arora, Eunsol Choi
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Building a Large Japanese Web Corpus for Large Language Models
Naoaki Okazaki, Kakeru Hattori, Hirai Shota, Hiroki Iida, Masanari Ohi, Kazuki Fujii, Taishi Nakamura, Mengsay Loem, Rio Yokota, Sakae Mizuki
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Handling Open-Vocabulary Constructs in Formalizing Specifications: Retrieval Augmented Parsing with Expert Knowledge
Mohammad Saqib Hasan, Sayontan Ghosh, Dhruv Verma, Geoff Kuenning, Erez Zadok, Scott Smolka, Niranjan Balasubramanian
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Do Language Models Plan Ahead for Future Tokens?
Wilson Wu, John Xavier Morris, Lionel Levine
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Early Weight Averaging meets High Learning Rates for LLM Pre-training
Sunny Sanyal, Atula Tejaswi Neerkaje, Jean Kaddour, Abhishek Kumar, sujay sanghavi
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Information Guided Regularization for Fine-tuning Language Models
Mandar Sharma, Nikhil Muralidhar, Shengzhe Xu, Raquib Bin Yousuf, Naren Ramakrishnan
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Prompt Public Large Language Models to Synthesize Data for Private On-device Applications
Shanshan Wu, Zheng Xu, Yanxiang Zhang, Yuanbo Zhang, Daniel Ramage
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
PRobELM: Plausibility Ranking Evaluation for Language Models
Moy Yuan, Eric Chamoun, Rami Aly, Chenxi Whitehouse, Andreas Vlachos
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping
Lucas Lehnert, Sainbayar Sukhbaatar, DiJia Su, Qinqing Zheng, Paul McVay, Michael Rabbat, Yuandong Tian
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
LMD3: Language Model Data Density Dependence
John Kirchenbauer, Garrett Honke, Gowthami Somepalli, Jonas Geiping, Katherine Lee, Daphne Ippolito, Tom Goldstein, David Andre
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents
Abhay Zala, Jaemin Cho, Han Lin, Jaehong Yoon, Mohit Bansal
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Model Autophagy Analysis to Explicate Self-consumption within Human-AI Interactions
Shu Yang, Muhammad Asif Ali, Lu Yu, Lijie Hu, Di Wang
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
DiagrammerGPT: Generating Open-Domain, Open-Platform Diagrams via LLM Planning
Abhay Zala, Han Lin, Jaemin Cho, Mohit Bansal
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
VideoDirectorGPT: Consistent Multi-Scene Video Generation via LLM-Guided Planning
Han Lin, Abhay Zala, Jaemin Cho, Mohit Bansal
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Towards Verifiable Text Generation with Symbolic References
Lucas Torroba Hennigen, Zejiang Shen, Aniruddha Nrusimha, Bernhard Gapp, David Sontag, Yoon Kim
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Fakes of Varying Shades: How Warning Affects Human Perception and Engagement Regarding LLM Hallucinations
Mahjabin Nahar, Haeseung Seo, Eun-Ju Lee, Aiping Xiong, Dongwon Lee
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Does RoBERTa Perform Better than BERT in Continual Learning: An Attention Sink Perspective
Xueying Bai, Yifan Sun, Niranjan Balasubramanian
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Stronger Random Baselines for In-Context Learning
Gregory Yauney, David Mimno
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Sainbayar Sukhbaatar, Olga Golovneva, Vasu Sharma, Hu Xu, Xi Victoria Lin, Baptiste Roziere, Jacob Kahn, Shang-Wen Li, Wen-tau Yih, Jason E Weston, Xian Li
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone
TOFU: A Task of Fictitious Unlearning for LLMs
Pratyush Maini, Zhili Feng, Avi Schwarzschild, Zachary Chase Lipton, J Zico Kolter
- Published: 10 Jul 2024, Last Modified: 26 Aug 2024
- COLM
- Readers: Everyone