ICML 2024 Workshop ICL Submissions

Can Transformers Solve Least Squares to High Precision?
Jerry Weihong Liu, Jessica Grogan, Owen M Dugan, Simran Arora, Atri Rudra, Christopher Re
- Published: 18 Jun 2024, Last Modified: 20 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
In-Context Principle Learning from Mistakes
Tianjun Zhang, Aman Madaan, Luyu Gao, Steven Zhang, Swaroop Mishra, Yiming Yang, Niket Tandon, Uri Alon
- Published: 18 Jun 2024, Last Modified: 18 Jun 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Probing the Decision Boundaries of In-context Learning in Large Language Models
Siyan Zhao, Tung Nguyen, Aditya Grover
- Published: 18 Jun 2024, Last Modified: 05 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Polynomial Regression as a Task for Understanding In-context Learning Through Finetuning and Alignment
Max Wilcoxson, Morten Svendgård, Ria Doshi, Dylan Davis, Reya Vir, Anant Sahai
- Published: 18 Jun 2024, Last Modified: 22 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Can Mamba In-Context Learn Task Mixtures?
Yingcong Li, Xupeng Wei, Haonan Zhao, Taigao Ma
- Published: 18 Jun 2024, Last Modified: 22 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Verbalized Machine Learning: Revisiting Machine Learning with Language Models
Tim Z. Xiao, Robert Bamler, Bernhard Schölkopf, Weiyang Liu
- Published: 18 Jun 2024, Last Modified: 02 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Linear Transformers are Versatile In-Context Learners
Max Vladymyrov, Johannes von Oswald, Mark Sandler, Rong Ge
- Published: 18 Jun 2024, Last Modified: 12 May 2025
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
In-Context Generalization to New Tasks From Unlabeled Observation Data
Anthony Liang, Pavel Czempin, Yutai Zhou, Stephen Tu, Erdem Biyik
- Published: 18 Jun 2024, Last Modified: 12 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
TabMDA: Tabular Manifold Data Augmentation for Any Classifier using Transformers with In-context Subsetting
Andrei Margeloiu, Adrián Bazaga, Nikola Simidjievski, Pietro Lio, Mateja Jamnik
- Published: 18 Jun 2024, Last Modified: 20 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Universal Self-Consistency for Large Language Models
Xinyun Chen, Renat Aksitov, Uri Alon, Jie Ren, Kefan Xiao, Pengcheng Yin, Sushant Prakash, Charles Sutton, Xuezhi Wang, Denny Zhou
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
In-Context Learning of Energy Functions
Rylan Schaeffer, Mikail Khona, Sanmi Koyejo
- Published: 18 Jun 2024, Last Modified: 18 Jun 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Transformers Can Perform Distributionally-robust Optimisation through In-context Learning
Taeyoung Kim, Hongseok Yang
- Published: 18 Jun 2024, Last Modified: 11 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Task Descriptors Help Transformers Learn Linear Models In-Context
Ruomin Huang, Rong Ge
- Published: 18 Jun 2024, Last Modified: 10 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Automatic Domain Adaptation by Transformers in In-Context Learning
Ryuichiro Hataya, Kota Matsui, Masaaki Imaizumi
- Published: 18 Jun 2024, Last Modified: 21 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Transformers as Stochastic Optimizers
Ryuichiro Hataya, Masaaki Imaizumi
- Published: 18 Jun 2024, Last Modified: 21 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond
Yingcong Li, Ankit Singh Rawat, Samet Oymak
- Published: 18 Jun 2024, Last Modified: 17 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Learning Task Representations from In-Context Learning
Baturay Saglam, Zhuoran Yang, Dionysis Kalogerias, Amin Karbasi
- Published: 18 Jun 2024, Last Modified: 07 Aug 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
LLMs learn governing principles of dynamical systems, revealing an in-context neural scaling law
Toni J.B. Liu, Nicolas Boulle, Raphaël Sarfati, Christopher Earls
- Published: 18 Jun 2024, Last Modified: 08 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Cross-lingual QA: A Key to Unlocking In-context Cross-lingual Performance
Sunkyoung Kim, Dayeon Ki, Yireun Kim, Jinsik Lee
- Published: 18 Jun 2024, Last Modified: 16 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
In-Context Learning from Training on Unstructured Data: The Role of Co-Occurrence, Positional Information, and Training Data Structure
Kevin Christian Wibisono, Yixin Wang
- Published: 18 Jun 2024, Last Modified: 22 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
In-Context Symmetries: Self-Supervised Learning through Contextual World Models
Sharut Gupta, Chenyu Wang, Yifei Wang, Tommi Jaakkola, Stefanie Jegelka
- Published: 18 Jun 2024, Last Modified: 09 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Can LLMs predict the convergence of Stochastic Gradient Descent?
Oussama Zekri, Abdelhakim Benechehab, Ievgen Redko
- Published: 18 Jun 2024, Last Modified: 22 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Learning Fast and Slow: Representations for In-Context Weight Modulation
Andrey Zhmoginov, Jihwan Lee, Max Vladymyrov, Mark Sandler
- Published: 18 Jun 2024, Last Modified: 17 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
Fast Training Dataset Attribution via In-Context Learning
Milad fotouhi, Mohammad Taha Bahadori, Seyi Feyisetan, Payman Arabshahi, David Heckerman
- Published: 18 Jun 2024, Last Modified: 20 Jul 2024
- ICML 2024 Workshop ICL Poster
- Readers: Everyone
A Theoretical Understanding of Self-Correction through In-context Alignment
Yifei Wang, Yuyang Wu, Zeming Wei, Stefanie Jegelka, Yisen Wang
- Published: 18 Jun 2024, Last Modified: 05 Jul 2024
- ICML 2024 Workshop ICL Contributedtalk
- Readers: Everyone