CPAL 2025 Recent Spotlight Track Submissions

Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes
Dan Qiao, Kaiqi Zhang, Esha Singh, Daniel Soudry, Yu-Xiang Wang
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Simplifying DINO by Coding Rate Regularization
Ziyang Wu, Jingyuan Zhang, Druv Pai, Yi Ma
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Geometry of Concepts in Next-token Prediction: Neural-Collapse Meets Semantics
Yize Zhao, Christos Thrampoulidis
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Out-of-distribution generalization via composition: a lens through induction heads in Transformers
Jiajun Song, Zhuoyan Xu, Yiqiao Zhong
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Attention-Only Transformers via Unrolled Subspace Denoising
Peng Wang, Yifu Lu, Yaodong Yu, Druv Pai, Qing Qu, Yi Ma
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Unlocking Global Optimality in Bilevel Optimization: A Pilot Study
Quan Xiao, Tianyi Chen
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Visual Prompting Reimagined: The Power of Activation Prompts
Yihua Zhang, Hongkang Li, Yuguang Yao, Aochuan Chen, Shuai Zhang, Pin-Yu Chen, Meng Wang, Sijia Liu
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Deep Neural Regression Collapse
Akshay Rangamani, Altay Unal
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Geometric Algebra Planes: Convex Implicit Neural Volumes
Irmak Sivgin, Sara Fridovich-Keil, Gordon Wetzstein, Mert Pilanci
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysis
Shirin Shoushtari, Jiaming Liu, Edward P. Chandler, M. Salman Asif, Ulugbek S. Kamilov
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models
Jinghan Jia, Jiancheng Liu, Yihua Zhang, Parikshit Ram, Nathalie Baracaldo, Sijia Liu
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
On Generalization Bounds for Neural Networks with Low Rank Layers
Andrea Pinto, Akshay Rangamani, Tomaso A Poggio
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
Tianzhe Chu, Yuexiang Zhai, Jihan Yang, Shengbang Tong, Saining Xie, Sergey Levine, Yi Ma
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Understanding Representation Dynamics of Diffusion Models via Low-Dimensional Modeling
Xiao Li, Zekai Zhang, Xiang Li, Siyi Chen, Zhihui Zhu, Peng Wang, Qing Qu
- Published: 11 Feb 2025, Last Modified: 19 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
SITCOM: Step-wise Triple-Consistent Diffusion Sampling for Inverse Problems
Ismail Alkhouri, Shijun Liang, Cheng-Han Huang, Jimmy Dai, Qing Qu, Saiprasad Ravishankar, Rongrong Wang
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Image Reconstruction Via Autoencoding Sequential Deep Image Prior
Ismail Alkhouri, Shijun Liang, Evan Bell, Qing Qu, Rongrong Wang, Saiprasad Ravishankar
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Diffusion models learn low-dimensional distributions via subspace clustering
Peng Wang, Huijie Zhang, Zekai Zhang, Siyi Chen, Yi Ma, Qing Qu
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
FlowDAS: A Flow-Based Framework for Data Assimilation
Siyi Chen, Yixuan Jia, Qing Qu, He Sun, Jeffrey A Fessler
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Principle Component Trees and their Persistent Homology
Ben Kizaric, Daniel L. Pimentel-Alarcón
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Dynamic Rescaling for Training GNNs
Nimrah Mustafa, Rebekka Burkholz
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Pruning neural network models for gene regulatory dynamics using data and domain knowledge
Intekhab Hossain, Jonas Fischer, Rebekka Burkholz, John Quackenbush
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Sparse Training from Random Initialization: Aligning Lottery Ticket Masks using Weight Symmetry
Mohammed Adnan, Rohan Jain, Ekansh Sharma, Yani Ioannou
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations
Yize Zhao, Tina Behnia, Vala Vakilian, Christos Thrampoulidis
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Learning Dynamics of Deep Matrix Factorization Beyond the Edge of Stability
Avrajit Ghosh, Soo Min Kwon, Rongrong Wang, Saiprasad Ravishankar, Qing Qu
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone
Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN
Pengxiang Li, Lu Yin, Shiwei Liu
- Published: 11 Feb 2025, Last Modified: 06 Mar 2025
- CPAL 2025 (Recent Spotlight Track)
- Readers: Everyone