NeurIPS 2024 Workshop FITML Submissions

UnoLoRA: Single Low-Rank Adaptation for Efficient Multitask Fine-tuning
Akash Kamalesh, Anirudh Lakhotia, Nischal H S, Prerana Sanjay Kulkarni, Gowri Srinivasa
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Characterizing the Training Dynamics of Private Fine-tuning with Langevin diffusion
Shuqi Ke, Charlie Hou, Sewoong Oh, Giulia Fanti
- Published: 10 Oct 2024, Last Modified: 10 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
COMAL: A Convergent Meta-Algorithm for Aligning LLMs with General Preferences
Yixin Liu, Argyris Oikonomou, Weiqiang Zheng, Yang Cai, Arman Cohan
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Oral
- Readers: Everyone
Navigating Parameter Space with Geodesic Interpolation: A New Approach to Efficient Fine-Tuning
Sophia Abraham
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Learning Reward and Policy Jointly from Demonstration and Preference Improves Alignment
Chenliang Li, Siliang Zeng, Zeyi Liao, Jiaxiang Li, Dongyeop Kang, Alfredo Garcia, Mingyi Hong
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Instruct-SkillMix: A Powerful Pipeline for LLM Instruction Tuning
Simran Kaur, Simon Park, Anirudh Goyal, Sanjeev Arora
- Published: 10 Oct 2024, Last Modified: 31 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Deep Reinforcement Learning Without Experience Replay, Target Networks, or Batch Updates
Mohamed Elsayed, Gautham Vasan, A. Rupam Mahmood
- Published: 10 Oct 2024, Last Modified: 09 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Teaching LLMs How To Learn with Contextual Fine-Tuning
Younwoo Choi, Muhammad Adil Asif, Ziwen Han, John Willes, Rahul Krishnan
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
LLM Alignment Through Successive Policy Re-weighting (SPR)
Xinnan Zhang, Siliang Zeng, Jiaxiang Li, Kaixiang Lin, Mingyi Hong
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
Noam Razin, Sadhika Malladi, Adithya Bhaskar, Danqi Chen, Sanjeev Arora, Boris Hanin
- Published: 10 Oct 2024, Last Modified: 20 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
RoCoFT: Efficient Finetuning of Large Language Models with Row-Column Updates
Md Kowsher, Tara Esmaeilbeig, Chun-Nam Yu, Mojtaba Soltanalian, Niloofar Yousefi
- Published: 10 Oct 2024, Last Modified: 30 Nov 2024
- FITML 2024 Oral
- Readers: Everyone
Evaluating Fine-Tuning Efficiency of Human-Inspired Learning Strategies in Medical Question Answering
Yushi Yang, Andrew Michael Bean, Robert McCraith, Adam Mahdi
- Published: 10 Oct 2024, Last Modified: 02 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors
Vijay Lingam, Atula Tejaswi, Aditya Vavre, Aneesh Shetty, Gautham Krishna Gudur, Joydeep Ghosh, Alex Dimakis, Eunsol Choi, Aleksandar Bojchevski, Sujay Sanghavi
- Published: 10 Oct 2024, Last Modified: 06 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Skip Transformers: Efficient Inference through Skip-Routing
Matthew Peroni, Dimitris Bertsimas
- Published: 10 Oct 2024, Last Modified: 02 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Optimizing Small Language Models for In-Vehicle Function-Calling
YAHYA SOWTI KHIABANI, Farris Atif, Chieh Hsu, Sven Stahlmann, Tobias Michels, Sebastian Kramer, Benedikt Heidrich, M. Saquib Sarfraz, Julian Merten, Faezeh Tafazzoli
- Published: 10 Oct 2024, Last Modified: 31 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Simultaneous Weight and Architecture Optimization for Neural Networks
Zitong Huang, Mansooreh Montazerin, Ajitesh Srivastava
- Published: 10 Oct 2024, Last Modified: 30 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Instant Transformer Adaption via HyperLoRA
Rujikorn Charakorn, Edoardo Cetin, Yujin Tang, Robert Tjarko Lange
- Published: 10 Oct 2024, Last Modified: 18 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
FedEx-LoRA: Exact Aggregation for Federated Parameter-Efficient Fine-Tuning of Foundation Models
Raghav Singhal, Kaustubh Ponkshe, Praneeth Vepakomma
- Published: 10 Oct 2024, Last Modified: 30 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Enhancing Cross-Language Code Translation via Task-Specific Embedding Alignment in Retrieval-Augmented Generation
Manish Bhattarai, Javier E. Santos, Ismael Boureima, Daniel O'Malley
- Published: 10 Oct 2024, Last Modified: 28 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Accelerating Direct Preference Optimization with Prefix Sharing
Franklin Wang, Sumanth Hegde
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
Hierarchical Unlearning Framework for Multi-Class Classification
Abraham Chan, Arpan Gujarati, Karthik Pattabiraman, Sathish Gopalakrishnan
- Published: 10 Oct 2024, Last Modified: 31 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Early Exiting in Deep Neural Networks via Dirichlet-based Uncertainty Quantification
Feng Xia, Jake Snell, Thomas L. Griffiths
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
On the Transferability of Parameter-Efficient Continual Learning for Vision Transformers
Leon Ackermann, Van-Linh Nguyen
- Published: 10 Oct 2024, Last Modified: 01 Nov 2024
- FITML 2024 Poster
- Readers: Everyone
GaLore-mini: Low Rank Gradient Learning with Fewer Learning Rates
Weihao Huang, Zhenyu Zhang, Yushun Zhang, Zhi-Quan Luo, Ruoyu Sun, Zhangyang Wang
- Published: 10 Oct 2024, Last Modified: 31 Oct 2024
- FITML 2024 Poster
- Readers: Everyone
Effective Text-to-Image Alignment with Quality Aware Pair Ranking
Kunal Singh, Mukund Khanna, Pradeep Moturi
- Published: 10 Oct 2024, Last Modified: 29 Oct 2024
- FITML 2024 Poster
- Readers: Everyone