Low-Rank Adaptation papers, 2023–2026

Key findings

• Low-Rank Adaptation went from 282 papers in 2023 to 841 in 2026, roughly 3.0x in three years.
• NeurIPS publishes the most Low-Rank Adaptation work: 781 papers from 2023 to 2026, 34% of the four-venue total.
• The fastest-growing overlap is with Diffusion Models: papers tagged with both rose from 4 in 2023 to 61 in 2026.
• Among the 5 topics under Optimization and Scaling, it ranks #1 by 2026 paper count; the fastest grower in the group, Scaling Laws, is up 4.1x versus 3.0x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026$\delta$-Mem: : Efficient Online Memory For Large Language Models
• ICML 2026A3: an Analytical Low-Rank Approximation Framework for Attention
• ICLR 2026A Guardrail for Safety Preservation: When Safety-Sensitive Subspace Meets Harmful-Resistant Null-Space
• CVPR 20262-Shots in the Dark Low-Light Denoising with Minimal Data Acquisition
• NeurIPS 2025A geometric framework for momentum-based optimizers for low-rank training
• ICML 2025Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning
• ICLR 2025A Quantum Circuit-Based Compression Perspective for Parameter-Efficient Learning
• CVPR 2025AdaDARE-gamma: Balancing Stability and Plasticity in Multi-modal LLMs through Efficient Adaptation
• NeurIPS 2024Bridging The Gap between Low-rank and Orthogonal Adaptation via Householder Reflection Adaptation
• ICML 2024A Tensor Decomposition Perspective on Second-order RNNs
• ICLR 2024A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation
• CVPR 2024DePT: Decoupled Prompt Tuning
• NeurIPS 2023A Theoretical Analysis of the Test Error of Finite-Rank Kernel Ridge Regression
• ICML 2023A Three-regime Model of Network Pruning
• ICLR 2023A General Rank Preserving Framework for Asymmetric Image Retrieval
• CVPR 20231% VS 100%: Parameter-Efficient Low Rank Adapter for Dense Predictions
• NeurIPS 2026A low-rank decoder bottleneck bounds reliability in foundation-model perturbation prediction
• ICML 2026Adaptive Utilization of Low-Rank Adaptation via Conditioned Gating
• ICLR 2026ABBA-Adapters: Efficient and Expressive Fine-Tuning of Foundation Models
• CVPR 2026Basis-Oriented Low-rank Transfer for Few-Shot and Test-Time Adaptation

All Low-Rank Adaptation papers

518 papers, page 10 of 11

451. NeurIPS 2024OneBit: Towards Extremely Low-bit Large Language Models
452. NeurIPS 2024Online Adaptation of Language Models with a Memory of Amortized Contexts
453. NeurIPS 2024Online Feature Updates Improve Online (Generalized) Label Shift Adaptation
454. NeurIPS 2024Open LLMs are Necessary for Current Private Adaptations and Outperform their Closed Alternatives
455. NeurIPS 2024OTTER: Effortless Label Distribution Adaptation of Zero-shot Models
456. NeurIPS 2024PACE: Marrying generalization in PArameter-efficient fine-tuning with Consistency rEgularization
457. NeurIPS 2024Panacea: Pareto Alignment via Preference Adaptation for LLMs
458. NeurIPS 2024Parameter Competition Balancing for Model Merging
459. NeurIPS 2024Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts
460. NeurIPS 2024Parameter-free Clipped Gradient Descent Meets Polyak
461. NeurIPS 2024Personalized Federated Learning via Feature Distribution Adaptation
462. NeurIPS 2024PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models
463. NeurIPS 2024Pre-Trained Multi-Goal Transformers with Prompt Optimization for Efficient Online Adaptation
464. NeurIPS 2024Pretrained Transformer Efficiently Learns Low-Dimensional Target Functions In-Context
465. NeurIPS 2024PrivAuditor: Benchmarking Data Protection Vulnerabilities in LLM Adaptation Techniques
466. NeurIPS 2024Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation
467. NeurIPS 2024Provably Efficient Reinforcement Learning with Multinomial Logit Function Approximation
468. NeurIPS 2024QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation
469. NeurIPS 2024Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models
470. NeurIPS 2024ReFT: Representation Finetuning for Language Models
471. NeurIPS 2024Repurposing Language Models into Embedding Models: Finding the Compute-Optimal Recipe
472. NeurIPS 2024Rethinking Misalignment in Vision-Language Model Adaptation from a Causal Perspective
473. NeurIPS 2024Rethinking Transformer for Long Contextual Histopathology Whole Slide Image Analysis
474. NeurIPS 2024S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity
475. NeurIPS 2024Safe LoRA: The Silver Lining of Reducing Safety Risks when Finetuning Large Language Models
476. NeurIPS 2024SAFE: Slow and Fast Parameter-Efficient Tuning for Continual Learning with Pre-Trained Models
477. NeurIPS 2024Sample-Efficient Geometry Reconstruction from Euclidean Distances using Non-Convex Optimization
478. NeurIPS 2024Sample-Efficient Private Learning of Mixtures of Gaussians
479. NeurIPS 2024SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation
480. NeurIPS 2024SGD vs GD: Rank Deficiency in Linear Networks
481. NeurIPS 2024Shaping the distribution of neural responses with interneurons in a recurrent circuit model
482. NeurIPS 2024Sharing Key Semantics in Transformer Makes Efficient Image Restoration
483. NeurIPS 2024Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts
484. NeurIPS 2024Sketched Lanczos uncertainty score: a low-memory summary of the Fisher information
485. NeurIPS 2024Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning
486. NeurIPS 2024SLTrain: a sparse plus low rank approach for parameter and memory efficient pretraining
487. NeurIPS 2024SpaFL: Communication-Efficient Federated Learning With Sparse Models And Low Computational Overhead
488. NeurIPS 2024Sparse High Rank Adapters
489. NeurIPS 2024Spectral Adapter: Fine-Tuning in Spectral Space
490. NeurIPS 2024SpeedLoader: An I/O efficient scheme for heterogeneous and distributed LLM operation
491. NeurIPS 2024Spiking Token Mixer: An event-driven friendly Former structure for spiking neural networks
492. NeurIPS 2024SSDiff: Spatial-spectral Integrated Diffusion Model for Remote Sensing Pansharpening
493. NeurIPS 2024Stepping Forward on the Last Mile
494. NeurIPS 2024Structured flexibility in recurrent neural networks via neuromodulation
495. NeurIPS 2024Structured Unrestricted-Rank Matrices for Parameter Efficient Finetuning
496. NeurIPS 2024SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors
497. NeurIPS 2024Swift Sampler: Efficient Learning of Sampler by 10 Parameters
498. NeurIPS 2024Tensor-Based Synchronization and the Low-Rankness of the Block Trifocal Tensor
499. NeurIPS 2024Test-Time Adaptation Induces Stronger Accuracy and Agreement-on-the-Line
500. NeurIPS 2024The Impact of Initialization on LoRA Finetuning Dynamics

FAQ

How many Low-Rank Adaptation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

2,273 in total: 282 in 2023, 518 in 2024, 632 in 2025, 841 in 2026.

How many Low-Rank Adaptation papers are at NeurIPS 2026?

NeurIPS 2026 has 269 Low-Rank Adaptation papers, versus 241 the year before.

How many Low-Rank Adaptation papers are at ICLR 2026?

ICLR 2026 has 184 Low-Rank Adaptation papers, versus 152 the year before.

How many Low-Rank Adaptation papers are at ICML 2026?

ICML 2026 has 240 Low-Rank Adaptation papers, versus 136 the year before.

How many Low-Rank Adaptation papers are at CVPR 2026?

CVPR 2026 has 148 Low-Rank Adaptation papers, versus 103 the year before.

Which conference publishes the most Low-Rank Adaptation papers?

NeurIPS, with 781 papers from 2023 to 2026.