Efficient Training papers, 2023–2026

Key findings

• Efficient Training went from 346 papers in 2023 to 603 in 2026, roughly 1.7x in three years.
• NeurIPS publishes the most Efficient Training work: 499 papers from 2023 to 2026, 28% of the four-venue total.
• The fastest-growing overlap is with Deep learning · large language models: papers tagged with both rose from 6 in 2023 to 50 in 2026.
• Among the 5 topics under Efficiency and Systems, it ranks #3 by 2026 paper count; the fastest grower in the group, Hardware-Aware ML, is up 4.4x versus 1.7x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Adaptive Residual Quantization for Memory-Efficient Temporal Action Segmentation
• ICML 2026A Geometry-Aware Efficient Algorithm for Compositional Entropic Risk Minimization
• ICLR 2026An Efficient SE(p)-Invariant Transport Metric Driven by Polar Transport Discrepancy-based Representation
• CVPR 2026A Bit is All You Need Efficient Video Capture via
• NeurIPS 20254DGCPro: Efficient Hierarchical 4D Gaussian Compression for Progressive Volumetric Video Streaming
• ICML 2025A Sample Efficient Conditional Independence Test in the Presence of Discretization
• ICLR 2025Breaking Class Barriers: Efficient Dataset Distillation via Inter-Class Feature Compensator
• CVPR 2025Accurate Scene Text Recognition with Efficient Model Scaling and Cloze Self-Distillation
• NeurIPS 2024$\texttt{dattri}$: A Library for Efficient Data Attribution
• ICML 2024A fast algorithm to simulate nonlinear resistive networks
• ICLR 2024Dictionary Contrastive Learning for Efficient Local Supervision without Auxiliary Networks
• CVPR 2024Deep-TROJ: An Inference Stage Trojan Insertion Algorithm through Efficient Weight Replacement Attack
• NeurIPS 2023Alternating Updates for Efficient Transformers
• ICML 2023Auxiliary Modality Learning with Generalized Curriculum Distillation
• ICLR 2023A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learning
• CVPR 2023A Rotation-Translation-Decoupled Solution for Robust and Efficient Visual-Inertial Initialization
• NeurIPS 2026Advanced Routing as Regularization Allocation for Efficient Diffusion Transformer Training
• ICML 2026Active Learning with Foundation Model Priors: Efficient Learning under Class Imbalance
• ICLR 2026AQER: A Scalable and Efficient Data Loader for Digital Quantum Computers
• CVPR 2026Adaptive Bayesian Early-Exit Networks for Efficient Non-Transferable Learning

All Efficient Training papers

177 papers, page 2 of 4

51. NeurIPS 2026Efficient Fine-Tuning for Structured Sparsity Under Group Repartitioning
52. NeurIPS 2026Efficient Image Synthesis with Sphere Latent Encoder
53. NeurIPS 2026Efficient Label Distribution Inference Attack and Defense on Classifier Weights in Federated Learning
54. NeurIPS 2026Efficient Learning of Truncated Boolean Product Distributions: Influence to the Rescue
55. NeurIPS 2026Efficient LLM Adaptation with Forward-Only Passes
56. NeurIPS 2026Efficient Memory Crystallization for Graph Learning under Non-Stationary Distribution Shifts
57. NeurIPS 2026Efficient Pre-Training with Token Superposition
58. NeurIPS 2026Efficient Scaling of LLM Training with Flexible Context Parallelism
59. NeurIPS 2026Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Management
60. NeurIPS 2026Efficient Training of Deep Spiking Neural Networks with Input-Driven Derivative-Free Updates
61. NeurIPS 2026Efficient Variational Inference for Log-Gaussian Cox Processes via Voronoi Tessellation
62. NeurIPS 2026Efficient, Accurate and Stable Gradients for Neural ODEs
63. NeurIPS 2026Efficiently Aligning Draft Models via Parameter- and Data-Efficient Adaptation
64. NeurIPS 2026EngramState: Loadable Tool Priors for Efficient Function Calling
65. NeurIPS 2026EventPrune: Cascaded Event-Assisted Token Pruning for Efficient First-Person Dynamic Spatial Reasoning
66. NeurIPS 2026Fast KVzip: Efficient and Accurate LLM Inference with Gated KV Eviction
67. NeurIPS 2026FELPS: Fair and Efficient Scheduling for Multi-LoRA Serving System
68. NeurIPS 2026Finite-Memory Control of POMDPs: Fundamental Limits and Efficient Design
69. NeurIPS 2026Finite-Sample and Communication-Efficient Networked Information Aggregation
70. NeurIPS 2026Flash-KMeans: Fast and Memory-Efficient Exact K-Means
71. NeurIPS 2026FlashMask-3: Efficient and Expressive Mask-Aware Distributed Attention
72. NeurIPS 2026Flow-Direct: Feedback-Efficient and Reusable Guidance for Flow Models via Non-Parametric Guidance Field
73. NeurIPS 2026From Experts to Sub-experts: Fine-grained Parameter-Efficient Fine-Tuning for MoE LLMs
74. NeurIPS 2026Generative Cross-Entropy: A Strictly Proper Loss for Data-Efficient Classification
75. NeurIPS 2026GramStatTexNet: Efficient, Interpretable, and Neuro-Inspired Texture Analysis-by-Synthesis
76. NeurIPS 2026HetCCL: Efficient LLM Training on Heterogeneous Vendor GPUs
77. NeurIPS 2026HiFloat4 Format for Language Model Pre-training on Ascend NPUs
78. NeurIPS 2026Holistic Scaling Laws for Optimal Mixture-of-Experts Architecture Optimization
79. NeurIPS 2026How Much Is One Recurrence Worth? Iso-Depth Scaling Laws for Looped Language Models
80. NeurIPS 2026Human-Inspired, Task-Dimension-Guided Exploration for Efficient Learning and Transfer in High Dimensions
81. NeurIPS 2026Hyperbolic Language Models: From Zipf to Compute-Optimal Scaling
82. NeurIPS 2026HyperVAttention: Efficient Sparse Attention with Spatio-Temporal Clustering for Video Diffusion
83. NeurIPS 2026IncAgg: Efficient Memory-Enhanced Graph Learning via Incremental Aggregation
84. NeurIPS 2026Joint Sequence--Vocabulary Selection for Efficient LLM Distillation
85. NeurIPS 2026Label-Efficient Dataset Pruning via Semi-Supervised Pseudo-Labeling
86. NeurIPS 2026Learning to Foresee: Unveiling the Unlocking Efficiency of On-Policy Distillation
87. NeurIPS 2026Leech Lattice Vector Quantization for Efficient LLM Compression
88. NeurIPS 2026LEMON-ZEST: Evolution-Informed Tokenization for Efficient Protein Language Modeling
89. NeurIPS 2026LIME: Link-based User-item Interaction Modeling with Decoupled XOR Attention for Efficient Test Time Scaling
90. NeurIPS 2026LLM Routing Through the Lens of Recommendation: A Roadmap for Efficient AI Orchestration
91. NeurIPS 2026Logical Distillation of Transformer Encoders
92. NeurIPS 2026LoopPrune: Evolutionary Module Selection with Iterative Execution for Efficient Large Language Model Compression
93. NeurIPS 2026Magnitude-preserving Layers Enable Efficient GANs
94. NeurIPS 2026Map-Guided Caching: A Global Perspective for Efficient Diffusion Transformer
95. NeurIPS 2026Matched-Control Tests of Partition-Source Claims in One Routed Distillation Family
96. NeurIPS 2026MemForest: Efficient Agent Memory Management via EventTree Partitioning and Progressive Merging
97. NeurIPS 2026Meta-memorization and memorization scaling laws in transformers
98. NeurIPS 2026MGMem: An Efficient, Deterministic, and Provenance-Preserving Framework for Long-Horizon Agent Memory
99. NeurIPS 2026Mixture-of-Top-$k$ Attention: Efficient Attention as Scalable Fast Weights
100. NeurIPS 2026MoE-SpAc: Efficient MoE Inference Based on Speculative Activation Utility in Heterogeneous Edge Scenario

FAQ

How many Efficient Training papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

1,765 in total: 346 in 2023, 300 in 2024, 516 in 2025, 603 in 2026.

How many Efficient Training papers are at NeurIPS 2026?

NeurIPS 2026 has 177 Efficient Training papers, versus 190 the year before.

How many Efficient Training papers are at ICLR 2026?

ICLR 2026 has 148 Efficient Training papers, versus 126 the year before.

How many Efficient Training papers are at ICML 2026?

ICML 2026 has 169 Efficient Training papers, versus 118 the year before.

How many Efficient Training papers are at CVPR 2026?

CVPR 2026 has 109 Efficient Training papers, versus 82 the year before.

Which conference publishes the most Efficient Training papers?

NeurIPS, with 499 papers from 2023 to 2026.