Efficient Training papers, 2023–2026

Scaling laws, MoE, distillation, and training efficiency

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 1,765 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Efficient Training papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
2023112678384346
2024207812280300
202519012611882516
2026177148169109603

Representative papers

Spread across years and venues so every edition shows up

All Efficient Training papers

1,765 papers, page 20 of 36

  1. NeurIPS 2025ChunkKV: Semantic-Preserving KV Cache Compression for Efficient Long-Context LLM Inference
  2. NeurIPS 2025COALA: Numerically Stable and Efficient Framework for Context-Aware Low-Rank Approximation
  3. NeurIPS 2025CodeGEMM: A Codebook-Centric Approach to Efficient GEMM in Quantized LLMs
  4. NeurIPS 2025CoIDO: Efficient Data Selection for Visual Instruction Tuning via Coupled Importance-Diversity Optimization
  5. NeurIPS 2025Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
  6. NeurIPS 2025Computation and Memory-Efficient Model Compression with Gradient Reweighting
  7. NeurIPS 2025Computational Budget Should Be Considered in Data Selection
  8. NeurIPS 2025Convex Potential Mirror Langevin Algorithm for Efficient Sampling of Energy-Based Models
  9. NeurIPS 2025Cost-Sensitive Freeze-thaw Bayesian Optimization for Efficient Hyperparameter Tuning
  10. NeurIPS 2025CrossSpectra: Exploiting Cross-Layer Smoothness for Parameter-Efficient Fine-Tuning
  11. NeurIPS 2025D2SA: Dual-Stage Distribution and Slice Adaptation for Efficient Test-Time Adaptation in MRI Reconstruction
  12. NeurIPS 2025DartQuant: Efficient Rotational Distribution Calibration for LLM Quantization
  13. NeurIPS 2025Degrees of Freedom for Linear Attention: Distilling Softmax Attention with Optimal Feature Efficiency
  14. NeurIPS 2025Delta Attention: Fast and Accurate Sparse Attention Inference by Delta Correction
  15. NeurIPS 2025DeltaFlow: An Efficient Multi-frame Scene Flow Estimation Method
  16. NeurIPS 2025Dependency Parsing is More Parameter-Efficient with Normalization
  17. NeurIPS 2025DictPFL: Efficient and Private Federated Learning on Encrypted Gradients
  18. NeurIPS 2025Diffusion on Demand: Selective Caching and Modulation for Efficient Generation
  19. NeurIPS 2025Dimension-adapted Momentum Outscales SGD
  20. NeurIPS 2025DoDo-Code: an Efficient Levenshtein Distance Embedding-based Code for 4-ary IDS Channel
  21. NeurIPS 2025Don't be lazy: CompleteP enables compute-efficient deep transformers
  22. NeurIPS 2025DuSA: Fast and Accurate Dual-Stage Sparse Attention Mechanism Accelerating Both Training and Inference
  23. NeurIPS 2025DynaNav: Dynamic Feature and Layer Selection for Efficient Visual Navigation
  24. NeurIPS 2025E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Products
  25. NeurIPS 2025EasySpec: Layer-Parallel Speculative Decoding for Efficient Multi-GPU Utilization
  26. NeurIPS 2025ECO: Evolving Core Knowledge for Efficient Transfer
  27. NeurIPS 2025Efficient $k$-Sparse Band–Limited Interpolation with Improved Approximation Ratio
  28. NeurIPS 2025Efficient and Generalizable Mixed-Precision Quantization via Topological Entropy
  29. NeurIPS 2025Efficient Data Selection at Scale via Influence Distillation
  30. NeurIPS 2025Efficient Fairness-Performance Pareto Front Computation
  31. NeurIPS 2025Efficient Hybrid Language Model Compression through Group-Aware SSM Pruning
  32. NeurIPS 2025Efficient Kernelized Learning in Polyhedral Games beyond Full Information: From Colonel Blotto to Congestion Games
  33. NeurIPS 2025Efficient Large Language Model Inference with Neural Block Linearization
  34. NeurIPS 2025Efficient Last-Iterate Convergence in Solving Extensive-Form Games
  35. NeurIPS 2025Efficient Multi-bit Quantization Network Training via Weight Bias Correction and Bit-wise Coreset Sampling
  36. NeurIPS 2025Efficient Multi-modal Large Language Models via Progressive Consistency Distillation
  37. NeurIPS 2025Efficient Multimodal Dataset Distillation via Generative Models
  38. NeurIPS 2025Efficient PAC Learning for Realizable-Statistic Models via Convex Surrogates
  39. NeurIPS 2025Efficient Parametric SVD of Koopman Operator for Stochastic Dynamical Systems
  40. NeurIPS 2025Efficient Part-level 3D Object Generation via Dual Volume Packing
  41. NeurIPS 2025Efficient Prompt Compression with Evaluator Heads for Long-Context Transformer Inference
  42. NeurIPS 2025Efficient RAW Image Deblurring with Adaptive Frequency Modulation
  43. NeurIPS 2025Efficient Representativeness-Aware Coreset Selection
  44. NeurIPS 2025Efficient semantic uncertainty quantification in language models via diversity-steered sampling
  45. NeurIPS 2025Efficient Speech Language Modeling via Energy Distance in Continuous Latent Space
  46. NeurIPS 2025Efficient Utility-Preserving Machine Unlearning with Implicit Gradient Surgery
  47. NeurIPS 2025Efficient Verified Unlearning For Distillation
  48. NeurIPS 2025ElliCE: Efficient and Provably Robust Algorithmic Recourse via the Rashomon Sets
  49. NeurIPS 2025Emergence and scaling laws in SGD learning of shallow neural networks
  50. NeurIPS 2025EventMG: Efficient Multilevel Mamba-Graph Learning for Spatiotemporal Event Representation

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Efficient Training papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "efficient-training"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Efficient Training papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
1,765 in total: 346 in 2023, 300 in 2024, 516 in 2025, 603 in 2026.
How many Efficient Training papers are at NeurIPS 2026?
NeurIPS 2026 has 177 Efficient Training papers, versus 190 the year before.
How many Efficient Training papers are at ICLR 2026?
ICLR 2026 has 148 Efficient Training papers, versus 126 the year before.
How many Efficient Training papers are at ICML 2026?
ICML 2026 has 169 Efficient Training papers, versus 118 the year before.
How many Efficient Training papers are at CVPR 2026?
CVPR 2026 has 109 Efficient Training papers, versus 82 the year before.
Which conference publishes the most Efficient Training papers?
NeurIPS, with 499 papers from 2023 to 2026.

More in Efficiency and Systems