高效训练论文趋势 2023–2026

Scaling law、MoE、蒸馏与训练效率

统计范围：NeurIPS、ICLR、ICML、CVPR 四个会议，2023–2026 年，共 1,765 篇被归入该主题的论文。

主要结论

每年论文数

各会议论文数

按年份和会议统计

高效训练论文数，按年份和会议
年份NeurIPSICLRICMLCVPR合计
2023112678384346
2024207812280300
202519012611882516
2026177148169109603

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

全部高效训练论文

年份全部2023202420252026
会议全部NeurIPSICLRICMLCVPR

共 1,765 篇，第 26 / 36 页

  1. ICLR 2024OVOR: OnePrompt with Virtual Outlier Regularization for Rehearsal-Free Class-Incremental Learning
  2. ICLR 2024Plug-and-Play: An Efficient Post-training Pruning Method for Large Language Models
  3. ICLR 2024PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
  4. ICLR 2024Project and Probe: Sample-Efficient Adaptation by Interpolating Orthogonal Features
  5. ICLR 2024Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning
  6. ICLR 2024QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models
  7. ICLR 2024RDesign: Hierarchical Data-efficient Representation Learning for Tertiary Structure-based RNA Design
  8. ICLR 2024ReFusion: Improving Natural Language Understanding with Computation-Efficient Retrieval Representation Fusion
  9. ICLR 2024Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learning
  10. ICLR 2024RETSim: Resilient and Efficient Text Similarity
  11. ICLR 2024Scaling Laws for Sparsely-Connected Foundation Models
  12. ICLR 2024Scaling Laws of RoPE-based Extrapolation
  13. ICLR 2024Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  14. ICLR 2024SPTNet: An Efficient Alternative Framework for Generalized Category Discovery with Spatial Prompt Tuning
  15. ICLR 2024ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Search
  16. ICLR 2024Towards Energy Efficient Spiking Neural Networks: An Unstructured Pruning Framework
  17. ICLR 2024Towards Reliable and Efficient Backdoor Trigger Inversion via Decoupling Benign Features
  18. ICLR 2024Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillation
  19. ICLR 2024Tree-Planner: Efficient Close-loop Task Planning with Large Language Models
  20. ICLR 2024Tuning LayerNorm in Attention: Towards Efficient Multi-Modal LLM Finetuning
  21. ICLR 2024VQGraph: Rethinking Graph Representation Space for Bridging GNNs and MLPs
  22. ICLR 2024Waxing-and-Waning: a Generic Similarity-based Framework for Efficient Self-Supervised Learning
  23. ICLR 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method
  24. ICLR 2024YaRN: Efficient Context Window Extension of Large Language Models
  25. ICLR 2024You Only Query Once: An Efficient Label-Only Membership Inference Attack
  26. ICLR 2024ZeRO++: Extremely Efficient Collective Communication for Large Model Training
  27. ICLR 2024Zoology: Measuring and Improving Recall in Efficient Language Models
  28. ICML 2024A Circuit Domain Generalization Framework for Efficient Logic Synthesis in Chip Design
  29. ICML 2024A Dynamical Model of Neural Scaling Laws
  30. ICML 2024A fast algorithm to simulate nonlinear resistive networks
  31. ICML 2024A New Computationally Efficient Algorithm to solve Feature Selection for Functional Data Classification in High-dimensional Spaces
  32. ICML 2024A Tale of Tails: Model Collapse as a Change of Scaling Laws
  33. ICML 2024AegisFL: Efficient and Flexible Privacy-Preserving Byzantine-Robust Cross-silo Federated Learning
  34. ICML 2024An Efficient Maximal Ancestral Graph Listing Algorithm
  35. ICML 2024An Efficient Self-Learning Framework For Interactive Spoken Dialog Systems
  36. ICML 2024APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  37. ICML 2024Asymptotically Optimal and Computationally Efficient Average Treatment Effect Estimation in A/B testing
  38. ICML 2024Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws
  39. ICML 2024Beyond Regular Grids: Fourier-Based Neural Operators on Arbitrary Domains
  40. ICML 2024CaM: Cache Merging for Memory-efficient LLMs Inference
  41. ICML 2024CHAI: Clustered Head Attention for Efficient LLM Inference
  42. ICML 2024CLIPZyme: Reaction-Conditioned Virtual Screening of Enzymes
  43. ICML 2024Collaborative Learning with Different Labeling Functions
  44. ICML 2024Compute Better Spent: Replacing Dense Layers with Structured Matrices
  45. ICML 2024CosPGD: an efficient white-box adversarial attack for pixel-wise prediction tasks
  46. ICML 2024Data-efficient Large Vision Models through Sequential Autoregression
  47. ICML 2024Data-Efficient Learning via Clustering-Based Sensitivity Sampling: Foundation Models and Beyond
  48. ICML 2024Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compression
  49. ICML 2024Deep Fusion: Efficient Network Training via Pre-trained Initializations
  50. ICML 2024Delving into Differentially Private Transformer

在 Claude、Cursor 里直接问这个趋势

接上 Paperlist MCP 后，写综述、挑方向或准备投稿时，不用离开对话框就能拿到这页的数字：每年各会议的论文数、增长倍数、涨得最快的子方向和代表论文，AI 会按你的问题整理。

可以直接复制这句话问 AI

用 paperlist 查高效训练在 NeurIPS 2023–2026 的论文趋势，哪一年涨得最快？

AI 会调用的工具：get_topic_stats {"topic": "efficient-training"}

两分钟接入 Paperlist MCP（Claude Code、Cursor、Codex、ChatGPT）

常见问题

2023–2026 年四大会议一共有多少篇高效训练论文？
共 1,765 篇，按年份分别是 2023 年 346 篇、2024 年 300 篇、2025 年 516 篇、2026 年 603 篇。
NeurIPS 2026 有多少篇高效训练论文？
NeurIPS 2026 有 177 篇高效训练论文，上一届是 190 篇。
ICLR 2026 有多少篇高效训练论文？
ICLR 2026 有 148 篇高效训练论文，上一届是 126 篇。
ICML 2026 有多少篇高效训练论文？
ICML 2026 有 169 篇高效训练论文，上一届是 118 篇。
CVPR 2026 有多少篇高效训练论文？
CVPR 2026 有 109 篇高效训练论文，上一届是 82 篇。
哪个会议的高效训练论文最多？
NeurIPS，2023–2026 年共 499 篇。

「效率与系统」下的其他主题