长上下文论文趋势 2023–2026

主要结论

• 长上下文论文从 2023 年的 66 篇增长到 2026 年的 341 篇，三年间扩大到约 5.2 倍。
• NeurIPS 是发长上下文论文最多的会议，2023–2026 年共 298 篇，占四个会议总量的 36%。
• 交叉方向里涨得最快的是AI 智能体：同时属于两个主题的论文从 2023 年的 0 篇增至 2026 年的 45 篇。
• 在「长上下文与记忆」的 5 个主题里，它的 2026 年论文数排第 1；同组增长最快的检索记忆是 6.6 倍，长上下文是 5.2 倍。

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

• NeurIPS 2026Accelerating Long-Context LLM Prefill via Layer-wise Progressive Token Pruning in Local Deployment
• ICML 2026AdaSplash-2: Faster Differentiable Sparse Attention
• ICLR 2026An evolutionary perspective on modes of learning in Transformers
• CVPR 2026AR2-4FV Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View
• NeurIPS 2025A Controllable Examination for Long-Context Language Models
• ICML 2025CateKV: On Sequential Consistency for Long-Context LLM Inference Acceleration
• ICLR 2025$\text{D}_{2}\text{O}$: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models
• CVPR 2025BIMBA: Selective-Scan Compression for Long-Range Video Question Answering
• NeurIPS 2024[Re] CUDA: Curriculum of Data Augmentation for Long‐tailed Recognition
• ICML 2024Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT
• ICLR 2024CLEX: Continuous Length Extrapolation for Large Language Models
• CVPR 2024GigaTraj: Predicting Long-term Trajectories of Hundreds of Pedestrians in Gigapixel Complex Scenes
• NeurIPS 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation
• ICML 2023CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling
• ICLR 2023$k$NN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference
• CVPR 2023AutoAD: Movie Description in Context
• NeurIPS 2026AdaCal: Adaptive Calibration for Robust Sparse Attention in Long-Context LLMs
• ICML 2026Artificial Hippocampus Networks for Efficient Long-Context Modeling
• ICLR 2026AutoSP: Unlocking Long-Context LLM Training Via Compiler-Based Sequence Parallelism
• CVPR 2026AstraNav-Memory Contexts Compression for Long Memory

全部长上下文论文

共 60 篇，第 1 / 2 页

1. ICML 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts
2. ICML 2024An Information-Theoretic Analysis of In-Context Learning
3. ICML 2024Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT
4. ICML 2024Bifurcated Attention for Single-Context Large-Batch Sampling
5. ICML 2024Breaking through the learning plateaus of in-context learning in Transformer
6. ICML 2024Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling
7. ICML 2024Can Mamba Learn How To Learn? A Comparative Study on In-Context Learning Tasks
8. ICML 2024Chasing Convex Functions with Long-term Constraints
9. ICML 2024Conditional Language Learning with Context
10. ICML 2024Data Engineering for Scaling Language Models to 128K Context
11. ICML 2024Dual Operating Modes of In-Context Learning
12. ICML 2024Efficient World Models with Context-Aware Tokenization
13. ICML 2024ELTA: An Enhancer against Long-Tail for Aesthetics-oriented Models
14. ICML 2024Emergence of In-Context Reinforcement Learning from Noise Distillation
15. ICML 2024Evaluating Quantized Large Language Models
16. ICML 2024Exact Conversion of In-Context Learning to Model Weights in Linearized-Attention Transformers
17. ICML 2024Fast Peer Adaptation with Context-aware Exploration
18. ICML 2024Feedback Loops With Language Models Drive In-Context Reward Hacking
19. ICML 2024Generalization to New Sequential Decision Making Tasks with In-Context Learning
20. ICML 2024GistScore: Learning Better Representations for In-Context Example Selection with Gist Bottlenecks
21. ICML 2024Harnessing Hierarchical Label Distribution Variations in Test Agnostic Long-tail Recognition
22. ICML 2024How do Transformers Perform In-Context Autoregressive Learning ?
23. ICML 2024In-context Convergence of Transformers
24. ICML 2024In-Context Decision Transformer: Reinforcement Learning via Hierarchical Chain-of-Thought
25. ICML 2024In-Context Language Learning: Architectures and Algorithms
26. ICML 2024In-Context Learning Agents Are Asymmetric Belief Updaters
27. ICML 2024In-context Learning on Function Classes Unveiled for Transformers
28. ICML 2024In-Context Principle Learning from Mistakes
29. ICML 2024In-Context Unlearning: Language Models as Few-Shot Unlearners
30. ICML 2024In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
31. ICML 2024Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective
32. ICML 2024Language Models as Science Tutors
33. ICML 2024Learning Label Shift Correction for Test-Agnostic Long-Tailed Recognition
34. ICML 2024Linguistic Calibration of Long-Form Generations
35. ICML 2024LLM Maybe LongLM: SelfExtend LLM Context Window Without Tuning
36. ICML 2024LoCoCo: Dropping In Convolutions for Long Context Compression
37. ICML 2024Long Range Propagation on Continuous-Time Dynamic Graphs
38. ICML 2024Long-Tail Learning with Foundation Model: Heavy Fine-Tuning Hurts
39. ICML 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
40. ICML 2024Loss Shaping Constraints for Long-Term Time Series Forecasting
41. ICML 2024Memory Consolidation Enables Long-Context Video Understanding
42. ICML 2024Meta-Reinforcement Learning Robust to Distributional Shift Via Performing Lifelong In-Context Learning
43. ICML 2024PICLe: Eliciting Diverse Behaviors from Large Language Models with Persona In-Context Learning
44. ICML 2024PolySketchFormer: Fast Transformers via Sketching Polynomial Kernels
45. ICML 2024Position: Cracking the Code of Cascading Disparity Towards Marginalized Communities
46. ICML 2024Position: Do pretrained Transformers Learn In-Context by Gradient Descent?
47. ICML 2024Position: Key Claims in LLM Research Have a Long Tail of Footnotes
48. ICML 2024QUEST: Query-Aware Sparsity for Efficient Long-Context LLM Inference
49. ICML 2024Rethinking Adversarial Robustness in the Context of the Right to be Forgotten
50. ICML 2024Short-Long Convolutions Help Hardware-Efficient Linear Attention to Focus on Long Sequences

常见问题

2023–2026 年四大会议一共有多少篇长上下文论文？

共 838 篇，按年份分别是 2023 年 66 篇、2024 年 176 篇、2025 年 255 篇、2026 年 341 篇。

NeurIPS 2026 有多少篇长上下文论文？

NeurIPS 2026 有 130 篇长上下文论文，上一届是 98 篇。

ICLR 2026 有多少篇长上下文论文？

ICLR 2026 有 82 篇长上下文论文，上一届是 87 篇。

ICML 2026 有多少篇长上下文论文？

ICML 2026 有 98 篇长上下文论文，上一届是 53 篇。

CVPR 2026 有多少篇长上下文论文？

CVPR 2026 有 31 篇长上下文论文，上一届是 17 篇。

哪个会议的长上下文论文最多？

NeurIPS，2023–2026 年共 298 篇。