长上下文论文趋势 2023–2026
长窗口建模
统计范围:NeurIPS、ICLR、ICML、CVPR 四个会议,2023–2026 年,共 838 篇被归入该主题的论文。
主要结论
- 长上下文论文从 2023 年的 66 篇增长到 2026 年的 341 篇,三年间扩大到约 5.2 倍。
- NeurIPS 是发长上下文论文最多的会议,2023–2026 年共 298 篇,占四个会议总量的 36%。
- 交叉方向里涨得最快的是AI 智能体:同时属于两个主题的论文从 2023 年的 0 篇增至 2026 年的 45 篇。
- 在「长上下文与记忆」的 5 个主题里,它的 2026 年论文数排第 1;同组增长最快的检索记忆是 6.6 倍,长上下文是 5.2 倍。
各会议论文数
按年份和会议统计
| 年份 | NeurIPS | ICLR | ICML | CVPR | 合计 |
|---|---|---|---|---|---|
| 2023 | 18 | 18 | 15 | 15 | 66 |
| 2024 | 52 | 43 | 60 | 21 | 176 |
| 2025 | 98 | 87 | 53 | 17 | 255 |
| 2026 | 130 | 82 | 98 | 31 | 341 |
代表论文
按年份和会议均匀挑选,方便快速看到每一届的样貌
- NeurIPS 2026Accelerating Long-Context LLM Prefill via Layer-wise Progressive Token Pruning in Local Deployment
- ICML 2026AdaSplash-2: Faster Differentiable Sparse Attention
- ICLR 2026An evolutionary perspective on modes of learning in Transformers
- CVPR 2026AR2-4FV Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View
- NeurIPS 2025A Controllable Examination for Long-Context Language Models
- ICML 2025CateKV: On Sequential Consistency for Long-Context LLM Inference Acceleration
- ICLR 2025$\text{D}_{2}\text{O}$: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models
- CVPR 2025BIMBA: Selective-Scan Compression for Long-Range Video Question Answering
- NeurIPS 2024[Re] CUDA: Curriculum of Data Augmentation for Long‐tailed Recognition
- ICML 2024Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT
- ICLR 2024CLEX: Continuous Length Extrapolation for Large Language Models
- CVPR 2024GigaTraj: Predicting Long-term Trajectories of Hundreds of Pedestrians in Gigapixel Complex Scenes
- NeurIPS 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation
- ICML 2023CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling
- ICLR 2023$k$NN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference
- CVPR 2023AutoAD: Movie Description in Context
- NeurIPS 2026AdaCal: Adaptive Calibration for Robust Sparse Attention in Long-Context LLMs
- ICML 2026Artificial Hippocampus Networks for Efficient Long-Context Modeling
- ICLR 2026AutoSP: Unlocking Long-Context LLM Training Via Compiler-Based Sequence Parallelism
- CVPR 2026AstraNav-Memory Contexts Compression for Long Memory
全部长上下文论文
共 230 篇,第 4 / 5 页
- ICLR 2025Scaling Long Context Training Data by Long-Distance Referrals
- ICLR 2025SCBench: A KV Cache-Centric Analysis of Long-Context Methods
- ICLR 2025Scrutinize What We Ignore: Reining In Task Representation Shift Of Context-Based Offline Meta Reinforcement Learning
- ICLR 2025Self-Updatable Large Language Models by Integrating Context into Model Parameters
- ICLR 2025TimeKAN: KAN-based Frequency Decomposition Learning Architecture for Long-term Time Series Forecasting
- ICLR 2025Timer-XL: Long-Context Transformers for Unified Time Series Forecasting
- ICLR 2025Towards Learning High-Precision Least Squares Algorithms with Sequence Models
- ICLR 2025Training Free Exponential Context Extension via Cascading KV Cache
- ICLR 2025Transformers are Universal In-context Learners
- ICLR 2025Transformers Handle Endogeneity in In-Context Linear Regression
- ICLR 2025Understanding and Mitigating Bottlenecks of State Space Models through the Lens of Recency and Over-smoothing
- ICLR 2025Unsupervised Meta-Learning via In-Context Learning
- ICLR 2025Vector-ICL: In-context Learning with Continuous Vector Representations
- ICLR 2025VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning
- ICLR 2025Wavelet-based Positional Representation for Long Context
- ICLR 2025What is Wrong with Perplexity for Long-context Language Modeling?
- ICLR 2025Why Does the Effective Context Length of LLMs Fall Short?
- ICLR 2025Why In-Context Learning Models are Good Few-Shot Learners?
- ICLR 2025ZETA: Leveraging $Z$-order Curves for Efficient Top-$k$ Attention
- ICLR 2024A Benchmark for Learning to Translate a New Language from One Grammar Book
- ICLR 2024AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agents
- ICLR 2024AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?
- ICLR 2024BooookScore: A systematic exploration of book-length summarization in the era of LLMs
- ICLR 2024CausalLM is not optimal for in-context learning
- ICLR 2024CLEX: Continuous Length Extrapolation for Large Language Models
- ICLR 2024Compressed Context Memory for Online Language Model Interaction
- ICLR 2024Context is Environment
- ICLR 2024Context-Aware Meta-Learning
- ICLR 2024Equivariant Matrix Function Neural Networks
- ICLR 2024FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data
- ICLR 2024FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
- ICLR 2024Function Vectors in Large Language Models
- ICLR 2024Functional Interpolation for Relative Positions improves Long Context Transformers
- ICLR 2024Hierarchical Context Merging: Better Long Context Understanding for Pre-trained LLMs
- ICLR 2024How do Language Models Bind Entities in Context?
- ICLR 2024HyperAttention: Long-context Attention in Near-Linear Time
- ICLR 2024IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs
- ICLR 2024IDEAL: Influence-Driven Selective Annotations Empower In-Context Learners in Large Language Models
- ICLR 2024In-context Autoencoder for Context Compression in a Large Language Model
- ICLR 2024In-Context Learning Learns Label Relationships but Is Not Conventional Learning
- ICLR 2024In-Context Learning through the Bayesian Prism
- ICLR 2024In-Context Pretraining: Language Modeling Beyond Document Boundaries
- ICLR 2024Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability
- ICLR 2024Kill Two Birds with One Stone: Rethinking Data Augmentation for Deep Long-tailed Learning
- ICLR 2024Language Modeling Is Compression
- ICLR 2024Long-tailed Diffusion Models with Oriented Calibration
- ICLR 2024LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
- ICLR 2024Looped Transformers are Better at Learning Learning Algorithms
- ICLR 2024MEND: Meta Demonstration Distillation for Efficient and Effective In-Context Learning
- ICLR 2024Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors
在 Claude、Cursor 里直接问这个趋势
接上 Paperlist MCP 后,写综述、挑方向或准备投稿时,不用离开对话框就能拿到这页的数字:每年各会议的论文数、增长倍数、涨得最快的子方向和代表论文,AI 会按你的问题整理。
可以直接复制这句话问 AI
用 paperlist 查长上下文在 NeurIPS 2023–2026 的论文趋势,哪一年涨得最快?
AI 会调用的工具:get_topic_stats {"topic": "long-context"}
常见问题
- 2023–2026 年四大会议一共有多少篇长上下文论文?
- 共 838 篇,按年份分别是 2023 年 66 篇、2024 年 176 篇、2025 年 255 篇、2026 年 341 篇。
- NeurIPS 2026 有多少篇长上下文论文?
- NeurIPS 2026 有 130 篇长上下文论文,上一届是 98 篇。
- ICLR 2026 有多少篇长上下文论文?
- ICLR 2026 有 82 篇长上下文论文,上一届是 87 篇。
- ICML 2026 有多少篇长上下文论文?
- ICML 2026 有 98 篇长上下文论文,上一届是 53 篇。
- CVPR 2026 有多少篇长上下文论文?
- CVPR 2026 有 31 篇长上下文论文,上一届是 17 篇。
- 哪个会议的长上下文论文最多?
- NeurIPS,2023–2026 年共 298 篇。