长上下文论文趋势 2023–2026
长窗口建模
统计范围:NeurIPS、ICLR、ICML、CVPR 四个会议,2023–2026 年,共 838 篇被归入该主题的论文。
主要结论
- 长上下文论文从 2023 年的 66 篇增长到 2026 年的 341 篇,三年间扩大到约 5.2 倍。
- NeurIPS 是发长上下文论文最多的会议,2023–2026 年共 298 篇,占四个会议总量的 36%。
- 交叉方向里涨得最快的是AI 智能体:同时属于两个主题的论文从 2023 年的 0 篇增至 2026 年的 45 篇。
- 在「长上下文与记忆」的 5 个主题里,它的 2026 年论文数排第 1;同组增长最快的检索记忆是 6.6 倍,长上下文是 5.2 倍。
各会议论文数
按年份和会议统计
| 年份 | NeurIPS | ICLR | ICML | CVPR | 合计 |
|---|---|---|---|---|---|
| 2023 | 18 | 18 | 15 | 15 | 66 |
| 2024 | 52 | 43 | 60 | 21 | 176 |
| 2025 | 98 | 87 | 53 | 17 | 255 |
| 2026 | 130 | 82 | 98 | 31 | 341 |
代表论文
按年份和会议均匀挑选,方便快速看到每一届的样貌
- NeurIPS 2026Accelerating Long-Context LLM Prefill via Layer-wise Progressive Token Pruning in Local Deployment
- ICML 2026AdaSplash-2: Faster Differentiable Sparse Attention
- ICLR 2026An evolutionary perspective on modes of learning in Transformers
- CVPR 2026AR2-4FV Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View
- NeurIPS 2025A Controllable Examination for Long-Context Language Models
- ICML 2025CateKV: On Sequential Consistency for Long-Context LLM Inference Acceleration
- ICLR 2025$\text{D}_{2}\text{O}$: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models
- CVPR 2025BIMBA: Selective-Scan Compression for Long-Range Video Question Answering
- NeurIPS 2024[Re] CUDA: Curriculum of Data Augmentation for Long‐tailed Recognition
- ICML 2024Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT
- ICLR 2024CLEX: Continuous Length Extrapolation for Large Language Models
- CVPR 2024GigaTraj: Predicting Long-term Trajectories of Hundreds of Pedestrians in Gigapixel Complex Scenes
- NeurIPS 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation
- ICML 2023CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling
- ICLR 2023$k$NN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference
- CVPR 2023AutoAD: Movie Description in Context
- NeurIPS 2026AdaCal: Adaptive Calibration for Robust Sparse Attention in Long-Context LLMs
- ICML 2026Artificial Hippocampus Networks for Efficient Long-Context Modeling
- ICLR 2026AutoSP: Unlocking Long-Context LLM Training Via Compiler-Based Sequence Parallelism
- CVPR 2026AstraNav-Memory Contexts Compression for Long Memory
全部长上下文论文
共 52 篇,第 1 / 2 页
- NeurIPS 2024[Re] CUDA: Curriculum of Data Augmentation for Long‐tailed Recognition
- NeurIPS 2024An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding
- NeurIPS 2024AUCSeg: AUC-oriented Pixel-level Long-tail Semantic Segmentation
- NeurIPS 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack
- NeurIPS 2024Balancing Context Length and Mixing Times for Reinforcement Learning at Scale
- NeurIPS 2024Base of RoPE Bounds Context Length
- NeurIPS 2024BERTs are Generative In-Context Learners
- NeurIPS 2024DAPE: Data-Adaptive Positional Encoding for Length Extrapolation
- NeurIPS 2024Dataset Decomposition: Faster LLM Training with Variable Sequence Length Curriculum
- NeurIPS 2024Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modeling
- NeurIPS 2024Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Data
- NeurIPS 2024Efficient Recurrent Off-Policy RL Requires a Context-Encoder-Specific Learning Rate
- NeurIPS 2024Enhancing In-Context Learning Performance with just SVD-Based Weight Pruning: A Theoretical Perspective
- NeurIPS 2024Exploring Context Window of Large Language Models via Decomposed Positional Vectors
- NeurIPS 2024Flexible Context-Driven Sensory Processing in Dynamical Vision Models
- NeurIPS 2024Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
- NeurIPS 2024Grammar-Aligned Decoding
- NeurIPS 2024In-Context Learning with Transformers: Softmax Attention Adapts to Function Lipschitzness
- NeurIPS 2024InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
- NeurIPS 2024KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
- NeurIPS 2024Learning Partitions from Context
- NeurIPS 2024Lever LM: Configuring In-Context Sequence to Lever Large Vision Language Models
- NeurIPS 2024Linear Transformers are Versatile In-Context Learners
- NeurIPS 2024Long-range Brain Graph Transformer
- NeurIPS 2024Long-Range Feedback Spiking Network Captures Dynamic and Static Representations of the Visual Cortex under Movie Stimuli
- NeurIPS 2024Long-tailed Object Detection Pretraining: Dynamic Rebalancing Contrastive Learning with Dual Reconstruction
- NeurIPS 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding
- NeurIPS 2024Make Your LLM Fully Utilize the Context
- NeurIPS 2024MambaLRP: Explaining Selective State Space Sequence Models
- NeurIPS 2024Many-Shot In-Context Learning
- NeurIPS 2024Many-shot Jailbreaking
- NeurIPS 2024Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
- NeurIPS 2024MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention
- NeurIPS 2024Mini-Sequence Transformers: Optimizing Intermediate Memory for Long Sequences Training
- NeurIPS 2024Mixture of In-Context Experts Enhance LLMs' Long Context Awareness
- NeurIPS 2024MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
- NeurIPS 2024Needle In A Multimodal Haystack
- NeurIPS 2024Neural P$^3$M: A Long-Range Interaction Modeling Enhancer for Geometric GNNs
- NeurIPS 2024One-Layer Transformer Provably Learns One-Nearest Neighbor In Context
- NeurIPS 2024Opponent Modeling with In-context Search
- NeurIPS 2024Pretrained Transformer Efficiently Learns Low-Dimensional Target Functions In-Context
- NeurIPS 2024Probing the Decision Boundaries of In-context Learning in Large Language Models
- NeurIPS 2024Reparameterized Multi-Resolution Convolutions for Long Sequence Modelling
- NeurIPS 2024Robust Sleep Staging over Incomplete Multimodal Physiological Signals via Contrastive Imagination
- NeurIPS 2024Selective Attention: Enhancing Transformer through Principled Context Control
- NeurIPS 2024StreamingDialogue: Prolonged Dialogue Learning via Long Context Compression with Minimal Losses
- NeurIPS 2024Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack
- NeurIPS 2024The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains
- NeurIPS 2024The GAN is dead; long live the GAN! A Modern GAN Baseline
- NeurIPS 2024Transformers are Minimax Optimal Nonparametric In-Context Learners
在 Claude、Cursor 里直接问这个趋势
接上 Paperlist MCP 后,写综述、挑方向或准备投稿时,不用离开对话框就能拿到这页的数字:每年各会议的论文数、增长倍数、涨得最快的子方向和代表论文,AI 会按你的问题整理。
可以直接复制这句话问 AI
用 paperlist 查长上下文在 NeurIPS 2023–2026 的论文趋势,哪一年涨得最快?
AI 会调用的工具:get_topic_stats {"topic": "long-context"}
常见问题
- 2023–2026 年四大会议一共有多少篇长上下文论文?
- 共 838 篇,按年份分别是 2023 年 66 篇、2024 年 176 篇、2025 年 255 篇、2026 年 341 篇。
- NeurIPS 2026 有多少篇长上下文论文?
- NeurIPS 2026 有 130 篇长上下文论文,上一届是 98 篇。
- ICLR 2026 有多少篇长上下文论文?
- ICLR 2026 有 82 篇长上下文论文,上一届是 87 篇。
- ICML 2026 有多少篇长上下文论文?
- ICML 2026 有 98 篇长上下文论文,上一届是 53 篇。
- CVPR 2026 有多少篇长上下文论文?
- CVPR 2026 有 31 篇长上下文论文,上一届是 17 篇。
- 哪个会议的长上下文论文最多?
- NeurIPS,2023–2026 年共 298 篇。