上下文压缩论文趋势 2023–2026

主要结论

• 上下文压缩论文从 2023 年的 39 篇增长到 2026 年的 136 篇，三年间扩大到约 3.5 倍。
• NeurIPS 是发上下文压缩论文最多的会议，2023–2026 年共 123 篇，占四个会议总量的 34%。
• 交叉方向里涨得最快的是深度学习 · large language models：同时属于两个主题的论文从 2023 年的 1 篇增至 2026 年的 13 篇。
• 在「长上下文与记忆」的 5 个主题里，它的 2026 年论文数排第 4；同组增长最快的检索记忆是 6.6 倍，上下文压缩是 3.5 倍。

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

• NeurIPS 2026A Free Lunch in LLM Compression: Revisiting Retraining after Pruning
• ICML 2026A Unified Sparse Attention via Multi-Granularity Compression
• ICLR 2026An evolutionary perspective on modes of learning in Transformers
• CVPR 2026AstraNav-Memory Contexts Compression for Long Memory
• NeurIPS 2025AdmTree: Compressing Lengthy Context with Adaptive Semantic Trees
• ICML 2025Does learning the right latent variables necessarily improve in-context learning?
• ICLR 2025Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
• CVPR 2025ECVC: Exploiting Non-Local Correlations in Multiple Frames for Contextual Video Compression
• NeurIPS 2024StreamingDialogue: Prolonged Dialogue Learning via Long Context Compression with Minimal Losses
• ICML 2024Agnostic Sample Compression Schemes for Regression
• ICLR 2024Compressed Context Memory for Online Language Model Interaction
• CVPR 2024Diversity-aware Channel Pruning for StyleGAN Compression
• NeurIPS 2023Do Not Marginalize Mechanisms, Rather Consolidate!
• ICML 2023Private Federated Learning with Autotuned Compression
• ICLR 2023$k$NN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference
• CVPR 2023AutoAD: Movie Description in Context
• NeurIPS 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compression
• ICML 2026Context-Driven Incremental Compression for Multi-Turn Dialogue Generation
• ICLR 2026Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchors
• CVPR 2026Featurising Pixels from Dynamic 3D Scenes with Linear In-Context Learners

全部上下文压缩论文

共 109 篇，第 1 / 3 页

1. CVPR 2025CASP: Compression of Large Multimodal Models Based on Attention Sparsity
2. CVPR 2025ECVC: Exploiting Non-Local Correlations in Multiple Frames for Contextual Video Compression
3. CVPR 2025Embracing Collaboration Over Competition: Condensing Multiple Prompts for Visual In-Context Learning
4. CVPR 2025Fitted Neural Lossless Image Compression
5. CVPR 2025FLAVC: Learned Video Compression with Feature Level Attention
6. CVPR 2025GA3CE: Unconstrained 3D Gaze Estimation with Gaze-Aware 3D Context Encoding
7. CVPR 2025Learned Image Compression with Dictionary-based Entropy Model
8. CVPR 2025Linear Attention Modeling for Learned Image Compression
9. CVPR 2025Lost in Translation, Found in Context: Sign Language Translation with Contextual Cues
10. CVPR 2025MambaIC: State Space Models for High-Performance Learned Image Compression
11. CVPR 2025Neural Video Compression with Context Modulation
12. CVPR 2025Neuron: Learning Context-Aware Evolving Representations for Zero-Shot Skeleton Action Recognition
13. CVPR 2025OverLoCK: An Overview-first-Look-Closely-next ConvNet with Context-Mixing Dynamic Kernels
14. CVPR 2025Perceptual Video Compression with Neural Wrapping
15. CVPR 2025Random Conditioning for Diffusion Model Compression with Distillation
16. CVPR 2025Random Conditioning with Distillation for Data-Efficient Diffusion Model Compression
17. CVPR 2025Temporal Action Detection Model Compression by Progressive Block Drop
18. CVPR 2025TopNet: Transformer-Efficient Occupancy Prediction Network for Octree-Structured Point Cloud Geometry Compression
19. CVPR 2025VoCo-LLaMA: Towards Vision Compression with Large Language Models
20. ICLR 2025Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
21. ICLR 2025BenTo: Benchmark Reduction with In-Context Transferability
22. ICLR 2025BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments
23. ICLR 2025Can In-context Learning Really Generalize to Out-of-distribution Tasks?
24. ICLR 2025CAT-3DGS: A Context-Adaptive Triplane Approach to Rate-Distortion-Optimized 3DGS Compression
25. ICLR 2025Context-Parametric Inversion: Why Instruction Finetuning May Not Actually Improve Context Reliance
26. ICLR 2025DiffPC: Diffusion-based High Perceptual Fidelity Image Compression with Semantic Refinement
27. ICLR 2025ICLR: In-Context Learning of Representations
28. ICLR 2025Implicit In-context Learning
29. ICLR 2025Improving the Sparse Structure Learning of Spiking Neural Networks from the View of Compression Efficiency
30. ICLR 2025Learning Randomized Algorithms with Transformers
31. ICLR 2025Long Context Compression with Activation Beacon
32. ICLR 2025Lossy Compression with Pretrained Diffusion Models
33. ICLR 2025MambaExtend: A Training-Free Approach to Improve Long Context Extension of Mamba
34. ICLR 2025MCNC: Manifold-Constrained Reparameterization for Neural Compression
35. ICLR 2025MELODI: Exploring Memory Compression for Long Contexts
36. ICLR 2025Metalic: Meta-Learning In-Context with Protein Language Models
37. ICLR 2025MoDeGPT: Modular Decomposition for Large Language Model Compression
38. ICLR 2025On the Learn-to-Optimize Capabilities of Transformers in In-Context Sparse Recovery
39. ICLR 2025Palu: KV-Cache Compression with Low-Rank Projection
40. ICLR 2025PICASO: Permutation-Invariant Context Composition with State Space Models
41. ICLR 2025RazorAttention: Efficient KV Cache Compression Through Retrieval Heads
42. ICLR 2025ReAttention: Training-Free Infinite Context with Finite Attention Scope
43. ICLR 2025Rethinking Invariance in In-context Learning
44. ICLR 2025Streamlining Redundant Layers to Compress Large Language Models
45. ICLR 2025ThinK: Thinner Key Cache by Query-Driven Pruning
46. ICLR 2025Training Free Exponential Context Extension via Cascading KV Cache
47. ICLR 2025Transformers are Universal In-context Learners
48. ICLR 2025Unsupervised Meta-Learning via In-Context Learning
49. ICLR 2025Why Does the Effective Context Length of LLMs Fall Short?
50. ICLR 2025Why In-Context Learning Models are Good Few-Shot Learners?

常见问题

2023–2026 年四大会议一共有多少篇上下文压缩论文？

共 365 篇，按年份分别是 2023 年 39 篇、2024 年 81 篇、2025 年 109 篇、2026 年 136 篇。

NeurIPS 2026 有多少篇上下文压缩论文？

NeurIPS 2026 有 50 篇上下文压缩论文，上一届是 38 篇。

ICLR 2026 有多少篇上下文压缩论文？

ICLR 2026 有 28 篇上下文压缩论文，上一届是 32 篇。

ICML 2026 有多少篇上下文压缩论文？

ICML 2026 有 39 篇上下文压缩论文，上一届是 20 篇。

CVPR 2026 有多少篇上下文压缩论文？

CVPR 2026 有 19 篇上下文压缩论文，上一届是 19 篇。

哪个会议的上下文压缩论文最多？

NeurIPS，2023–2026 年共 123 篇。