Context Compression papers, 2023–2026

Key findings

• Context Compression went from 39 papers in 2023 to 136 in 2026, roughly 3.5x in three years.
• NeurIPS publishes the most Context Compression work: 123 papers from 2023 to 2026, 34% of the four-venue total.
• The fastest-growing overlap is with Deep learning · large language models: papers tagged with both rose from 1 in 2023 to 13 in 2026.
• Among the 5 topics under Long Context and Memory, it ranks #4 by 2026 paper count; the fastest grower in the group, Retrieval Memory, is up 6.6x versus 3.5x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026A Free Lunch in LLM Compression: Revisiting Retraining after Pruning
• ICML 2026A Unified Sparse Attention via Multi-Granularity Compression
• ICLR 2026An evolutionary perspective on modes of learning in Transformers
• CVPR 2026AstraNav-Memory Contexts Compression for Long Memory
• NeurIPS 2025AdmTree: Compressing Lengthy Context with Adaptive Semantic Trees
• ICML 2025Does learning the right latent variables necessarily improve in-context learning?
• ICLR 2025Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
• CVPR 2025ECVC: Exploiting Non-Local Correlations in Multiple Frames for Contextual Video Compression
• NeurIPS 2024StreamingDialogue: Prolonged Dialogue Learning via Long Context Compression with Minimal Losses
• ICML 2024Agnostic Sample Compression Schemes for Regression
• ICLR 2024Compressed Context Memory for Online Language Model Interaction
• CVPR 2024Diversity-aware Channel Pruning for StyleGAN Compression
• NeurIPS 2023Do Not Marginalize Mechanisms, Rather Consolidate!
• ICML 2023Private Federated Learning with Autotuned Compression
• ICLR 2023$k$NN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference
• CVPR 2023AutoAD: Movie Description in Context
• NeurIPS 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compression
• ICML 2026Context-Driven Incremental Compression for Multi-Turn Dialogue Generation
• ICLR 2026Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchors
• CVPR 2026Featurising Pixels from Dynamic 3D Scenes with Linear In-Context Learners

All Context Compression papers

39 papers, page 1 of 1

1. CVPR 2023AutoAD: Movie Description in Context
2. CVPR 2023Class-Incremental Exemplar Compression for Class-Incremental Learning
3. CVPR 2023Context De-Confounded Emotion Recognition
4. CVPR 2023Context-Based Trit-Plane Coding for Progressive Image Compression
5. CVPR 2023Discriminator-Cooperated Feature Map Distillation for GAN Compression
6. CVPR 2023Efficient Hierarchical Entropy Model for Learned Point Cloud Compression
7. CVPR 2023Learned Image Compression With Mixed Transformer-CNN Architectures
8. CVPR 2023Leveraging Temporal Context in Low Representational Power Regimes
9. CVPR 2023Motion Information Propagation for Neural Video Compression
10. CVPR 2023Neural Video Compression With Diverse Contexts
11. CVPR 2023TINC: Tree-Structured Implicit Neural Compression
12. CVPR 2023Ultra-High Resolution Segmentation With Ultra-Rich Context: A Novel Benchmark
13. CVPR 2023Video Compression With Entropy-Constrained Neural Representations
14. ICLR 2023$k$NN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inference
15. ICLR 2023A Unified Framework for Soft Threshold Pruning
16. ICLR 2023Accurate Neural Training with 4-bit Matrix Multiplications at Standard Formats
17. ICLR 2023Artificial Neuronal Ensembles with Learned Context Dependent Gating
18. ICLR 2023CrAM: A Compression-Aware Minimizer
19. ICLR 2023DFPC: Data flow driven pruning of coupled channels without data.
20. ICLR 2023Generate rather than Retrieve: Large Language Models are Strong Context Generators
21. ICLR 2023How Informative is the Approximation Error from Tensor Decomposition for Neural Network Compression?
22. ICLR 2023MIMT: Masked Image Modeling Transformer for Video Compression
23. ICLR 2023Pruning Deep Neural Networks from a Sparsity Perspective
24. ICLR 2023RLx2: Training a Sparse Deep Reinforcement Learning Model from Scratch
25. ICLR 2023TVSPrune - Pruning Non-discriminative filters via Total Variation separability of intermediate representations without fine tuning
26. ICLR 2023What learning algorithm is in-context learning? Investigations with linear models
27. ICML 2023Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming
28. ICML 2023Hardware-Aware Compression with Random Operation Access Specific Tile (ROAST) Hashing
29. ICML 2023Modality-Agnostic Variational Compression of Implicit Neural Representations
30. ICML 2023Private Federated Learning with Autotuned Compression
31. ICML 2023Transformers Learn In-Context by Gradient Descent
32. NeurIPS 20232Direction: Theoretically Faster Distributed Training with Bidirectional Communication Compression
33. NeurIPS 2023Do Not Marginalize Mechanisms, Rather Consolidate!
34. NeurIPS 2023Idempotent Learned Image Compression with Right-Inverse
35. NeurIPS 2023Meta-in-context learning in large language models
36. NeurIPS 2023Private Distribution Learning with Public Data: The View from Sample Compression
37. NeurIPS 2023PRODIGY: Enabling In-context Learning Over Graphs
38. NeurIPS 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time
39. NeurIPS 2023Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selection

FAQ

How many Context Compression papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

365 in total: 39 in 2023, 81 in 2024, 109 in 2025, 136 in 2026.

How many Context Compression papers are at NeurIPS 2026?

NeurIPS 2026 has 50 Context Compression papers, versus 38 the year before.

How many Context Compression papers are at ICLR 2026?

ICLR 2026 has 28 Context Compression papers, versus 32 the year before.

How many Context Compression papers are at ICML 2026?

ICML 2026 has 39 Context Compression papers, versus 20 the year before.

How many Context Compression papers are at CVPR 2026?

CVPR 2026 has 19 Context Compression papers, versus 19 the year before.

Which conference publishes the most Context Compression papers?

NeurIPS, with 123 papers from 2023 to 2026.