Sparsity Acceleration papers, 2023–2026

Key findings

• Sparsity Acceleration went from 54 papers in 2023 to 89 in 2026, roughly 1.6x in three years.
• NeurIPS publishes the most Sparsity Acceleration work: 80 papers from 2023 to 2026, 31% of the four-venue total.
• The fastest-growing overlap is with Multimodal LLMs: papers tagged with both rose from 0 in 2023 to 13 in 2026.
• Among the 5 topics under Hardware and Compilers, it ranks #1 by 2026 paper count; the fastest grower in the group, Edge Inference, is up 4.0x versus 1.6x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AC/DC on a Budget -- Alternating Sparse Phases
• ICML 2026An Evidential Route to Asymptotic Bayes Optimality under Sparsity
• ICLR 2026Hilbert-Guided Sparse Local Attention
• CVPR 2026Improving Sparse Autoencoder with Dynamic Attention
• NeurIPS 2025Bilevel Network Learning via Hierarchically Structured Sparsity
• ICML 2025COGNATE: Acceleration of Sparse Tensor Programs on Emerging Hardware using Transfer Learning
• ICLR 2025Beyond Worst-Case Dimensionality Reduction for Sparse Vectors
• CVPR 2025ICP: Immediate Compensation Pruning for Mid-to-high Sparsity
• NeurIPS 2024ELSA: Exploiting Layer-wise N:M Sparsity for Vision Transformer Acceleration
• ICML 2024Accelerating Transformer Pre-training with 2:4 Sparsity
• ICLR 2024Adaptive Sharpness-Aware Pruning for Robust Sparse Networks
• CVPR 2024Masked Spatial Propagation Network for Sparsity-Adaptive Depth Refinement
• NeurIPS 2023Dynamic Sparsity Is Channel-Level Sparsity Learner
• ICML 2023Conformalization of Sparse Generalized Linear Models
• ICLR 2023Bit-Pruning: A Sparse Multiplication-Less Dot-Product
• CVPR 2023Adaptive Channel Sparsity for Federated Learning Under System Heterogeneity
• NeurIPS 2026Beyond Masked Sparsity: SNACK Enables Truly Sparse Neural Networks on GPU
• ICML 2026FlashSketch: Sketch-Kernel Co-Design for Fast Sparse Sketching on GPUs
• ICLR 2026Identifiability Challenges in Sparse Linear Ordinary Differential Equations
• CVPR 2026Revisiting Pose Sensitivity in Splat-based Computed Tomography under Sparse-view Reconstruction

All Sparsity Acceleration papers

80 papers, page 1 of 2

1. NeurIPS 2026AC/DC on a Budget -- Alternating Sparse Phases
2. NeurIPS 2026Asymmetric Scaling Laws from Sparse Features
3. NeurIPS 2026Attribute-Efficient Learning of Sparse Halfspaces with Constant Malicious Noise Rate
4. NeurIPS 2026Beyond Masked Sparsity: SNACK Enables Truly Sparse Neural Networks on GPU
5. NeurIPS 2026Cannistraci-Hebb Channel-wise Dynamic Sparse Training of Convolutional Neural Networks with Contextual Modulation
6. NeurIPS 2026Coarse-to-Fine 3D MRI Reconstruction via Resolution-Agnostic Neural Operators
7. NeurIPS 2026Colour me shocked: Exact Molecular Hessians from MLIPs in O(N) time using sparse differentiation!
8. NeurIPS 2026Contribution-Aware Structured Sparsity for Model Merging
9. NeurIPS 2026Direct Acceleration of Stochastic Root-Finding Without Variance Reduction and Regularization
10. NeurIPS 2026Distribution Free Fourier Sparsity Testing
11. NeurIPS 2026Effectiveness of Curriculum Learning Depends on Reward Sparsity and Competing Optima
12. NeurIPS 2026Efficient Fine-Tuning for Structured Sparsity Under Group Repartitioning
13. NeurIPS 2026Flow Matching from Viewpoint of Proximal Operators
14. NeurIPS 2026Inference-time Alignment via Sparse Junction Steering
15. NeurIPS 2026Intrinsically Interpretable Attention via Sparse Post-Training
16. NeurIPS 2026Inverting Retargeting: Humanoid Datasets Remember Their Operators
17. NeurIPS 2026Learning Event-to-Field Operators Without Interpolation
18. NeurIPS 2026Long-Context Language Models Require Extreme Sparsity in Context Dimension
19. NeurIPS 2026On the Sparsity of Direct Preference Optimization: Weight Disentanglement in the NTK Regime
20. NeurIPS 2026On the Sparsity-Storage-Accuracy Tradeoff in Parsimoniously Activated Dictionary Learning
21. NeurIPS 2026OneVision-Encoder: Codec-Aligned Sparsity as a Foundational Principle for Multimodal Intelligence
22. NeurIPS 2026Perfect Parallelization in Mini-Batch SGD with Classical Momentum Acceleration
23. NeurIPS 2026Posterior Contraction Rates for sparse Kolmogorov-Arnold Networks in Anisotropic Besov Spaces
24. NeurIPS 2026Sparse blind deconvolution via thresholded Wirtinger flow
25. NeurIPS 2026Sparse Delta Memory: Scaling the State of Linear RNNs through Sparsity
26. NeurIPS 2026Sparse Sum-of-Squares Layers for Certified Learning
27. NeurIPS 2026SVDP: Training-Free Contextual Sparsity Predictors for Fast LLM Inference
28. NeurIPS 2026The Sparsity Whisperer
29. NeurIPS 2026Transferable SCF-Acceleration through Solver-Aligned Initialization Learning
30. NeurIPS 2025Bilevel Network Learning via Hierarchically Structured Sparsity
31. NeurIPS 2025Bivariate Matrix-valued Linear Regression (BMLR): Finite-sample performance under Identifiability and Sparsity Assumptions
32. NeurIPS 2025CAS-Spec: Cascade Adaptive Self-Speculative Decoding for On-the-Fly Lossless Inference Acceleration of LLMs
33. NeurIPS 2025Differentiable Sparsity via $D$-Gating: Simple and Versatile Structured Penalization
34. NeurIPS 2025DuoGPT: Training-free Dual Sparsity through Activation-aware Pruning in LLMs
35. NeurIPS 2025Exploiting Dynamic Sparsity in Einsum
36. NeurIPS 2025Global Minimizers of $\ell^p$-Regularized Objectives Yield the Sparsest ReLU Neural Networks
37. NeurIPS 2025Masked Gated Linear Unit
38. NeurIPS 2025MoESD: Unveil Speculative Decoding's Potential for Accelerating Sparse MoE
39. NeurIPS 2025MUSTAFAR: Promoting Unstructured Sparsity for KV Cache Pruning in LLM Inference
40. NeurIPS 2025PermLLM: Learnable Channel Permutation for N:M Sparse Large Language Models
41. NeurIPS 2025Polar Sparsity: High Throughput Batched LLM Inferencing with Scalable Contextual Sparsity
42. NeurIPS 2025Price of Parsimony: Complexity of Fourier Sparsity Testing
43. NeurIPS 2025Sign-In to the Lottery: Reparameterizing Sparse Training
44. NeurIPS 2025Spark Transformer: Reactivating Sparsity in Transformer FFN and Attention
45. NeurIPS 2025Stochastic Shortest Path with Sparse Adversarial Costs
46. NeurIPS 2025The Price of Sparsity: Sufficient Conditions for Sparse Recovery using Sparse and Sparsified Measurements
47. NeurIPS 2025TSENOR: Highly-Efficient Algorithm for Finding Transposable N:M Sparse Masks
48. NeurIPS 2025Twilight: Adaptive Attention Sparsity with Hierarchical Top-$p$ Pruning
49. NeurIPS 2025Týr-the-Pruner: Structural Pruning LLMs via Global Sparsity Distribution Optimization
50. NeurIPS 2025You Only Spectralize Once: Taking a Spectral Detour to Accelerate Graph Neural Network

FAQ

How many Sparsity Acceleration papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

260 in total: 54 in 2023, 53 in 2024, 64 in 2025, 89 in 2026.

How many Sparsity Acceleration papers are at NeurIPS 2026?

NeurIPS 2026 has 29 Sparsity Acceleration papers, versus 21 the year before.

How many Sparsity Acceleration papers are at ICLR 2026?

ICLR 2026 has 24 Sparsity Acceleration papers, versus 16 the year before.

How many Sparsity Acceleration papers are at ICML 2026?

ICML 2026 has 24 Sparsity Acceleration papers, versus 22 the year before.

How many Sparsity Acceleration papers are at CVPR 2026?

CVPR 2026 has 12 Sparsity Acceleration papers, versus 5 the year before.

Which conference publishes the most Sparsity Acceleration papers?

NeurIPS, with 80 papers from 2023 to 2026.