Sparsity Acceleration papers, 2023–2026

Key findings

• Sparsity Acceleration went from 54 papers in 2023 to 89 in 2026, roughly 1.6x in three years.
• NeurIPS publishes the most Sparsity Acceleration work: 80 papers from 2023 to 2026, 31% of the four-venue total.
• The fastest-growing overlap is with Multimodal LLMs: papers tagged with both rose from 0 in 2023 to 13 in 2026.
• Among the 5 topics under Hardware and Compilers, it ranks #1 by 2026 paper count; the fastest grower in the group, Edge Inference, is up 4.0x versus 1.6x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AC/DC on a Budget -- Alternating Sparse Phases
• ICML 2026An Evidential Route to Asymptotic Bayes Optimality under Sparsity
• ICLR 2026Hilbert-Guided Sparse Local Attention
• CVPR 2026Improving Sparse Autoencoder with Dynamic Attention
• NeurIPS 2025Bilevel Network Learning via Hierarchically Structured Sparsity
• ICML 2025COGNATE: Acceleration of Sparse Tensor Programs on Emerging Hardware using Transfer Learning
• ICLR 2025Beyond Worst-Case Dimensionality Reduction for Sparse Vectors
• CVPR 2025ICP: Immediate Compensation Pruning for Mid-to-high Sparsity
• NeurIPS 2024ELSA: Exploiting Layer-wise N:M Sparsity for Vision Transformer Acceleration
• ICML 2024Accelerating Transformer Pre-training with 2:4 Sparsity
• ICLR 2024Adaptive Sharpness-Aware Pruning for Robust Sparse Networks
• CVPR 2024Masked Spatial Propagation Network for Sparsity-Adaptive Depth Refinement
• NeurIPS 2023Dynamic Sparsity Is Channel-Level Sparsity Learner
• ICML 2023Conformalization of Sparse Generalized Linear Models
• ICLR 2023Bit-Pruning: A Sparse Multiplication-Less Dot-Product
• CVPR 2023Adaptive Channel Sparsity for Federated Learning Under System Heterogeneity
• NeurIPS 2026Beyond Masked Sparsity: SNACK Enables Truly Sparse Neural Networks on GPU
• ICML 2026FlashSketch: Sketch-Kernel Co-Design for Fast Sparse Sketching on GPUs
• ICLR 2026Identifiability Challenges in Sparse Linear Ordinary Differential Equations
• CVPR 2026Revisiting Pose Sensitivity in Splat-based Computed Tomography under Sparse-view Reconstruction

All Sparsity Acceleration papers

75 papers, page 2 of 2

51. ICML 2024Diversified Batch Selection for Training Acceleration
52. ICML 2024Enhancing Adversarial Robustness in SNNs with Sparse Gradients
53. ICML 2024Exploring the Benefit of Activation Sparsity in Pre-training
54. ICML 2024High-dimensional Linear Bandits with Knapsacks
55. ICML 2024Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity
56. ICML 2024SPADE: Sparsity-Guided Debugging for Deep Neural Networks
57. ICML 2024Sparse Cocktail: Every Sparse Pattern Every Sparse Ratio All At Once
58. ICML 2024Sparse Dimensionality Reduction Revisited
59. ICML 2024Sparse is Enough in Fine-tuning Pre-trained Large Language Models
60. ICML 2024Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency
61. ICML 2024Sparser, Better, Deeper, Stronger: Improving Static Sparse Training with Exact Orthogonal Initialization
62. ICML 2024Straight-Through Meets Sparse Recovery: the Support Exploration Algorithm
63. ICML 2024Submodular framework for structured-sparse optimal transport
64. ICML 2024Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot
65. ICML 2023Conformalization of Sparse Generalized Linear Models
66. ICML 2023Context Consistency Regularization for Label Sparsity in Time Series
67. ICML 2023Does Sparsity Help in Learning Misspecified Linear Bandits?
68. ICML 2023Emergence of Sparse Representations from Noise
69. ICML 2023Marginalization is not Marginal: No Bad VAE Local Minima when Learning Optimal Sparse Representations
70. ICML 2023Pruning via Sparsity-indexed ODE: a Continuous Sparsity Viewpoint
71. ICML 2023SLAMB: Accelerated Large Batch Training with Sparse Communication
72. ICML 2023Sparse Learning of Dynamical Systems in RKHS: An Operator-Theoretic Approach
73. ICML 2023Thompson Sampling for High-Dimensional Sparse Linear Contextual Bandits
74. ICML 2023Tilted Sparse Additive Models
75. ICML 2023Why Random Pruning Is All We Need to Start Sparse

FAQ

How many Sparsity Acceleration papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

260 in total: 54 in 2023, 53 in 2024, 64 in 2025, 89 in 2026.

How many Sparsity Acceleration papers are at NeurIPS 2026?

NeurIPS 2026 has 29 Sparsity Acceleration papers, versus 21 the year before.

How many Sparsity Acceleration papers are at ICLR 2026?

ICLR 2026 has 24 Sparsity Acceleration papers, versus 16 the year before.

How many Sparsity Acceleration papers are at ICML 2026?

ICML 2026 has 24 Sparsity Acceleration papers, versus 22 the year before.

How many Sparsity Acceleration papers are at CVPR 2026?

CVPR 2026 has 12 Sparsity Acceleration papers, versus 5 the year before.

Which conference publishes the most Sparsity Acceleration papers?

NeurIPS, with 80 papers from 2023 to 2026.