Sparsity Acceleration papers, 2023–2026

Key findings

• Sparsity Acceleration went from 54 papers in 2023 to 89 in 2026, roughly 1.6x in three years.
• NeurIPS publishes the most Sparsity Acceleration work: 80 papers from 2023 to 2026, 31% of the four-venue total.
• The fastest-growing overlap is with Multimodal LLMs: papers tagged with both rose from 0 in 2023 to 13 in 2026.
• Among the 5 topics under Hardware and Compilers, it ranks #1 by 2026 paper count; the fastest grower in the group, Edge Inference, is up 4.0x versus 1.6x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AC/DC on a Budget -- Alternating Sparse Phases
• ICML 2026An Evidential Route to Asymptotic Bayes Optimality under Sparsity
• ICLR 2026Hilbert-Guided Sparse Local Attention
• CVPR 2026Improving Sparse Autoencoder with Dynamic Attention
• NeurIPS 2025Bilevel Network Learning via Hierarchically Structured Sparsity
• ICML 2025COGNATE: Acceleration of Sparse Tensor Programs on Emerging Hardware using Transfer Learning
• ICLR 2025Beyond Worst-Case Dimensionality Reduction for Sparse Vectors
• CVPR 2025ICP: Immediate Compensation Pruning for Mid-to-high Sparsity
• NeurIPS 2024ELSA: Exploiting Layer-wise N:M Sparsity for Vision Transformer Acceleration
• ICML 2024Accelerating Transformer Pre-training with 2:4 Sparsity
• ICLR 2024Adaptive Sharpness-Aware Pruning for Robust Sparse Networks
• CVPR 2024Masked Spatial Propagation Network for Sparsity-Adaptive Depth Refinement
• NeurIPS 2023Dynamic Sparsity Is Channel-Level Sparsity Learner
• ICML 2023Conformalization of Sparse Generalized Linear Models
• ICLR 2023Bit-Pruning: A Sparse Multiplication-Less Dot-Product
• CVPR 2023Adaptive Channel Sparsity for Federated Learning Under System Heterogeneity
• NeurIPS 2026Beyond Masked Sparsity: SNACK Enables Truly Sparse Neural Networks on GPU
• ICML 2026FlashSketch: Sketch-Kernel Co-Design for Fast Sparse Sketching on GPUs
• ICLR 2026Identifiability Challenges in Sparse Linear Ordinary Differential Equations
• CVPR 2026Revisiting Pose Sensitivity in Splat-based Computed Tomography under Sparse-view Reconstruction

All Sparsity Acceleration papers

80 papers, page 2 of 2

51. NeurIPS 2024Adaptive Layer Sparsity for Large Language Models via Activation Correlation Assessment
52. NeurIPS 2024AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising
53. NeurIPS 2024Block Sparse Bayesian Learning: A Diversified Scheme
54. NeurIPS 2024CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networks
55. NeurIPS 2024Discovering Sparsity Allocation for Layer-wise Pruning of Large Language Models
56. NeurIPS 2024ELSA: Exploiting Layer-wise N:M Sparsity for Vision Transformer Acceleration
57. NeurIPS 2024Fast Iterative Hard Thresholding Methods with Pruning Gradient Computations
58. NeurIPS 2024How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspective
59. NeurIPS 2024Improving Decision Sparsity
60. NeurIPS 2024Learn To be Efficient: Build Structured Sparsity in Large Language Models
61. NeurIPS 2024Learning from Highly Sparse Spatio-temporal Data
62. NeurIPS 2024MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
63. NeurIPS 2024Navigating Extremes: Dynamic Sparsity in Large Output Spaces
64. NeurIPS 2024Nesterov acceleration despite very noisy gradients
65. NeurIPS 2024Numerically Stable Sparse Gaussian Processes via Minimum Separation using Cover Trees
66. NeurIPS 2024On the Sparsity of the Strong Lottery Ticket Hypothesis
67. NeurIPS 2024S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training
68. NeurIPS 2024Solving Sparse \& High-Dimensional-Output Regression via Compression
69. NeurIPS 2024Sparse maximal update parameterization: A holistic approach to sparse training dynamics
70. NeurIPS 2024Sparsity-Agnostic Linear Bandits with Adaptive Adversaries
71. NeurIPS 2023Canonical normalizing flows for manifold learning
72. NeurIPS 2023Double Randomized Underdamped Langevin with Dimension-Independent Convergence Guarantee
73. NeurIPS 2023Dynamic Sparsity Is Channel-Level Sparsity Learner
74. NeurIPS 2023On the Identifiability of Sparse ICA without Assuming Non-Gaussianity
75. NeurIPS 2023Penalising the biases in norm regularisation enforces sparsity
76. NeurIPS 2023Robust Model Reasoning and Fitting via Dual Sparsity Pursuit
77. NeurIPS 2023Sparsity-Preserving Differentially Private Training of Large Embedding Models
78. NeurIPS 2023SUBP: Soft Uniform Block Pruning for 1$\times$N Sparse CNNs Multithreading Acceleration
79. NeurIPS 2023Tanh Works Better with Asymmetry
80. NeurIPS 2023Towards Data-Agnostic Pruning At Initialization: What Makes a Good Sparse Mask?

FAQ

How many Sparsity Acceleration papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

260 in total: 54 in 2023, 53 in 2024, 64 in 2025, 89 in 2026.

How many Sparsity Acceleration papers are at NeurIPS 2026?

NeurIPS 2026 has 29 Sparsity Acceleration papers, versus 21 the year before.

How many Sparsity Acceleration papers are at ICLR 2026?

ICLR 2026 has 24 Sparsity Acceleration papers, versus 16 the year before.

How many Sparsity Acceleration papers are at ICML 2026?

ICML 2026 has 24 Sparsity Acceleration papers, versus 22 the year before.

How many Sparsity Acceleration papers are at CVPR 2026?

CVPR 2026 has 12 Sparsity Acceleration papers, versus 5 the year before.

Which conference publishes the most Sparsity Acceleration papers?

NeurIPS, with 80 papers from 2023 to 2026.