Sparsity Acceleration papers, 2023–2026

Key findings

• Sparsity Acceleration went from 54 papers in 2023 to 89 in 2026, roughly 1.6x in three years.
• NeurIPS publishes the most Sparsity Acceleration work: 80 papers from 2023 to 2026, 31% of the four-venue total.
• The fastest-growing overlap is with Multimodal LLMs: papers tagged with both rose from 0 in 2023 to 13 in 2026.
• Among the 5 topics under Hardware and Compilers, it ranks #1 by 2026 paper count; the fastest grower in the group, Edge Inference, is up 4.0x versus 1.6x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AC/DC on a Budget -- Alternating Sparse Phases
• ICML 2026An Evidential Route to Asymptotic Bayes Optimality under Sparsity
• ICLR 2026Hilbert-Guided Sparse Local Attention
• CVPR 2026Improving Sparse Autoencoder with Dynamic Attention
• NeurIPS 2025Bilevel Network Learning via Hierarchically Structured Sparsity
• ICML 2025COGNATE: Acceleration of Sparse Tensor Programs on Emerging Hardware using Transfer Learning
• ICLR 2025Beyond Worst-Case Dimensionality Reduction for Sparse Vectors
• CVPR 2025ICP: Immediate Compensation Pruning for Mid-to-high Sparsity
• NeurIPS 2024ELSA: Exploiting Layer-wise N:M Sparsity for Vision Transformer Acceleration
• ICML 2024Accelerating Transformer Pre-training with 2:4 Sparsity
• ICLR 2024Adaptive Sharpness-Aware Pruning for Robust Sparse Networks
• CVPR 2024Masked Spatial Propagation Network for Sparsity-Adaptive Depth Refinement
• NeurIPS 2023Dynamic Sparsity Is Channel-Level Sparsity Learner
• ICML 2023Conformalization of Sparse Generalized Linear Models
• ICLR 2023Bit-Pruning: A Sparse Multiplication-Less Dot-Product
• CVPR 2023Adaptive Channel Sparsity for Federated Learning Under System Heterogeneity
• NeurIPS 2026Beyond Masked Sparsity: SNACK Enables Truly Sparse Neural Networks on GPU
• ICML 2026FlashSketch: Sketch-Kernel Co-Design for Fast Sparse Sketching on GPUs
• ICLR 2026Identifiability Challenges in Sparse Linear Ordinary Differential Equations
• CVPR 2026Revisiting Pose Sensitivity in Splat-based Computed Tomography under Sparse-view Reconstruction

All Sparsity Acceleration papers

260 papers, page 5 of 6

201. NeurIPS 2024Numerically Stable Sparse Gaussian Processes via Minimum Separation using Cover Trees
202. NeurIPS 2024On the Sparsity of the Strong Lottery Ticket Hypothesis
203. NeurIPS 2024S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training
204. NeurIPS 2024Solving Sparse \& High-Dimensional-Output Regression via Compression
205. NeurIPS 2024Sparse maximal update parameterization: A holistic approach to sparse training dynamics
206. NeurIPS 2024Sparsity-Agnostic Linear Bandits with Adaptive Adversaries
207. CVPR 2023Adaptive Channel Sparsity for Federated Learning Under System Heterogeneity
208. CVPR 2023Compacting Binary Neural Networks by Sparse Kernel Selection
209. CVPR 2023DSVT: Dynamic Sparse Voxel Transformer With Rotated Sets
210. CVPR 2023Fair Scratch Tickets: Finding Fair Sparse Networks Without Weight Training
211. CVPR 2023Fast Monocular Scene Reconstruction With Global-Sparse Local-Dense Grids
212. CVPR 2023FlexNeRF: Photorealistic Free-Viewpoint Rendering of Moving Humans From Sparse Views
213. CVPR 2023Hunting Sparsity: Density-Guided Contrastive Learning for Semi-Supervised Semantic Segmentation
214. CVPR 2023Network Expansion for Practical Training Acceleration
215. CVPR 2023Practical Network Acceleration With Tiny Sets
216. CVPR 2023STMixer: A One-Stage Sparse Action Detector
217. CVPR 2023Unsupervised Inference of Signed Distance Functions From Single Sparse Point Clouds Without Learning Priors
218. ICLR 2023Accurate Neural Training with 4-bit Matrix Multiplications at Standard Formats
219. ICLR 2023Bit-Pruning: A Sparse Multiplication-Less Dot-Product
220. ICLR 2023Continuized Acceleration for Quasar Convex Functions in Non-Convex Optimization
221. ICLR 2023Efficient recurrent architectures through activity sparsity and sparse back-propagation through time
222. ICLR 2023Equivariant Hypergraph Diffusion Neural Operators
223. ICLR 2023Exponential Generalization Bounds with Near-Optimal Rates for $L_q$-Stable Algorithms
224. ICLR 2023Factorized Fourier Neural Operators
225. ICLR 2023Implicit Regularization for Group Sparsity
226. ICLR 2023Minimalistic Unsupervised Representation Learning with the Sparse Manifold Transform
227. ICLR 2023Minimum Variance Unbiased N:M Sparsity for the Neural Gradients
228. ICLR 2023MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initialization
229. ICLR 2023More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity
230. ICLR 2023Pruning Deep Neural Networks from a Sparsity Perspective
231. ICLR 2023Rethinking Graph Lottery Tickets: Graph Sparsity Matters
232. ICLR 2023Sparse Distributed Memory is a Continual Learner
233. ICLR 2023Sparse Random Networks for Communication-Efficient Federated Learning
234. ICLR 2023Sparse tree-based Initialization for Neural Networks
235. ICLR 2023Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!
236. ICLR 2023Sparsity-Constrained Optimal Transport
237. ICLR 2023The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers
238. ICLR 2023Unmasking the Lottery Ticket Hypothesis: What's Encoded in a Winning Ticket's Mask?
239. ICLR 2023Variance-Aware Sparse Linear Bandits
240. ICML 2023Conformalization of Sparse Generalized Linear Models
241. ICML 2023Context Consistency Regularization for Label Sparsity in Time Series
242. ICML 2023Does Sparsity Help in Learning Misspecified Linear Bandits?
243. ICML 2023Emergence of Sparse Representations from Noise
244. ICML 2023Marginalization is not Marginal: No Bad VAE Local Minima when Learning Optimal Sparse Representations
245. ICML 2023Pruning via Sparsity-indexed ODE: a Continuous Sparsity Viewpoint
246. ICML 2023SLAMB: Accelerated Large Batch Training with Sparse Communication
247. ICML 2023Sparse Learning of Dynamical Systems in RKHS: An Operator-Theoretic Approach
248. ICML 2023Thompson Sampling for High-Dimensional Sparse Linear Contextual Bandits
249. ICML 2023Tilted Sparse Additive Models
250. ICML 2023Why Random Pruning Is All We Need to Start Sparse

FAQ

How many Sparsity Acceleration papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

260 in total: 54 in 2023, 53 in 2024, 64 in 2025, 89 in 2026.

How many Sparsity Acceleration papers are at NeurIPS 2026?

NeurIPS 2026 has 29 Sparsity Acceleration papers, versus 21 the year before.

How many Sparsity Acceleration papers are at ICLR 2026?

ICLR 2026 has 24 Sparsity Acceleration papers, versus 16 the year before.

How many Sparsity Acceleration papers are at ICML 2026?

ICML 2026 has 24 Sparsity Acceleration papers, versus 22 the year before.

How many Sparsity Acceleration papers are at CVPR 2026?

CVPR 2026 has 12 Sparsity Acceleration papers, versus 5 the year before.

Which conference publishes the most Sparsity Acceleration papers?

NeurIPS, with 80 papers from 2023 to 2026.