Robustness Benchmarks papers, 2023–2026

Key findings

• Robustness Benchmarks went from 64 papers in 2023 to 69 in 2026, roughly 1.1x in three years.
• NeurIPS publishes the most Robustness Benchmarks work: 80 papers from 2023 to 2026, 30% of the four-venue total.
• The fastest-growing overlap is with General ML · evaluation: papers tagged with both rose from 0 in 2023 to 8 in 2026.
• Among the 5 topics under Evaluation and Benchmarks, it ranks #4 by 2026 paper count; the fastest grower in the group, LLM Benchmarks, is up 154x versus 1.1x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Brittlebench: Quantifying LLM robustness via prompt sensitivity
• ICML 2026Geometrically Constrained Outlier Synthesis
• ICLR 2026Pitfalls in Evaluating Language Model Forecasters
• CVPR 2026FoV-Net Rotation-Invariant CAD B-rep Learning via Field-of-View Ray Casting
• NeurIPS 2025Aggregation Hides Out-of-Distribution Generalization Failures from Spurious Correlations
• ICML 2025Diverse Prototypical Ensembles Improve Robustness to Subpopulation Shift
• ICLR 2025DRoP: Distributionally Robust Data Pruning
• CVPR 2025FRAMES-VQA: Benchmarking Fine-Tuning Robustness across Multi-Modal Shifts in Visual Question Answering
• NeurIPS 2024An Analysis of Robustness of Non-Lipschitz Networks
• ICML 2024Controllable Prompt Tuning For Balancing Group Distributional Robustness
• ICLR 2024Realistic Evaluation of Semi-supervised Learning Algorithms in Open Environments
• CVPR 2024A Bayesian Approach to OOD Robustness in Image Classification
• NeurIPS 2023Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evaluations
• ICML 2023A Law of Robustness beyond Isoperimetry
• ICLR 2023A Call to Reflect on Evaluation Practices for Failure Detection in Image Classification
• CVPR 2023Improving Robustness of Vision Transformers by Reducing Sensitivity To Patch Corruptions
• NeurIPS 2026Stress-Testing Neural Network Verifiers with Provably Robust Instances
• ICML 2026Optimal Attention Temperature Improves the Robustness of In-Context Learning under Distribution Shift in High Dimensions
• ICLR 2026CLARC: C/C++ Benchmark for Robust Code Search
• CVPR 2026LIBERO-Plus A Progressive Robustness Benchmark for Visual-Language-Action Models

All Robustness Benchmarks papers

69 papers, page 1 of 2

1. CVPR 2026Detecting Compressed AI-Generated Images via Phase Spectrum Robustness
2. CVPR 2026FoV-Net Rotation-Invariant CAD B-rep Learning via Field-of-View Ray Casting
3. CVPR 2026Geometry-driven OOD Detectors Are Class-Incremental Learners
4. CVPR 2026LIBERO-Plus A Progressive Robustness Benchmark for Visual-Language-Action Models
5. CVPR 2026Mitigating Error Amplification in Fast Adversarial Training
6. CVPR 2026On the Role of Temporal Granularity in the Robustness of
7. CVPR 2026PanoVGGT Feed-Forward 3D Reconstruction from Panoramic Imagery
8. CVPR 2026Scaling Test-Time Robustness of Vision-Language Models via Self-Critical Inference Framework
9. CVPR 2026Shedding Light on VLN Robustness A Black-box Framework for Indoor
10. CVPR 2026Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks
11. CVPR 2026Verifying Neural Network Robustness with Dual Perturbations
12. CVPR 2026WaTeRFlow Watermark Temporal Robustness via Flow Consistency
13. ICLR 2026CERTIFIED VS. EMPIRICAL ADVERSARIAL ROBUSTNESS VIA HYBRID CONVOLUTIONS WITH ATTENTION STOCHASTICITY
14. ICLR 2026CLARC: C/C++ Benchmark for Robust Code Search
15. ICLR 2026GneissWeb: Preparing High Quality Data for LLMs at Scale
16. ICLR 2026GraphUniverse: Enabling Systematic Evaluation of Inductive Generalization
17. ICLR 2026Is Your Paper Being Reviewed by an LLM? Benchmarking AI Text Detection in Peer Review
18. ICLR 2026Mapping Overlaps in Benchmarks through Perplexity in the Wild
19. ICLR 2026On the Bayes Inconsistency of Disagreement Discrepancy Surrogates
20. ICLR 2026ON THE ROLE OF IMPLICIT REGULARIZATION OF STOCHASTIC GRADIENT DESCENT IN GROUP ROBUSTNESS
21. ICLR 2026Pitfalls in Evaluating Language Model Forecasters
22. ICLR 2026PYRREGULAR: A Unified Framework for Irregular Time Series, with Classification Benchmarks
23. ICLR 2026QUEST: A robust attention formulation using query-modulated spherical attention
24. ICLR 2026SocialHarmBench: Revealing LLM Vulnerabilities to Socially Harmful Requests
25. ICLR 2026The Price of Robustness: Stable Classifiers Need Overparameterization
26. ICLR 2026Training Dynamics Impact Post-Training Quantization Robustness
27. ICLR 2026When Flatness Does (Not) Guarantee Adversarial Robustness
28. ICML 2026A Geometry-Based View of Mahalanobis OOD Detection
29. ICML 2026AgentNoiseBench: Benchmarking Robustness of Tool-Using LLM Agents Under Noisy Condition
30. ICML 2026AOEPT: Breaking the Implicit Modality-Reduction Bottleneck in Modality-Missing Prompt Tuning
31. ICML 2026Beyond Benchmarks: Toward Causally Faithful Evaluation of Large Language Models
32. ICML 2026CaliDist: Calibrating Large Language Models via Behavioral Robustness to Distraction
33. ICML 2026Correct Looks Better: Pairwise Comparisons Reveal Accuracy Rankings
34. ICML 2026Ellipsoidal Time Series Forecasting
35. ICML 2026Evaluating Robustness of Reasoning Models on Parameterized Logical Problems
36. ICML 2026Expanding the AI Evaluation Toolbox with Statistical Models
37. ICML 2026GENEB: Why Genomic Models Are Hard to Compare
38. ICML 2026Geometrically Constrained Outlier Synthesis
39. ICML 2026Improving the Robustness-Utility Trade-off in Decentralized Learning over Sparse Networks
40. ICML 2026Improving the Sensitivity of Backdoor Detectors via Class Subspace Orthogonalization
41. ICML 2026MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMs
42. ICML 2026Non-Parametric Probabilistic Robustness: A Conservative Risk Estimator under Unknown Perturbation Distributions
43. ICML 2026Optimal Attention Temperature Improves the Robustness of In-Context Learning under Distribution Shift in High Dimensions
44. ICML 2026Posterior Mismatch Matters: Adversarial Training for Long-Tailed Robustness
45. ICML 2026ProMiSE: Protein Multi-State Evaluation Benchmark in Biological Contexts
46. ICML 2026RubricRobustness: Evaluating the Sensitivity of Rubrics-Based Benchmarks to Simple Perturbations
47. ICML 2026Self-Calibrated Consistency can Fight Back for Adversarial Robustness in Vision-Language Models
48. ICML 2026Towards Optimal Robustness in Learning-Augmented Paging
49. ICML 2026Training-Free Adversarial Robustness in Computational MRI
50. ICML 2026VLM-RobustBench: A Comprehensive Benchmark for Robustness of Vision-Language Models

FAQ

How many Robustness Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

264 in total: 64 in 2023, 59 in 2024, 72 in 2025, 69 in 2026.

How many Robustness Benchmarks papers are at NeurIPS 2026?

NeurIPS 2026 has 18 Robustness Benchmarks papers, versus 34 the year before.

How many Robustness Benchmarks papers are at ICLR 2026?

ICLR 2026 has 15 Robustness Benchmarks papers, versus 10 the year before.

How many Robustness Benchmarks papers are at ICML 2026?

ICML 2026 has 24 Robustness Benchmarks papers, versus 20 the year before.

How many Robustness Benchmarks papers are at CVPR 2026?

CVPR 2026 has 12 Robustness Benchmarks papers, versus 8 the year before.

Which conference publishes the most Robustness Benchmarks papers?

NeurIPS, with 80 papers from 2023 to 2026.