Robustness Benchmarks papers, 2023–2026
OOD evaluation
Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 264 papers are tagged with this topic.
Key findings
- Robustness Benchmarks went from 64 papers in 2023 to 69 in 2026, roughly 1.1x in three years.
- NeurIPS publishes the most Robustness Benchmarks work: 80 papers from 2023 to 2026, 30% of the four-venue total.
- The fastest-growing overlap is with General ML · evaluation: papers tagged with both rose from 0 in 2023 to 8 in 2026.
- Among the 5 topics under Evaluation and Benchmarks, it ranks #4 by 2026 paper count; the fastest grower in the group, LLM Benchmarks, is up 154x versus 1.1x here.
Papers per venue
Counts by year and venue
| Year | NeurIPS | ICLR | ICML | CVPR | Total |
|---|---|---|---|---|---|
| 2023 | 12 | 29 | 14 | 9 | 64 |
| 2024 | 16 | 18 | 16 | 9 | 59 |
| 2025 | 34 | 10 | 20 | 8 | 72 |
| 2026 | 18 | 15 | 24 | 12 | 69 |
Representative papers
Spread across years and venues so every edition shows up
- NeurIPS 2026Brittlebench: Quantifying LLM robustness via prompt sensitivity
- ICML 2026Geometrically Constrained Outlier Synthesis
- ICLR 2026Pitfalls in Evaluating Language Model Forecasters
- CVPR 2026FoV-Net Rotation-Invariant CAD B-rep Learning via Field-of-View Ray Casting
- NeurIPS 2025Aggregation Hides Out-of-Distribution Generalization Failures from Spurious Correlations
- ICML 2025Diverse Prototypical Ensembles Improve Robustness to Subpopulation Shift
- ICLR 2025DRoP: Distributionally Robust Data Pruning
- CVPR 2025FRAMES-VQA: Benchmarking Fine-Tuning Robustness across Multi-Modal Shifts in Visual Question Answering
- NeurIPS 2024An Analysis of Robustness of Non-Lipschitz Networks
- ICML 2024Controllable Prompt Tuning For Balancing Group Distributional Robustness
- ICLR 2024Realistic Evaluation of Semi-supervised Learning Algorithms in Open Environments
- CVPR 2024A Bayesian Approach to OOD Robustness in Image Classification
- NeurIPS 2023Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evaluations
- ICML 2023A Law of Robustness beyond Isoperimetry
- ICLR 2023A Call to Reflect on Evaluation Practices for Failure Detection in Image Classification
- CVPR 2023Improving Robustness of Vision Transformers by Reducing Sensitivity To Patch Corruptions
- NeurIPS 2026Stress-Testing Neural Network Verifiers with Provably Robust Instances
- ICML 2026Optimal Attention Temperature Improves the Robustness of In-Context Learning under Distribution Shift in High Dimensions
- ICLR 2026CLARC: C/C++ Benchmark for Robust Code Search
- CVPR 2026LIBERO-Plus A Progressive Robustness Benchmark for Visual-Language-Action Models
All Robustness Benchmarks papers
38 papers, page 1 of 1
- CVPR 2026Detecting Compressed AI-Generated Images via Phase Spectrum Robustness
- CVPR 2026FoV-Net Rotation-Invariant CAD B-rep Learning via Field-of-View Ray Casting
- CVPR 2026Geometry-driven OOD Detectors Are Class-Incremental Learners
- CVPR 2026LIBERO-Plus A Progressive Robustness Benchmark for Visual-Language-Action Models
- CVPR 2026Mitigating Error Amplification in Fast Adversarial Training
- CVPR 2026On the Role of Temporal Granularity in the Robustness of
- CVPR 2026PanoVGGT Feed-Forward 3D Reconstruction from Panoramic Imagery
- CVPR 2026Scaling Test-Time Robustness of Vision-Language Models via Self-Critical Inference Framework
- CVPR 2026Shedding Light on VLN Robustness A Black-box Framework for Indoor
- CVPR 2026Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks
- CVPR 2026Verifying Neural Network Robustness with Dual Perturbations
- CVPR 2026WaTeRFlow Watermark Temporal Robustness via Flow Consistency
- CVPR 2025Advancing Adversarial Robustness in GNeRFs: The IL2-NeRF Attack
- CVPR 2025FRAMES-VQA: Benchmarking Fine-Tuning Robustness across Multi-Modal Shifts in Visual Question Answering
- CVPR 2025Gain from Neighbors: Boosting Model Robustness in the Wild via Adversarial Perturbations Toward Neighboring Classes
- CVPR 2025R-TPT: Improving Adversarial Robustness of Vision-Language Models through Test-Time Prompt Tuning
- CVPR 2025Rethinking the Adversarial Robustness of Multi-Exit Neural Networks in an Attack-Defense Game
- CVPR 2025SATA: Spatial Autocorrelation Token Analysis for Enhancing the Robustness of Vision Transformers
- CVPR 2025Tightening Robustness Verification of MaxPool-based Neural Networks via Minimizing the Over-Approximation Zone
- CVPR 2025Towards Million-Scale Adversarial Robustness Evaluation With Stronger Individual Attacks
- CVPR 2024A Bayesian Approach to OOD Robustness in Image Classification
- CVPR 2024Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptions
- CVPR 2024Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness
- CVPR 2024Calibrating Multi-modal Representations: A Pursuit of Group Robustness without Annotations
- CVPR 2024ImageNet-D: Benchmarking Neural Network Robustness on Diffusion Synthetic Object
- CVPR 2024Model Inversion Robustness: Can Transfer Learning Help?
- CVPR 2024Reconstructing Hands in 3D with Transformers
- CVPR 2024RoDLA: Benchmarking the Robustness of Document Layout Analysis Models
- CVPR 2024Soften to Defend: Towards Adversarial Robustness via Self-Guided Label Refinement
- CVPR 2023A Large-Scale Robustness Analysis of Video Action Recognition Models
- CVPR 2023Adversarial Robustness via Random Projection Filters
- CVPR 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions
- CVPR 2023Cooperation or Competition: Avoiding Player Domination for Multi-Target Robustness via Adaptive Budgets
- CVPR 2023Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistency
- CVPR 2023ImageNet-E: Benchmarking Neural Network Robustness via Attribute Editing
- CVPR 2023Improving Robustness of Vision Transformers by Reducing Sensitivity To Patch Corruptions
- CVPR 2023Revisiting Residual Networks for Adversarial Robustness
- CVPR 2023Towards Compositional Adversarial Robustness: Generalizing Adversarial Training to Composite Semantic Perturbations
Ask about this trend from Claude or Cursor
Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.
Copy this prompt into your assistant
Use paperlist to show how Robustness Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.
Tool the assistant calls: get_topic_stats {"topic": "robustness-benchmarks"}
Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)
FAQ
- How many Robustness Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
- 264 in total: 64 in 2023, 59 in 2024, 72 in 2025, 69 in 2026.
- How many Robustness Benchmarks papers are at NeurIPS 2026?
- NeurIPS 2026 has 18 Robustness Benchmarks papers, versus 34 the year before.
- How many Robustness Benchmarks papers are at ICLR 2026?
- ICLR 2026 has 15 Robustness Benchmarks papers, versus 10 the year before.
- How many Robustness Benchmarks papers are at ICML 2026?
- ICML 2026 has 24 Robustness Benchmarks papers, versus 20 the year before.
- How many Robustness Benchmarks papers are at CVPR 2026?
- CVPR 2026 has 12 Robustness Benchmarks papers, versus 8 the year before.
- Which conference publishes the most Robustness Benchmarks papers?
- NeurIPS, with 80 papers from 2023 to 2026.