Alignment and Safety papers, 2023–2026
RLHF, preference optimization, red-teaming, and safety alignment
Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.
Key findings
- Alignment and Safety went from 438 papers in 2023 to 1,882 in 2026, roughly 4.3x in three years.
- NeurIPS publishes the most Alignment and Safety work: 1,421 papers from 2023 to 2026, 31% of the four-venue total.
- The fastest-growing overlap is with Social aspects · safety: papers tagged with both rose from 0 in 2023 to 137 in 2026.
- Among the 5 topics under Alignment and Responsible AI, it ranks #1 by 2026 paper count; the fastest grower in the group, Social aspects · safety, is up 93x versus 4.3x here.
Papers per venue
Counts by year and venue
| Year | NeurIPS | ICLR | ICML | CVPR | Total |
|---|---|---|---|---|---|
| 2023 | 138 | 87 | 101 | 112 | 438 |
| 2024 | 348 | 156 | 246 | 125 | 875 |
| 2025 | 455 | 473 | 300 | 135 | 1,363 |
| 2026 | 480 | 623 | 551 | 228 | 1,882 |
Representative papers
Spread across years and venues so every edition shows up
- NeurIPS 2026$\gamma$-weakly $\theta$-up-concavity: A Unified Framework for Non-Convex Optimization Beyond DR-Submodular and OSS Functions
- ICML 2026AICrypto: Evaluating Cryptography Capabilities of Large Language Models
- ICLR 2026A Fair Bayesian Inference through Matched Gibbs Posterior
- CVPR 2026Advancing Cancer Prognosis with Hierarchical Fusion of Genomic Proteomic and
- NeurIPS 2025$\Psi$-Sampler: Initial Particle Sampling for SMC-Based Inference-Time Reward Alignment in Score Models
- ICML 2025A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment
- ICLR 2025$\sigma$-zero: Gradient-based Optimization of $\ell_0$-norm Adversarial Examples
- CVPR 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models
- NeurIPS 2024A survey and benchmark of high-dimensional Bayesian optimization of discrete sequences
- ICML 2024A Global Geometric Analysis of Maximal Coding Rate Reduction
- ICLR 2024A unique M-pattern for micro-expression spotting in long videos
- CVPR 2024Decompose-and-Compose: A Compositional Approach to Mitigating Spurious Correlation
- NeurIPS 2023(S)GD over Diagonal Linear Networks: Implicit bias, Large Stepsizes and Edge of Stability
- ICML 2023A Robust Optimisation Perspective on Counterexample-Guided Repair of Neural Networks
- ICLR 2023Aligning Model and Macaque Inferior Temporal Cortex Representations Improves Model-to-Human Behavioral Alignment and Adversarial Robustness
- CVPR 2023Adjustment and Alignment for Unbiased Open Set Domain Adaptation
- NeurIPS 2026$\mathcal{P}$Torch: Narrowing the Gap Between Projection and Gradient-Based Learning
- ICML 2026Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignment
- ICLR 2026A2D: Any-Order, Any-Step Safety Alignment for Diffusion Language Models
- CVPR 2026AlignPose Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment
All Alignment and Safety papers
300 papers, page 1 of 6
- ICML 2025$\mathcal{V}ista\mathcal{DPO}$: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Models
- ICML 2025$S^2$FGL: Spatial Spectral Federated Graph Learning
- ICML 2025A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment
- ICML 2025A Generic Family of Graphical Models: Diversity, Efficiency, and Heterogeneity
- ICML 2025A Physics-Informed Machine Learning Framework for Safe and Optimal Control of Autonomous Systems
- ICML 2025A Unified Framework for Entropy Search and Expected Improvement in Bayesian Optimization
- ICML 2025A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO
- ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
- ICML 2025Achieving Linear Speedup and Near-Optimal Complexity for Decentralized Optimization over Row-stochastic Networks
- ICML 2025Activation Space Interventions Can Be Transferred Between Large Language Models
- ICML 2025Active Reward Modeling: Adaptive Preference Labeling for Large Language Model Alignment
- ICML 2025Adapting While Learning: Grounding LLMs for Scientific Problems with Tool Usage Adaptation
- ICML 2025Adaptive Estimation and Learning under Temporal Distribution Shift
- ICML 2025Addressing Concept Mislabeling in Concept Bottleneck Models Through Preference Optimization
- ICML 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization
- ICML 2025AdvAgent: Controllable Blackbox Red-teaming on Web Agents
- ICML 2025Adversaries Can Misuse Combinations of Safe Models
- ICML 2025AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs
- ICML 2025AEQA-NAT : Adaptive End-to-end Quantization Alignment Training Framework for Non-autoregressive Machine Translation
- ICML 2025Aligning Multimodal Representations through an Information Bottleneck
- ICML 2025Aligning Spoken Dialogue Models from User Interactions
- ICML 2025Aligning with Logic: Measuring, Evaluating and Improving Logical Preference Consistency in Large Language Models
- ICML 2025AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
- ICML 2025AlphaPO: Reward Shape Matters for LLM Alignment
- ICML 2025AMPO: Active Multi Preference Optimization for Self-play Preference Selection
- ICML 2025Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-tuning Attack
- ICML 2025Assessing Safety Risks and Quantization-aware Safety Patching for Quantized Large Language Models
- ICML 2025Automated Red Teaming with GOAT: the Generative Offensive Agent Tester
- ICML 2025Avoiding Catastrophe in Online Learning by Asking for Help
- ICML 2025Bayesian Optimization from Human Feedback: Near-Optimal Regret Bounds
- ICML 2025BDC-CLIP: Brownian Distance Covariance for Adapting CLIP to Action Recognition
- ICML 2025Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safety
- ICML 2025Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment
- ICML 2025BILBO: BILevel Bayesian Optimization
- ICML 2025Boosting Adversarial Robustness with CLAT: Criticality Leveraged Adversarial Training
- ICML 2025BOPO: Neural Combinatorial Optimization via Best-anchored and Objective-guided Preference Optimization
- ICML 2025Bounded Rationality for LLMs: Satisficing Alignment at Inference-Time
- ICML 2025BounDr.E: Predicting Drug-likeness via Biomedical Knowledge Alignment and EM-like One-Class Boundary Optimization
- ICML 2025Breaking Barriers: Combinatorial Algorithms for Non-Monotone Submodular Maximization with Sublinear Adaptivity and $1/e$ Approximation
- ICML 2025Calibrated Language Models and How to Find Them with Label Smoothing
- ICML 2025Calibrating Video Watch-time Predictions with Credible Prototype Alignment
- ICML 2025Can RLHF be More Efficient with Imperfect Reward Models? A Policy Coverage Perspective
- ICML 2025Cannot See the Forest for the Trees: Invoking Heuristics and Biases to Elicit Irrational Choices of LLMs
- ICML 2025CASE-Bench: Context-Aware SafEty Benchmark for Large Language Models
- ICML 2025Clipped SGD Algorithms for Performative Prediction: Tight Bounds for Stochastic Bias and Remedies
- ICML 2025Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
- ICML 2025Clone-Robust AI Alignment
- ICML 2025CodeSteer: Symbolic-Augmented Language Models via Code/Text Guidance
- ICML 2025Comparing Comparisons: Informative and Easy Human Feedback with Distinguishability Queries
- ICML 2025Comparing Few to Rank Many: Active Human Preference Learning Using Randomized Frank-Wolfe Method
Ask about this trend from Claude or Cursor
Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.
Copy this prompt into your assistant
Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.
Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}
Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)
FAQ
- How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
- 4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
- How many Alignment and Safety papers are at NeurIPS 2026?
- NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
- How many Alignment and Safety papers are at ICLR 2026?
- ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
- How many Alignment and Safety papers are at ICML 2026?
- ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
- How many Alignment and Safety papers are at CVPR 2026?
- CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
- Which conference publishes the most Alignment and Safety papers?
- NeurIPS, with 1,421 papers from 2023 to 2026.