Alignment and Safety papers, 2023–2026
RLHF, preference optimization, red-teaming, and safety alignment
Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.
Key findings
- Alignment and Safety went from 438 papers in 2023 to 1,882 in 2026, roughly 4.3x in three years.
- NeurIPS publishes the most Alignment and Safety work: 1,421 papers from 2023 to 2026, 31% of the four-venue total.
- The fastest-growing overlap is with Social aspects · safety: papers tagged with both rose from 0 in 2023 to 137 in 2026.
- Among the 5 topics under Alignment and Responsible AI, it ranks #1 by 2026 paper count; the fastest grower in the group, Social aspects · safety, is up 93x versus 4.3x here.
Papers per venue
Counts by year and venue
| Year | NeurIPS | ICLR | ICML | CVPR | Total |
|---|---|---|---|---|---|
| 2023 | 138 | 87 | 101 | 112 | 438 |
| 2024 | 348 | 156 | 246 | 125 | 875 |
| 2025 | 455 | 473 | 300 | 135 | 1,363 |
| 2026 | 480 | 623 | 551 | 228 | 1,882 |
Representative papers
Spread across years and venues so every edition shows up
- NeurIPS 2026$\gamma$-weakly $\theta$-up-concavity: A Unified Framework for Non-Convex Optimization Beyond DR-Submodular and OSS Functions
- ICML 2026AICrypto: Evaluating Cryptography Capabilities of Large Language Models
- ICLR 2026A Fair Bayesian Inference through Matched Gibbs Posterior
- CVPR 2026Advancing Cancer Prognosis with Hierarchical Fusion of Genomic Proteomic and
- NeurIPS 2025$\Psi$-Sampler: Initial Particle Sampling for SMC-Based Inference-Time Reward Alignment in Score Models
- ICML 2025A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment
- ICLR 2025$\sigma$-zero: Gradient-based Optimization of $\ell_0$-norm Adversarial Examples
- CVPR 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models
- NeurIPS 2024A survey and benchmark of high-dimensional Bayesian optimization of discrete sequences
- ICML 2024A Global Geometric Analysis of Maximal Coding Rate Reduction
- ICLR 2024A unique M-pattern for micro-expression spotting in long videos
- CVPR 2024Decompose-and-Compose: A Compositional Approach to Mitigating Spurious Correlation
- NeurIPS 2023(S)GD over Diagonal Linear Networks: Implicit bias, Large Stepsizes and Edge of Stability
- ICML 2023A Robust Optimisation Perspective on Counterexample-Guided Repair of Neural Networks
- ICLR 2023Aligning Model and Macaque Inferior Temporal Cortex Representations Improves Model-to-Human Behavioral Alignment and Adversarial Robustness
- CVPR 2023Adjustment and Alignment for Unbiased Open Set Domain Adaptation
- NeurIPS 2026$\mathcal{P}$Torch: Narrowing the Gap Between Projection and Gradient-Based Learning
- ICML 2026Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignment
- ICLR 2026A2D: Any-Order, Any-Step Safety Alignment for Diffusion Language Models
- CVPR 2026AlignPose Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment
All Alignment and Safety papers
1,363 papers, page 24 of 28
- NeurIPS 2025Many LLMs Are More Utilitarian Than One
- NeurIPS 2025Matchings Under Biased and Correlated Evaluations
- NeurIPS 2025Measuring and Guiding Monosemanticity
- NeurIPS 2025Mechanism Design for LLM Fine-tuning with Multiple Reward Models
- NeurIPS 2025Median Selection with Noisy and Structural Information
- NeurIPS 2025Mesh-RFT: Enhancing Mesh Generation via Fine-grained Reinforcement Fine-Tuning
- NeurIPS 2025Meta-Learning Objectives for Preference Optimization
- NeurIPS 2025MGUP: A Momentum-Gradient Alignment Update Policy for Stochastic Optimization
- NeurIPS 2025Military AI Needs Technically-Informed Regulation to Safeguard AI Research and its Applications
- NeurIPS 2025Mitigating Hallucination Through Theory-Consistent Symmetric Multimodal Preference Optimization
- NeurIPS 2025Mitigating Reward Over-optimization in Direct Alignment Algorithms with Importance Sampling
- NeurIPS 2025Mitigating Sexual Content Generation via Embedding Distortion in Text-conditioned Diffusion Models
- NeurIPS 2025Mix Data or Merge Models? Balancing the Helpfulness, Honesty, and Harmlessness of Large Language Model via Model Merging
- NeurIPS 2025MJ-Video: Benchmarking and Rewarding Video Generation with Fine-Grained Video Preference
- NeurIPS 2025Model Inversion with Layer-Specific Modeling and Alignment for Data-Free Continual Learning
- NeurIPS 2025Model–Behavior Alignment under Flexible Evaluation: When the Best-Fitting Model Isn’t the Right One
- NeurIPS 2025Multi-step Visual Reasoning with Visual Tokens Scaling and Verification
- NeurIPS 2025Multimodal Disease Progression Modeling via Spatiotemporal Disentanglement and Multiscale Alignment
- NeurIPS 2025Nabla-R2D3: Effective and Efficient 3D Diffusion Alignment with 2D Rewards
- NeurIPS 2025Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
- NeurIPS 2025Neural Thermodynamics: Entropic Forces in Deep and Universal Representation Learning
- NeurIPS 2025NeuSymEA: Neuro-symbolic Entity Alignment via Variational Inference
- NeurIPS 2025No Loss, No Gain: Gated Refinement and Adaptive Compression for Prompt Optimization
- NeurIPS 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Models
- NeurIPS 2025Non-monotone Submodular Optimization: $p$-Matchoid Constraints and Fully Dynamic Setting
- NeurIPS 2025NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit Vector Quantization of KV Cache
- NeurIPS 2025nvBench 2.0: Resolving Ambiguity in Text-to-Visualization through Stepwise Reasoning
- NeurIPS 2025Object-centric binding in Contrastive Language-Image Pretraining
- NeurIPS 2025Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimization
- NeurIPS 2025On Efficiency-Effectiveness Trade-off of Diffusion-based Recommenders
- NeurIPS 2025On Evaluating LLM Alignment by Evaluating LLMs as Judges
- NeurIPS 2025On Extending Direct Preference Optimization to Accommodate Ties
- NeurIPS 2025On Local Limits of Sparse Random Graphs: Color Convergence and the Refined Configuration Model
- NeurIPS 2025On the creation of narrow AI: hierarchy and nonlocality of neural network skills
- NeurIPS 2025On the Effect of Negative Gradient in Group Relative Deep Reinforcement Optimization
- NeurIPS 2025On the Existence and Complexity of Core-Stable Data Exchanges
- NeurIPS 2025On the Stability and Generalization of Meta-Learning: the Impact of Inner-Levels
- NeurIPS 2025On-Policy Optimization with Group Equivalent Preference for Multi-Programming Language Understanding
- NeurIPS 2025One SPACE to Rule Them All: Jointly Mitigating Factuality and Faithfulness Hallucinations in LLMs
- NeurIPS 2025Online Inverse Linear Optimization: Efficient Logarithmic-Regret Algorithm, Robustness to Suboptimality, and Lower Bound
- NeurIPS 2025Online Strategic Classification With Noise and Partial Feedback
- NeurIPS 2025OpenOmni: Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Real-time Emotional Speech Synthesis
- NeurIPS 2025Optimality and NP-Hardness of Transformers in Learning Markovian Dynamical Functions
- NeurIPS 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization
- NeurIPS 2025Orthogonal Contrastive Learning for Multi-Representation fMRI Analysis
- NeurIPS 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents
- NeurIPS 2025Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning
- NeurIPS 2025OVERT: A Benchmark for Over-Refusal Evaluation on Text-to-Image Models
- NeurIPS 2025Pairwise Calibrated Rewards for Pluralistic Alignment
- NeurIPS 2025Panacea: Mitigating Harmful Fine-tuning for Large Language Models via Post-fine-tuning Perturbation
Ask about this trend from Claude or Cursor
Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.
Copy this prompt into your assistant
Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.
Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}
Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)
FAQ
- How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
- 4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
- How many Alignment and Safety papers are at NeurIPS 2026?
- NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
- How many Alignment and Safety papers are at ICLR 2026?
- ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
- How many Alignment and Safety papers are at ICML 2026?
- ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
- How many Alignment and Safety papers are at CVPR 2026?
- CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
- Which conference publishes the most Alignment and Safety papers?
- NeurIPS, with 1,421 papers from 2023 to 2026.