Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

4,558 papers, page 50 of 92

  1. ICLR 2025Towards Federated RLHF with Aggregated Client Preference for LLMs
  2. ICLR 2025Towards hyperparameter-free optimization with differential privacy
  3. ICLR 2025Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimization
  4. ICLR 2025Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMs
  5. ICLR 2025Towards Scalable Exact Machine Unlearning Using Parameter-Efficient Fine-Tuning
  6. ICLR 2025Towards Understanding Why Label Smoothing Degrades Selective Classification and How to Fix It
  7. ICLR 2025TPO: Aligning Large Language Models with Multi-branch & Multi-step Preference Trees
  8. ICLR 2025Tracing Representation Progression: Analyzing and Enhancing Layer-Wise Similarity
  9. ICLR 2025Training Robust Ensembles Requires Rethinking Lipschitz Continuity
  10. ICLR 2025Training-Free Diffusion Model Alignment with Sampling Demons
  11. ICLR 2025Training-free LLM-generated Text Detection by Mining Token Probability Sequences
  12. ICLR 2025Transformers Learn Low Sensitivity Functions: Investigations and Implications
  13. ICLR 2025Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement
  14. ICLR 2025Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimization
  15. ICLR 2025Uncertainty and Influence aware Reward Model Refinement for Reinforcement Learning from Human Feedback
  16. ICLR 2025Uncovering Gaps in How Humans and LLMs Interpret Subjective Language
  17. ICLR 2025Understanding and Enhancing Safety Mechanisms of LLMs via Safety-Specific Neuron
  18. ICLR 2025Understanding and Enhancing the Transferability of Jailbreaking Attacks
  19. ICLR 2025Understanding the Generalization of In-Context Learning in Transformers: An Empirical Study
  20. ICLR 2025UniDetox: Universal Detoxification of Large Language Models via Dataset Distillation
  21. ICLR 2025Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  22. ICLR 2025Unlearn and Burn: Adversarial Machine Unlearning Requests Destroy Model Accuracy
  23. ICLR 2025Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearning
  24. ICLR 2025Utility-Directed Conformal Prediction: A Decision-Aware Framework for Actionable Uncertainty Quantification
  25. ICLR 2025Value-aligned Behavior Cloning for Offline Reinforcement Learning via Bi-level Optimization
  26. ICLR 2025Value-Incentivized Preference Optimization: A Unified Approach to Online and Offline RLHF
  27. ICLR 2025Variational Best-of-N Alignment
  28. ICLR 2025Varying Shades of Wrong: Aligning LLMs with Wrong Answers Only
  29. ICLR 2025VibeCheck: Discover and Quantify Qualitative Differences in Large Language Models
  30. ICLR 2025VideoPhy: Evaluating Physical Commonsense for Video Generation
  31. ICLR 2025VideoShield: Regulating Diffusion-based Video Generation Models via Watermarking
  32. ICLR 2025Vision CNNs trained to estimate spatial latents learned similar ventral-stream-aligned representations
  33. ICLR 2025Walk the Talk? Measuring the Faithfulness of Large Language Model Explanations
  34. ICLR 2025Wasserstein Distances, Neuronal Entanglement, and Sparsity
  35. ICLR 2025Weak-to-Strong Preference Optimization: Stealing Reward from Weak Aligned Model
  36. ICLR 2025Weighted-Reward Preference Optimization for Implicit Model Fusion
  37. ICLR 2025Wicked Oddities: Selectively Poisoning for Effective Clean-Label Backdoor Attacks
  38. ICLR 2025X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scale
  39. ICLR 2025Your Weak LLM is Secretly a Strong Teacher for Alignment
  40. ICLR 2025Zeroth-Order Policy Gradient for Reinforcement Learning from Human Feedback without Reward Inference
  41. ICML 2025$\mathcal{V}ista\mathcal{DPO}$: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Models
  42. ICML 2025$S^2$FGL: Spatial Spectral Federated Graph Learning
  43. ICML 2025A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment
  44. ICML 2025A Generic Family of Graphical Models: Diversity, Efficiency, and Heterogeneity
  45. ICML 2025A Physics-Informed Machine Learning Framework for Safe and Optimal Control of Autonomous Systems
  46. ICML 2025A Unified Framework for Entropy Search and Expected Improvement in Bayesian Optimization
  47. ICML 2025A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO
  48. ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
  49. ICML 2025Achieving Linear Speedup and Near-Optimal Complexity for Decentralized Optimization over Row-stochastic Networks
  50. ICML 2025Activation Space Interventions Can Be Transferred Between Large Language Models

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI