Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

473 papers, page 9 of 10

  1. ICLR 2025Spurious Forgetting in Continual Learning of Language Models
  2. ICLR 2025Stealthy Shield Defense: A Conditional Mutual Information-Based Approach against Black-Box Model Inversion Attacks
  3. ICLR 2025Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Prediction
  4. ICLR 2025Strategic Classification With Externalities
  5. ICLR 2025Strong Preferences Affect the Robustness of Preference Models and Value Alignment
  6. ICLR 2025Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking
  7. ICLR 2025Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization
  8. ICLR 2025SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  9. ICLR 2025Support is All You Need for Certified VAE Training
  10. ICLR 2025Surgical, Cheap, and Flexible: Mitigating False Refusal in Language Models via Single Vector Ablation
  11. ICLR 2025Tailoring Mixup to Data for Calibration
  12. ICLR 2025Taming Overconfidence in LLMs: Reward Calibration in RLHF
  13. ICLR 2025Tamper-Resistant Safeguards for Open-Weight LLMs
  14. ICLR 2025TASAR: Transfer-based Attack on Skeletal Action Recognition
  15. ICLR 2025Test-time Adaptation for Regression by Subspace Alignment
  16. ICLR 2025Test-time Alignment of Diffusion Models without Reward Over-optimization
  17. ICLR 2025The Crucial Role of Samplers in Online Direct Preference Optimization
  18. ICLR 2025The Effectiveness of Curvature-Based Rewiring and the Role of Hyperparameters in GNNs Revisited
  19. ICLR 2025The Geometry of Categorical and Hierarchical Concepts in Large Language Models
  20. ICLR 2025The Hidden Cost of Waiting for Accurate Predictions
  21. ICLR 2025The Last Iterate Advantage: Empirical Auditing and Principled Heuristic Analysis of Differentially Private SGD
  22. ICLR 2025The Optimization Landscape of SGD Across the Feature Learning Strength
  23. ICLR 2025The Utility and Complexity of In- and Out-of-Distribution Machine Unlearning
  24. ICLR 2025Tighter Privacy Auditing of DP-SGD in the Hidden State Threat Model
  25. ICLR 2025TIS-DPO: Token-level Importance Sampling for Direct Preference Optimization With Estimated Weights
  26. ICLR 2025To Tackle Adversarial Transferability: A Novel Ensemble Training Method with Fourier Transformation
  27. ICLR 2025To Trust or Not to Trust? Enhancing Large Language Models' Situated Faithfulness to External Contexts
  28. ICLR 2025TODO: Enhancing LLM Alignment with Ternary Preferences
  29. ICLR 2025Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment
  30. ICLR 2025Towards a learning theory of representation alignment
  31. ICLR 2025Towards Certification of Uncertainty Calibration under Adversarial Attacks
  32. ICLR 2025Towards counterfactual fairness through auxiliary variables
  33. ICLR 2025Towards Effective Evaluations and Comparisons for LLM Unlearning Methods
  34. ICLR 2025Towards Federated RLHF with Aggregated Client Preference for LLMs
  35. ICLR 2025Towards hyperparameter-free optimization with differential privacy
  36. ICLR 2025Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimization
  37. ICLR 2025Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMs
  38. ICLR 2025Towards Scalable Exact Machine Unlearning Using Parameter-Efficient Fine-Tuning
  39. ICLR 2025Towards Understanding Why Label Smoothing Degrades Selective Classification and How to Fix It
  40. ICLR 2025TPO: Aligning Large Language Models with Multi-branch & Multi-step Preference Trees
  41. ICLR 2025Tracing Representation Progression: Analyzing and Enhancing Layer-Wise Similarity
  42. ICLR 2025Training Robust Ensembles Requires Rethinking Lipschitz Continuity
  43. ICLR 2025Training-Free Diffusion Model Alignment with Sampling Demons
  44. ICLR 2025Training-free LLM-generated Text Detection by Mining Token Probability Sequences
  45. ICLR 2025Transformers Learn Low Sensitivity Functions: Investigations and Implications
  46. ICLR 2025Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement
  47. ICLR 2025Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimization
  48. ICLR 2025Uncertainty and Influence aware Reward Model Refinement for Reinforcement Learning from Human Feedback
  49. ICLR 2025Uncovering Gaps in How Humans and LLMs Interpret Subjective Language
  50. ICLR 2025Understanding and Enhancing Safety Mechanisms of LLMs via Safety-Specific Neuron

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI