Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

4,558 papers, page 49 of 92

  1. ICLR 2025Self-Boosting Large Language Models with Synthetic Preference Data
  2. ICLR 2025SELF-EVOLVED REWARD LEARNING FOR LLMS
  3. ICLR 2025Self-Improvement in Language Models: The Sharpening Mechanism
  4. ICLR 2025Self-Improving Robust Preference Optimization
  5. ICLR 2025Self-Play Preference Optimization for Language Model Alignment
  6. ICLR 2025Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models
  7. ICLR 2025Sensitivity Verification for Additive Decision Tree Ensembles
  8. ICLR 2025SeRA: Self-Reviewing and Alignment of LLMs using Implicit Reward Margins
  9. ICLR 2025Severing Spurious Correlations with Data Pruning
  10. ICLR 2025Shape as Line Segments: Accurate and Flexible Implicit Surface Representation
  11. ICLR 2025Shh, don't say that! Domain Certification in LLMs
  12. ICLR 2025SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters
  13. ICLR 2025Simple yet Effective Incomplete Multi-view Clustering: Similarity-level Imputation and Intra-view Hybrid-group Prototype Construction
  14. ICLR 2025SimulPL: Aligning Human Preferences in Simultaneous Machine Translation
  15. ICLR 2025SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal
  16. ICLR 2025Sparse components distinguish visual pathways & their alignment to neural networks
  17. ICLR 2025Spread Preference Annotation: Direct Preference Judgment for Efficient LLM Alignment
  18. ICLR 2025Spurious Forgetting in Continual Learning of Language Models
  19. ICLR 2025Stealthy Shield Defense: A Conditional Mutual Information-Based Approach against Black-Box Model Inversion Attacks
  20. ICLR 2025Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Prediction
  21. ICLR 2025Strategic Classification With Externalities
  22. ICLR 2025Strong Preferences Affect the Robustness of Preference Models and Value Alignment
  23. ICLR 2025Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking
  24. ICLR 2025Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization
  25. ICLR 2025SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  26. ICLR 2025Support is All You Need for Certified VAE Training
  27. ICLR 2025Surgical, Cheap, and Flexible: Mitigating False Refusal in Language Models via Single Vector Ablation
  28. ICLR 2025Tailoring Mixup to Data for Calibration
  29. ICLR 2025Taming Overconfidence in LLMs: Reward Calibration in RLHF
  30. ICLR 2025Tamper-Resistant Safeguards for Open-Weight LLMs
  31. ICLR 2025TASAR: Transfer-based Attack on Skeletal Action Recognition
  32. ICLR 2025Test-time Adaptation for Regression by Subspace Alignment
  33. ICLR 2025Test-time Alignment of Diffusion Models without Reward Over-optimization
  34. ICLR 2025The Crucial Role of Samplers in Online Direct Preference Optimization
  35. ICLR 2025The Effectiveness of Curvature-Based Rewiring and the Role of Hyperparameters in GNNs Revisited
  36. ICLR 2025The Geometry of Categorical and Hierarchical Concepts in Large Language Models
  37. ICLR 2025The Hidden Cost of Waiting for Accurate Predictions
  38. ICLR 2025The Last Iterate Advantage: Empirical Auditing and Principled Heuristic Analysis of Differentially Private SGD
  39. ICLR 2025The Optimization Landscape of SGD Across the Feature Learning Strength
  40. ICLR 2025The Utility and Complexity of In- and Out-of-Distribution Machine Unlearning
  41. ICLR 2025Tighter Privacy Auditing of DP-SGD in the Hidden State Threat Model
  42. ICLR 2025TIS-DPO: Token-level Importance Sampling for Direct Preference Optimization With Estimated Weights
  43. ICLR 2025To Tackle Adversarial Transferability: A Novel Ensemble Training Method with Fourier Transformation
  44. ICLR 2025To Trust or Not to Trust? Enhancing Large Language Models' Situated Faithfulness to External Contexts
  45. ICLR 2025TODO: Enhancing LLM Alignment with Ternary Preferences
  46. ICLR 2025Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment
  47. ICLR 2025Towards a learning theory of representation alignment
  48. ICLR 2025Towards Certification of Uncertainty Calibration under Adversarial Attacks
  49. ICLR 2025Towards counterfactual fairness through auxiliary variables
  50. ICLR 2025Towards Effective Evaluations and Comparisons for LLM Unlearning Methods

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI