Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

1,339 papers, page 21 of 27

  1. ICLR 2025Scaling up the Banded Matrix Factorization Mechanism for Large Scale Differentially Private ML
  2. ICLR 2025SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection
  3. ICLR 2025SEBRA : Debiasing through Self-Guided Bias Ranking
  4. ICLR 2025SecureGS: Boosting the Security and Fidelity of 3D Gaussian Splatting Steganography
  5. ICLR 2025Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models
  6. ICLR 2025Selective Unlearning via Representation Erasure Using Domain Adversarial Training
  7. ICLR 2025Self-Boosting Large Language Models with Synthetic Preference Data
  8. ICLR 2025SELF-EVOLVED REWARD LEARNING FOR LLMS
  9. ICLR 2025Self-Improvement in Language Models: The Sharpening Mechanism
  10. ICLR 2025Self-Improving Robust Preference Optimization
  11. ICLR 2025Self-Play Preference Optimization for Language Model Alignment
  12. ICLR 2025Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models
  13. ICLR 2025Sensitivity Verification for Additive Decision Tree Ensembles
  14. ICLR 2025SeRA: Self-Reviewing and Alignment of LLMs using Implicit Reward Margins
  15. ICLR 2025Severing Spurious Correlations with Data Pruning
  16. ICLR 2025Shape as Line Segments: Accurate and Flexible Implicit Surface Representation
  17. ICLR 2025Shh, don't say that! Domain Certification in LLMs
  18. ICLR 2025SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters
  19. ICLR 2025Simple yet Effective Incomplete Multi-view Clustering: Similarity-level Imputation and Intra-view Hybrid-group Prototype Construction
  20. ICLR 2025SimulPL: Aligning Human Preferences in Simultaneous Machine Translation
  21. ICLR 2025SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal
  22. ICLR 2025Sparse components distinguish visual pathways & their alignment to neural networks
  23. ICLR 2025Spread Preference Annotation: Direct Preference Judgment for Efficient LLM Alignment
  24. ICLR 2025Spurious Forgetting in Continual Learning of Language Models
  25. ICLR 2025Stealthy Shield Defense: A Conditional Mutual Information-Based Approach against Black-Box Model Inversion Attacks
  26. ICLR 2025Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Prediction
  27. ICLR 2025Strategic Classification With Externalities
  28. ICLR 2025Strong Preferences Affect the Robustness of Preference Models and Value Alignment
  29. ICLR 2025Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking
  30. ICLR 2025Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization
  31. ICLR 2025SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  32. ICLR 2025Support is All You Need for Certified VAE Training
  33. ICLR 2025Surgical, Cheap, and Flexible: Mitigating False Refusal in Language Models via Single Vector Ablation
  34. ICLR 2025Tailoring Mixup to Data for Calibration
  35. ICLR 2025Taming Overconfidence in LLMs: Reward Calibration in RLHF
  36. ICLR 2025Tamper-Resistant Safeguards for Open-Weight LLMs
  37. ICLR 2025TASAR: Transfer-based Attack on Skeletal Action Recognition
  38. ICLR 2025Test-time Adaptation for Regression by Subspace Alignment
  39. ICLR 2025Test-time Alignment of Diffusion Models without Reward Over-optimization
  40. ICLR 2025The Crucial Role of Samplers in Online Direct Preference Optimization
  41. ICLR 2025The Effectiveness of Curvature-Based Rewiring and the Role of Hyperparameters in GNNs Revisited
  42. ICLR 2025The Geometry of Categorical and Hierarchical Concepts in Large Language Models
  43. ICLR 2025The Hidden Cost of Waiting for Accurate Predictions
  44. ICLR 2025The Last Iterate Advantage: Empirical Auditing and Principled Heuristic Analysis of Differentially Private SGD
  45. ICLR 2025The Optimization Landscape of SGD Across the Feature Learning Strength
  46. ICLR 2025The Utility and Complexity of In- and Out-of-Distribution Machine Unlearning
  47. ICLR 2025Tighter Privacy Auditing of DP-SGD in the Hidden State Threat Model
  48. ICLR 2025TIS-DPO: Token-level Importance Sampling for Direct Preference Optimization With Estimated Weights
  49. ICLR 2025To Tackle Adversarial Transferability: A Novel Ensemble Training Method with Fourier Transformation
  50. ICLR 2025To Trust or Not to Trust? Enhancing Large Language Models' Situated Faithfulness to External Contexts

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI