Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

1,363 papers, page 11 of 28

  1. ICLR 2025Robust System Identification: Finite-sample Guarantees and Connection to Regularization
  2. ICLR 2025Robustness Inspired Graph Backdoor Defense
  3. ICLR 2025Round and Round We Go! What makes Rotary Positional Encodings useful?
  4. ICLR 2025RouteLLM: Learning to Route LLMs from Preference Data
  5. ICLR 2025RRM: Robust Reward Model Training Mitigates Reward Hacking
  6. ICLR 2025SafeDiffuser: Safe Planning with Diffusion Probabilistic Models
  7. ICLR 2025Safety Alignment Should be Made More Than Just a Few Tokens Deep
  8. ICLR 2025Safety Layers in Aligned Large Language Models: The Key to LLM Security
  9. ICLR 2025SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanations
  10. ICLR 2025Sail into the Headwind: Alignment via Robust Rewards and Dynamic Labels against Reward Hacking
  11. ICLR 2025SaLoRA: Safety-Alignment Preserved Low-Rank Adaptation
  12. ICLR 2025Scalable Extraction of Training Data from Aligned, Production Language Models
  13. ICLR 2025Scaling up the Banded Matrix Factorization Mechanism for Large Scale Differentially Private ML
  14. ICLR 2025SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection
  15. ICLR 2025SEBRA : Debiasing through Self-Guided Bias Ranking
  16. ICLR 2025SecureGS: Boosting the Security and Fidelity of 3D Gaussian Splatting Steganography
  17. ICLR 2025Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models
  18. ICLR 2025Selective Unlearning via Representation Erasure Using Domain Adversarial Training
  19. ICLR 2025Self-Boosting Large Language Models with Synthetic Preference Data
  20. ICLR 2025SELF-EVOLVED REWARD LEARNING FOR LLMS
  21. ICLR 2025Self-Improvement in Language Models: The Sharpening Mechanism
  22. ICLR 2025Self-Improving Robust Preference Optimization
  23. ICLR 2025Self-Play Preference Optimization for Language Model Alignment
  24. ICLR 2025Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models
  25. ICLR 2025Sensitivity Verification for Additive Decision Tree Ensembles
  26. ICLR 2025SeRA: Self-Reviewing and Alignment of LLMs using Implicit Reward Margins
  27. ICLR 2025Severing Spurious Correlations with Data Pruning
  28. ICLR 2025Shape as Line Segments: Accurate and Flexible Implicit Surface Representation
  29. ICLR 2025Shh, don't say that! Domain Certification in LLMs
  30. ICLR 2025SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters
  31. ICLR 2025Simple yet Effective Incomplete Multi-view Clustering: Similarity-level Imputation and Intra-view Hybrid-group Prototype Construction
  32. ICLR 2025SimulPL: Aligning Human Preferences in Simultaneous Machine Translation
  33. ICLR 2025SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal
  34. ICLR 2025Sparse components distinguish visual pathways & their alignment to neural networks
  35. ICLR 2025Spread Preference Annotation: Direct Preference Judgment for Efficient LLM Alignment
  36. ICLR 2025Spurious Forgetting in Continual Learning of Language Models
  37. ICLR 2025Stealthy Shield Defense: A Conditional Mutual Information-Based Approach against Black-Box Model Inversion Attacks
  38. ICLR 2025Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Prediction
  39. ICLR 2025Strategic Classification With Externalities
  40. ICLR 2025Strong Preferences Affect the Robustness of Preference Models and Value Alignment
  41. ICLR 2025Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking
  42. ICLR 2025Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization
  43. ICLR 2025SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  44. ICLR 2025Support is All You Need for Certified VAE Training
  45. ICLR 2025Surgical, Cheap, and Flexible: Mitigating False Refusal in Language Models via Single Vector Ablation
  46. ICLR 2025Tailoring Mixup to Data for Calibration
  47. ICLR 2025Taming Overconfidence in LLMs: Reward Calibration in RLHF
  48. ICLR 2025Tamper-Resistant Safeguards for Open-Weight LLMs
  49. ICLR 2025TASAR: Transfer-based Attack on Skeletal Action Recognition
  50. ICLR 2025Test-time Adaptation for Regression by Subspace Alignment

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI