Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

1,339 papers, page 13 of 27

  1. ICLR 2026WARP: Weight Teleportation for Attack-Resilient Unlearning Protocols
  2. ICLR 2026Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs
  3. ICLR 2026Watch your steps: Dormant Adversarial Behaviors that Activate upon LLM Finetuning
  4. ICLR 2026WaterDrum: Watermark-based Data-centric Unlearning Metric
  5. ICLR 2026Watermark-based Attribution of AI-Generated Content
  6. ICLR 2026Weak-to-Strong Generalization with Failure Trajectories
  7. ICLR 2026What Do Large Language Models Know About Opinions?
  8. ICLR 2026What happens when generative AI models train recursively on each others' outputs?
  9. ICLR 2026What matters for Representation Alignment: Global Information or Spatial Structure?
  10. ICLR 2026What's In My Human Feedback? Learning Interpretable Descriptions of Preference Data
  11. ICLR 2026What's the plan? Metrics for implicit planning in LLMs and their application to rhyme generation
  12. ICLR 2026When Data is the Algorithm: A Systematic Study and Curation of Preference Optimization Datasets
  13. ICLR 2026When Language Models Lose Their Mind: The Consequences of Brain Misalignment
  14. ICLR 2026When Machine Learning Gets Personal: Evaluating Prediction and Explanation
  15. ICLR 2026When Priors Backfire: On the Vulnerability of Unlearnable Examples to Pretraining
  16. ICLR 2026When Style Breaks Safety: Defending LLMs Against Superficial Style Alignment
  17. ICLR 2026When Weak LLMs Speak with Confidence, Preference Alignment Gets Stronger
  18. ICLR 2026Where Did It Go Wrong? Attributing Undesirable LLM Behaviors via Representation Gradient Tracing
  19. ICLR 2026Why DPO is a Misspecified Estimator and How to Fix It
  20. ICLR 2026Will AI Tell Lies to Save Sick Children? Litmus-Testing AI Values Prioritization with AIRiskDilemmas
  21. ICLR 2026Winter Soldier: Backdooring Language Models at Pre-Training with Indirect Data Poisoning
  22. ICLR 2026Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents
  23. ICLR 2026Zero-Sacrifice Persistent-Robustness Adversarial Defense for Pre-Trained Encoders
  24. ICLR 2025$\sigma$-zero: Gradient-based Optimization of $\ell_0$-norm Adversarial Examples
  25. ICLR 2025$R^2$-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoning
  26. ICLR 20253D-Properties: Identifying Challenges in DPO and Charting a Path Forward
  27. ICLR 2025A Benchmark for Semantic Sensitive Information in LLMs Outputs
  28. ICLR 2025A Black Swan Hypothesis: The Role of Human Irrationality in AI Safety
  29. ICLR 2025A Closer Look at Machine Unlearning for Large Language Models
  30. ICLR 2025A Common Pitfall of Margin-based Language Model Alignment: Gradient Entanglement
  31. ICLR 2025A Generic Framework for Conformal Fairness
  32. ICLR 2025A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language
  33. ICLR 2025A Probabilistic Perspective on Unlearning and Alignment for Large Language Models
  34. ICLR 2025A Simple yet Effective $\Delta\Delta G$ Predictor is An Unsupervised Antibody Optimizer and Explainer
  35. ICLR 2025A Theoretical Framework for Partially-Observed Reward States in RLHF
  36. ICLR 2025A Transfer Attack to Image Watermarks
  37. ICLR 2025A transfer learning framework for weak to strong generalization
  38. ICLR 2025ACC-Collab: An Actor-Critic Approach to Multi-Agent LLM Collaboration
  39. ICLR 2025Accelerating Training with Neuron Interaction and Nowcasting Networks
  40. ICLR 2025Activation Gradient based Poisoned Sample Detection Against Backdoor Attacks
  41. ICLR 2025Adam-mini: Use Fewer Learning Rates To Gain More
  42. ICLR 2025Adaptive Batch Size for Privately Finding Second-Order Stationary Points
  43. ICLR 2025Adaptive Deployment of Untrusted LLMs Reduces Distributed Threats
  44. ICLR 2025Adaptive Energy Alignment for Accelerating Test-Time Adaptation
  45. ICLR 2025Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control
  46. ICLR 2025Advancing LLM Reasoning Generalists with Preference Trees
  47. ICLR 2025Advantage-Guided Distillation for Preference Alignment in Small Language Models
  48. ICLR 2025Adversarial Attacks on Data Attribution
  49. ICLR 2025Adversarial Latent Feature Augmentation for Fairness
  50. ICLR 2025Adversarial Machine Unlearning

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI