Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

1,339 papers, page 1 of 27

  1. ICLR 2026(Token-Level) \textbf{InfoRMIA}: Stronger Membership Inference and Privacy Assessment for LLMs
  2. ICLR 2026$\alpha$-DPO: Robust Preference Alignment for Diffusion Models via $\alpha$ Divergence
  3. ICLR 2026A Fair Bayesian Inference through Matched Gibbs Posterior
  4. ICLR 2026A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
  5. ICLR 2026A Guardrail for Safety Preservation: When Safety-Sensitive Subspace Meets Harmful-Resistant Null-Space
  6. ICLR 2026A Unified Total Variation Framework for Membrane Potential Perturbation Dynamic
  7. ICLR 2026A2D: Any-Order, Any-Step Safety Alignment for Diffusion Language Models
  8. ICLR 2026Activation Steering for LLM Alignment via a Unified ODE-Based Framework
  9. ICLR 2026Activation Steering with a Feedback Controller
  10. ICLR 2026ActiveDPO: Active Direct Preference Optimization for Sample-Efficient Alignment
  11. ICLR 2026AdAEM: An Adaptively and Automated Extensible Evaluation Method of LLMs' Value Difference
  12. ICLR 2026Adaptive Attacks on Trusted Monitors Subvert AI Control Protocols
  13. ICLR 2026Adaptive Data-Knowledge Alignment in Genetic Perturbation Prediction
  14. ICLR 2026Adaptive Social Learning via Mode Policy Optimization for Language Agents
  15. ICLR 2026AdPO: Enhancing the Adversarial Robustness of Large Vision-Language Models with Preference Optimization
  16. ICLR 2026AdvChain: Adversarial Chain-of-Thought Tuning for Robust Safety Alignment of Large Reasoning Models
  17. ICLR 2026Adversarial Déjà Vu: Jailbreak Dictionary Learning for Stronger Generalization to Unseen Attacks
  18. ICLR 2026Align Once, Benefit Multilingually: Enforcing Multilingual Consistency for LLM Safety Alignment
  19. ICLR 2026Align to Misalign: Automatic LLM Jailbreak with Meta-Optimized LLM Judges
  20. ICLR 2026Align-SAM: Seeking Flatter Minima for Better Cross-Subset Alignment
  21. ICLR 2026Aligner, Diagnose Thyself: A Meta-Learning Paradigm for Fusing Intrinsic Feedback in Preference Alignment
  22. ICLR 2026Aligning Collaborative View Recovery and Tensorial Subspace Learning via Latent Representation for Incomplete Multi-View Clustering
  23. ICLR 2026Aligning Deep Implicit Preferences by Learning to Reason Defensively
  24. ICLR 2026Alignment through Meta-Weighted Online Sampling: Bridging the Gap between Data Generation and Preference Optimization
  25. ICLR 2026Alignment-Enhanced Integration of Connectivity and Spectral Sparse in Dynamic Sparse Training of LLM
  26. ICLR 2026Alignment-Weighted DPO: A principled reasoning approach to improve alignment
  27. ICLR 2026AlignSep: Temporally-Aligned Video-Queried Sound Separation with Flow Matching
  28. ICLR 2026All Code, No Thought: Language Models Struggle to Reason in Ciphered Language
  29. ICLR 2026All Roads Lead to Likelihood: The Value of Reinforcement Learning in Fine-Tuning
  30. ICLR 2026AlphaAlign: Incentivizing Safety Alignment with Extremely Simplified Reinforcement Learning
  31. ICLR 2026AlphaSteer: Learning Refusal Steering with Principled Null-Space Constraint
  32. ICLR 2026Annotation-Efficient Honesty Alignment via Confidence Elicitation and Calibration
  33. ICLR 2026Antibody: Strengthening Defense Against Harmful Fine-Tuning for Large Language Models via Attenuating Harmful Gradient Influence
  34. ICLR 2026Antislop: A Comprehensive Framework for Identifying and Eliminating Repetitive Patterns in Language Models
  35. ICLR 2026Any-Depth Alignment: Unlocking Innate Safety Alignment of LLMs to Any-Depth
  36. ICLR 2026Architecture-Agnostic Test-Time Adaptation via Backprop-Free Embedding Alignment
  37. ICLR 2026Are Deep Speech Denoising Models Robust to Adversarial Noise?
  38. ICLR 2026ARMOR: Aligning Secure and Safe Large Language Models via Meticulous Reasoning
  39. ICLR 2026ARMs: Adaptive Red-Teaming Agent against Multimodal Models with Plug-and-Play Attacks
  40. ICLR 2026ASGuard: Activation-Scaling Guard to Mitigate Targeted Jailbreaking Attack
  41. ICLR 2026ASIDE: Architectural Separation of Instructions and Data in Language Models
  42. ICLR 2026Asymptotic analysis of shallow and deep forgetting in replay with neural collapse
  43. ICLR 2026Asynchronous Denoising Diffusion Models for Aligning Text-to-Image Generation
  44. ICLR 2026Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coin
  45. ICLR 2026Attention Smoothing Is All You Need For Unlearning
  46. ICLR 2026AttriCtrl: A Generalizable Framework for Controlling Semantic Attribute Intensity in Diffusion Models
  47. ICLR 2026AttTok: Marrying Attribute Tokens with Generative Pre-trained Vision-Language Models towards Medical Image Understanding
  48. ICLR 2026Auditing Black-Box LLM APIs with a Rank-Based Uniformity Test
  49. ICLR 2026Auto-RT: Automatic Jailbreak Strategy Exploration for Red-Teaming Large Language Models
  50. ICLR 2026Automatic Dialectic Jailbreak: A Framework for Generating Effective Jailbreak Strategies

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI