Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

623 papers, page 8 of 13

  1. ICLR 2026More Than What Was Chosen: LLM-based Explainable Recommendation Beyond Noisy User Preferences
  2. ICLR 2026MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes
  3. ICLR 2026mR3: Multilingual Rubric-Agnostic Reward Reasoning Models
  4. ICLR 2026Multi-Feature Quantized Self-Attention for Fair Large Language Models
  5. ICLR 2026Multi-objective Large Language Model Alignment with Hierarchical Experts
  6. ICLR 2026Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
  7. ICLR 2026Multiplayer Nash Preference Optimization
  8. ICLR 2026Narrow Finetuning Leaves Clearly Readable Traces in the Activation Differences
  9. ICLR 2026Nasty Adversarial Training: A Probability Sparsity Perspective for Robustness Enhancement
  10. ICLR 2026NDAD: Negative-Direction Aware Decoding for Large Language Models via Controllable Hallucination Signal Injection
  11. ICLR 2026Neologism Learning for Controllability and Self-Verbalization
  12. ICLR 2026NeuCLIP: Efficient Large-Scale CLIP Training with Neural Normalizer Optimization
  13. ICLR 2026No, of Course I Can! Deeper Fine-Tuning Attacks That Bypass Token-Level Safety Mechanisms
  14. ICLR 2026Noisy-Pair Robust Representation Alignment for Positive-Unlabeled Learning
  15. ICLR 2026Non-Clashing Teaching in Graphs: Algorithms, Complexity, and Bounds
  16. ICLR 2026NurValues: Real-World Nursing Values Evaluation for Large Language Models in Clinical Context
  17. ICLR 2026Obfuscated Activations Bypass LLM Latent-Space Defenses
  18. ICLR 2026Obscure but Effective: Classical Chinese Jailbreak Prompt Optimization via Bio-Inspired Search
  19. ICLR 2026OffTopicEval: When Large Language Models Enter the Wrong Chat, Almost Always!
  20. ICLR 2026OFMU: OPTIMIZATION-DRIVEN FRAMEWORK FOR MACHINE UNLEARNING
  21. ICLR 2026Omni-Reward: Towards Generalist Omni-Modal Reward Modeling with Free-Form Preferences
  22. ICLR 2026OmniPortrait: Fine-Grained Personalized Portrait Synthesis via Pivotal Optimization
  23. ICLR 2026On Fairness of Task Arithmetic: The Role of Task Vectors
  24. ICLR 2026On Optimal Hyperparameters for Differentially Private Deep Transfer Learning
  25. ICLR 2026On the Alignment Between Supervised and Self-Supervised Contrastive Learning
  26. ICLR 2026On the Impossibility of Separating Intelligence from Judgment: The Computational Intractability of Filtering for AI Alignment
  27. ICLR 2026On the Interaction of Compressibility and Adversarial Robustness
  28. ICLR 2026Only Brains Align with Brains: Cross-Region Patterns Expose Limits of Normative Models
  29. ICLR 2026OpenAgentSafety: A Comprehensive Framework For Evaluating Real-World AI Agent Safety
  30. ICLR 2026Operationalizing Data Minimization for Privacy-Preserving LLM Prompting
  31. ICLR 2026OPPO: Accelerating PPO-based RLHF via Pipeline Overlap
  32. ICLR 2026Optimal Transport-Induced Samples against Out-of-Distribution Overconfidence
  33. ICLR 2026Optimas: Optimizing Compound AI Systems with Globally Aligned Local Rewards
  34. ICLR 2026Optimizing Agent Planning for Security and Autonomy
  35. ICLR 2026Optimizing Canaries for Privacy Auditing with Metagradient Descent
  36. ICLR 2026Optimizing ID Consistency in Multimodal Large Models: Facial Restoration via Alignment, Entanglement, and Disentanglement
  37. ICLR 2026ORION: Decoupling and Alignment for Unified Autoregressive Understanding and Generation
  38. ICLR 2026OrthAlign: Orthogonal Subspace Decomposition for Non-Interfering Multi-Objective Alignment
  39. ICLR 2026Out of the Shadows: Exploring a Latent Space for Neural Network Verification
  40. ICLR 2026Output Supervision Can Obfuscate the Chain of Thought
  41. ICLR 2026Oversmoothing, "Oversquashing'', Heterophily, Long-Range, and more: Demystifying Common Beliefs in Graph Machine Learning
  42. ICLR 2026P-GenRM: Personalized Generative Reward Model with Test-time User-based Scaling
  43. ICLR 2026P$^2$-DPO:Grounding Hallucination in Perceptual Processing via Calibration Direct Preference Optimization
  44. ICLR 2026PACEbench: A Framework for Evaluating Practical AI Cyber-Exploitation Capabilities
  45. ICLR 2026PALC: Preference Alignment via Logit Calibration
  46. ICLR 2026PAMDP: Interact to Persona Alignment via a Partially Observable Markov Decision Process
  47. ICLR 2026Parameterized Hardness of Zonotope Containment and Neural Network Verification
  48. ICLR 2026PCPO: Proportionate Credit Policy Optimization for Preference Alignment of Image Generation Models
  49. ICLR 2026PE-SGD: Differentially Private Deep Learning via Evolution of Gradient Subspace for Text
  50. ICLR 2026Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Models

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI