Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

4,558 papers, page 14 of 92

  1. ICLR 2026Private Rate-Constrained Optimization with Applications to Fair Learning
  2. ICLR 2026PromptHub: Enhancing Multi-Prompt Visual In-Context Learning with Locality-Aware Fusion, Concentration and Alignment
  3. ICLR 2026Propaganda AI: An Analysis of Semantic Divergence in Large Language Models
  4. ICLR 2026PropensityBench: Evaluating Latent Safety Risks in Large Language Models via an Agentic Approach
  5. ICLR 2026Property-Driven Protein Inverse Folding with Multi-Objective Preference Alignment
  6. ICLR 2026ProSafePrune: Projected Safety Pruning for Mitigating Over-Refusal in LLMs
  7. ICLR 2026Protection against Source Inference Attacks in Federated Learning
  8. ICLR 2026Pruning Long Chain-of-Thought of Large Reasoning Models via Small-Scale Preference Optimization
  9. ICLR 2026REAL: Reading Out Transformer Activations for Precise Localization in Language Model Steering
  10. ICLR 2026Reasoned Safety Alignment: Ensuring Jailbreak Defense via Answer-Then-Check
  11. ICLR 2026Reasoning Boosts Opinion Alignment in LLMs
  12. ICLR 2026RedCodeAgent: Automatic Red-teaming Agent against Diverse Code Agents
  13. ICLR 2026RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments
  14. ICLR 2026Reducing information dependency does not cause training data privacy. Adversarially non-robust features do.
  15. ICLR 2026References Improve LLM Alignment in Non-Verifiable Domains
  16. ICLR 2026Regulating Internal Evidence Flows for Robust Learning Under Spurious Correlations
  17. ICLR 2026Reinforcement Learning Fine-Tuning Enhances Activation Intensity and Diversity in the Internal Circuitry of LLMs
  18. ICLR 2026Reinforcement Unlearning via Group Relative Policy Optimization
  19. ICLR 2026Relationship Alignment for View-aware Multi-view Clustering
  20. ICLR 2026RelayFormer: A Unified Local-Global Attention Framework for Scalable Image and Video Manipulation Localization
  21. ICLR 2026Reliable Poisoned Sample Detection against Backdoor Attacks Enhanced by Sharpness Aware Minimization
  22. ICLR 2026Reliable Weak-to-Strong Monitoring of LLM Agents
  23. ICLR 2026RepIt: Steering Language Models with Concept-Specific Refusal Vectors
  24. ICLR 2026Representation Alignment for Diffusion Transformers without External Components
  25. ICLR 2026Representational Alignment Across Model Layers and Brain Regions with Hierarchical Optimal Transport
  26. ICLR 2026RESFL: An Uncertainty-Aware Framework for Responsible Federated Learning by Balancing Privacy, Fairness and Utility
  27. ICLR 2026Rethinking Benign Relearning: Syntax as the Hidden Driver of Unlearning Failures
  28. ICLR 2026Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models
  29. ICLR 2026Rethinking LoRA for Privacy-Preserving Federated Learning in Large Models
  30. ICLR 2026Rethinking Pareto Frontier: On the Optimal Trade-offs in Fair Classification
  31. ICLR 2026Rethinking Radiology Report Generation: From Narrative Flow to Topic-Guided Findings
  32. ICLR 2026Rethinking the Gold Standard: Why Discrete Curvature Fails to Fully Capture Over-squashing in GNNs?
  33. ICLR 2026Reward Model Routing in Alignment
  34. ICLR 2026Reward Models Inherit Value Biases from Pretraining
  35. ICLR 2026RewardEval: Advancing Reward Model Evaluation
  36. ICLR 2026Riemannian Optimization on Relaxed Indicator Matrix Manifold
  37. ICLR 2026Risk Phase Transitions in Spiked Regression: Alignment Driven Benign and Catastrophic Overfitting
  38. ICLR 2026Risk-Sensitive Agent Compositions
  39. ICLR 2026RLBFF: Binary Flexible Feedback to bridge between Human Feedback & Verifiable Rewards
  40. ICLR 2026Robust Adversarial Attacks Against Unknown Disturbance via Inverse Gradient Sample
  41. ICLR 2026Robust LLM Unlearning via Post Judgment and Multi-round Thinking
  42. ICLR 2026Robust Multi-Objective Controlled Decoding of Large Language Models
  43. ICLR 2026Robust Preference Alignment via Directional Neighborhood Consensus
  44. ICLR 2026Robust Preference Optimization: Aligning Language Models with Noisy Preference Feedback
  45. ICLR 2026Robust Reward Modeling via Causal Rubrics
  46. ICLR 2026Routing Manifold Alignment Improves Generalization of Mixture-of-Experts LLMs
  47. ICLR 2026Routing, Cascades, and User Choice for LLMs
  48. ICLR 2026Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domains
  49. ICLR 2026SafeDialBench: A Fine-Grained Safety Evaluation Benchmark for Large Language Models in Multi-Turn Dialogues with Diverse Jailbreak Attacks
  50. ICLR 2026SafeDPO: A Simple Approach to Direct Preference Optimization with Enhanced Safety

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI