Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

1,363 papers, page 13 of 28

  1. ICLR 2025Walk the Talk? Measuring the Faithfulness of Large Language Model Explanations
  2. ICLR 2025Wasserstein Distances, Neuronal Entanglement, and Sparsity
  3. ICLR 2025Weak-to-Strong Preference Optimization: Stealing Reward from Weak Aligned Model
  4. ICLR 2025Weighted-Reward Preference Optimization for Implicit Model Fusion
  5. ICLR 2025Wicked Oddities: Selectively Poisoning for Effective Clean-Label Backdoor Attacks
  6. ICLR 2025X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scale
  7. ICLR 2025Your Weak LLM is Secretly a Strong Teacher for Alignment
  8. ICLR 2025Zeroth-Order Policy Gradient for Reinforcement Learning from Human Feedback without Reward Inference
  9. ICML 2025$\mathcal{V}ista\mathcal{DPO}$: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Models
  10. ICML 2025$S^2$FGL: Spatial Spectral Federated Graph Learning
  11. ICML 2025A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment
  12. ICML 2025A Generic Family of Graphical Models: Diversity, Efficiency, and Heterogeneity
  13. ICML 2025A Physics-Informed Machine Learning Framework for Safe and Optimal Control of Autonomous Systems
  14. ICML 2025A Unified Framework for Entropy Search and Expected Improvement in Bayesian Optimization
  15. ICML 2025A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO
  16. ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
  17. ICML 2025Achieving Linear Speedup and Near-Optimal Complexity for Decentralized Optimization over Row-stochastic Networks
  18. ICML 2025Activation Space Interventions Can Be Transferred Between Large Language Models
  19. ICML 2025Active Reward Modeling: Adaptive Preference Labeling for Large Language Model Alignment
  20. ICML 2025Adapting While Learning: Grounding LLMs for Scientific Problems with Tool Usage Adaptation
  21. ICML 2025Adaptive Estimation and Learning under Temporal Distribution Shift
  22. ICML 2025Addressing Concept Mislabeling in Concept Bottleneck Models Through Preference Optimization
  23. ICML 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization
  24. ICML 2025AdvAgent: Controllable Blackbox Red-teaming on Web Agents
  25. ICML 2025Adversaries Can Misuse Combinations of Safe Models
  26. ICML 2025AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs
  27. ICML 2025AEQA-NAT : Adaptive End-to-end Quantization Alignment Training Framework for Non-autoregressive Machine Translation
  28. ICML 2025Aligning Multimodal Representations through an Information Bottleneck
  29. ICML 2025Aligning Spoken Dialogue Models from User Interactions
  30. ICML 2025Aligning with Logic: Measuring, Evaluating and Improving Logical Preference Consistency in Large Language Models
  31. ICML 2025AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
  32. ICML 2025AlphaPO: Reward Shape Matters for LLM Alignment
  33. ICML 2025AMPO: Active Multi Preference Optimization for Self-play Preference Selection
  34. ICML 2025Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-tuning Attack
  35. ICML 2025Assessing Safety Risks and Quantization-aware Safety Patching for Quantized Large Language Models
  36. ICML 2025Automated Red Teaming with GOAT: the Generative Offensive Agent Tester
  37. ICML 2025Avoiding Catastrophe in Online Learning by Asking for Help
  38. ICML 2025Bayesian Optimization from Human Feedback: Near-Optimal Regret Bounds
  39. ICML 2025BDC-CLIP: Brownian Distance Covariance for Adapting CLIP to Action Recognition
  40. ICML 2025Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safety
  41. ICML 2025Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment
  42. ICML 2025BILBO: BILevel Bayesian Optimization
  43. ICML 2025Boosting Adversarial Robustness with CLAT: Criticality Leveraged Adversarial Training
  44. ICML 2025BOPO: Neural Combinatorial Optimization via Best-anchored and Objective-guided Preference Optimization
  45. ICML 2025Bounded Rationality for LLMs: Satisficing Alignment at Inference-Time
  46. ICML 2025BounDr.E: Predicting Drug-likeness via Biomedical Knowledge Alignment and EM-like One-Class Boundary Optimization
  47. ICML 2025Breaking Barriers: Combinatorial Algorithms for Non-Monotone Submodular Maximization with Sublinear Adaptivity and $1/e$ Approximation
  48. ICML 2025Calibrated Language Models and How to Find Them with Label Smoothing
  49. ICML 2025Calibrating Video Watch-time Predictions with Credible Prototype Alignment
  50. ICML 2025Can RLHF be More Efficient with Imperfect Reward Models? A Policy Coverage Perspective

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI