Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

246 papers, page 3 of 5

  1. ICML 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study
  2. ICML 2024Iterative Data Smoothing: Mitigating Reward Overfitting and Overoptimization in RLHF
  3. ICML 2024Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-constraint
  4. ICML 2024Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization
  5. ICML 2024Junk DNA Hypothesis: Pruning Small Pre-Trained Weights $\textit{Irreversibly}$ and $\textit{Monotonically}$ Impairs ``Difficult" Downstream Tasks in LLMs
  6. ICML 2024KISA: A Unified Keyframe Identifier and Skill Annotator for Long-Horizon Robotics Demonstrations
  7. ICML 2024Language Models Represent Beliefs of Self and Others
  8. ICML 2024LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging
  9. ICML 2024Learning and Forgetting Unsafe Examples in Large Language Models
  10. ICML 2024Learning Associative Memories with Gradient Descent
  11. ICML 2024Learning Decision Trees and Forests with Algorithmic Recourse
  12. ICML 2024Learning in Feature Spaces via Coupled Covariances: Asymmetric Kernel SVD and Nyström method
  13. ICML 2024Learning Linear Block Error Correction Codes
  14. ICML 2024Learning Modality Knowledge Alignment for Cross-Modality Transfer
  15. ICML 2024Learning Reward for Robot Skills Using Large Language Models via Self-Alignment
  16. ICML 2024Learning to Remove Cuts in Integer Linear Programming
  17. ICML 2024Learning with 3D rotations, a hitchhiker's guide to SO(3)
  18. ICML 2024Limited Preference Aided Imitation Learning from Imperfect Demonstrations
  19. ICML 2024Linear Alignment: A Closed-form Solution for Aligning Human Preferences without Tuning and Feedback
  20. ICML 2024Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning
  21. ICML 2024Look Ahead or Look Around? A Theoretical Comparison Between Autoregressive and Masked Pretraining
  22. ICML 2024MaxMin-RLHF: Alignment with Diverse Human Preferences
  23. ICML 2024Mean-field Underdamped Langevin Dynamics and its Spacetime Discretization
  24. ICML 2024MGit: A Model Versioning and Management System
  25. ICML 2024Minimally Modifying a Markov Game to Achieve Any Nash Equilibrium and Value
  26. ICML 2024MLI Formula: A Nearly Scale-Invariant Solution with Noise Perturbation
  27. ICML 2024Model Alignment as Prospect Theoretic Optimization
  28. ICML 2024Model Assessment and Selection under Temporal Distribution Shift
  29. ICML 2024Momentum Particle Maximum Likelihood
  30. ICML 2024Monotone, Bi-Lipschitz, and Polyak-Łojasiewicz Networks
  31. ICML 2024Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-Loop and Hessian-Free Solution Strategy
  32. ICML 2024MusicRL: Aligning Music Generation to Human Preferences
  33. ICML 2024Naive Bayes Classifiers over Missing Data: Decision and Poisoning
  34. ICML 2024Nash Learning from Human Feedback
  35. ICML 2024Noise-Adaptive Confidence Sets for Linear Bandits and Application to Bayesian Optimization
  36. ICML 2024Nonlinear Filtering with Brenier Optimal Transport Maps
  37. ICML 2024ODIN: Disentangled Reward Mitigates Hacking in RLHF
  38. ICML 2024On Stronger Computational Separations Between Multimodal and Unimodal Machine Learning
  39. ICML 2024On the Convergence of Projected Bures-Wasserstein Gradient Descent under Euclidean Strong Convexity
  40. ICML 2024On the Duality Between Sharpness-Aware Minimization and Adversarial Training
  41. ICML 2024One for All: A Universal Generator for Concept Unlearnability via Multi-Modal Alignment
  42. ICML 2024Optimal Acceleration for Minimax and Fixed-Point Problems is Not Unique
  43. ICML 2024Optimal Exact Recovery in Semi-Supervised Learning: A Study of Spectral Methods and Graph Convolutional Networks
  44. ICML 2024OptiMUS: Scalable Optimization Modeling with (MI)LP Solvers and Large Language Models
  45. ICML 2024OSSCAR: One-Shot Structured Pruning in Vision and Language Models with Combinatorial Optimization
  46. ICML 2024OT-CLIP: Understanding and Generalizing CLIP via Optimal Transport
  47. ICML 2024Overcoming Data and Model heterogeneities in Decentralized Federated Learning via Synthetic Anchors
  48. ICML 2024Pairwise Alignment Improves Graph Domain Adaptation
  49. ICML 2024PARDEN, Can You Repeat That? Defending against Jailbreaks via Repetition
  50. ICML 2024PEARL: Zero-shot Cross-task Preference Alignment and Robust Reward Learning for Robotic Manipulation

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI