Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

875 papers, page 10 of 18

  1. ICML 2024Private and Federated Stochastic Convex Optimization: Efficient Strategies for Centralized Systems
  2. ICML 2024Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo
  3. ICML 2024Promoting External and Internal Equities Under Ex-Ante/Ex-Post Metrics in Online Resource Allocation
  4. ICML 2024Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Prompts
  5. ICML 2024Provably Robust DPO: Aligning Language Models with Noisy Feedback
  6. ICML 2024Quality Diversity through Human Feedback: Towards Open-Ended Diversity-Driven Optimization
  7. ICML 2024Quality-Diversity with Limited Resources
  8. ICML 2024Quantum Algorithms and Lower Bounds for Finite-Sum Optimization
  9. ICML 2024QuIP$\#$: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks
  10. ICML 2024Random Exploration in Bayesian Optimization: Order-Optimal Regret and Computational Efficiency
  11. ICML 2024Random Scaling and Momentum for Non-smooth Non-convex Optimization
  12. ICML 2024Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation
  13. ICML 2024Reducing Item Discrepancy via Differentially Private Robust Embedding Alignment for Privacy-Preserving Cross Domain Recommendation
  14. ICML 2024ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models
  15. ICML 2024Representation Surgery: Theory and Practice of Affine Steering
  16. ICML 2024Residual-Conditioned Optimal Transport: Towards Structure-Preserving Unpaired and Paired Image Restoration
  17. ICML 2024Rethinking Optimization and Architecture for Tiny Language Models
  18. ICML 2024Reward Model Learning vs. Direct Policy Optimization: A Comparative Analysis of Learning from Human Preferences
  19. ICML 2024Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment
  20. ICML 2024Risk Estimation in a Markov Cost Process: Lower and Upper Bounds
  21. ICML 2024RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedback
  22. ICML 2024RLVF: Learning from Verbal Feedback without Overgeneralization
  23. ICML 2024Robust Stable Spiking Neural Networks
  24. ICML 2024Robustly Learning Single-Index Models via Alignment Sharpness
  25. ICML 2024Roping in Uncertainty: Robustness and Regularization in Markov Games
  26. ICML 2024Safe and Robust Subgame Exploitation in Imperfect Information Games
  27. ICML 2024Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants
  28. ICML 2024Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical Features
  29. ICML 2024Scalable AI Safety via Doubly-Efficient Debate
  30. ICML 2024Scaling Exponents Across Parameterizations and Optimizers
  31. ICML 2024Self-Alignment of Large Language Models via Monopolylogue-based Social Scene Simulation
  32. ICML 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models
  33. ICML 2024SelfIE: Self-Interpretation of Large Language Model Embeddings
  34. ICML 2024Simultaneous identification of models and parameters of scientific simulators
  35. ICML 2024SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization
  36. ICML 2024Smoothing Proximal Gradient Methods for Nonsmooth Sparsity Constrained Optimization: Optimality Conditions and Global Convergence
  37. ICML 2024Sobolev Space Regularised Pre Density Models
  38. ICML 2024SPABA: A Single-Loop and Probabilistic Stochastic Bilevel Algorithm Achieving Optimal Sample Complexity
  39. ICML 2024Sparse and Structured Hopfield Networks
  40. ICML 2024Sparser, Better, Deeper, Stronger: Improving Static Sparse Training with Exact Orthogonal Initialization
  41. ICML 2024Spectral Phase Transition and Optimal PCA in Block-Structured Spiked Models
  42. ICML 2024Split-and-Denoise: Protect large language model inference with local differential privacy
  43. ICML 2024SqueezeLLM: Dense-and-Sparse Quantization
  44. ICML 2024Stability and Generalization for Stochastic Recursive Momentum-based Algorithms for (Strongly-)Convex One to $K$-Level Stochastic Optimizations
  45. ICML 2024Stacking Deep Set Networks and Pooling by Quantiles
  46. ICML 2024STELLA: Continual Audio-Video Pre-training with SpatioTemporal Localized Alignment
  47. ICML 2024StyDeSty: Min-Max Stylization and Destylization for Single Domain Generalization
  48. ICML 2024Symmetry Induces Structure and Constraint of Learning
  49. ICML 2024Tackling Prevalent Conditions in Unsupervised Combinatorial Optimization: Cardinality, Minimum, Covering, and More
  50. ICML 2024Target Networks and Over-parameterization Stabilize Off-policy Bootstrapping with Function Approximation

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI