Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

4,558 papers, page 51 of 92

  1. ICML 2025Active Reward Modeling: Adaptive Preference Labeling for Large Language Model Alignment
  2. ICML 2025Adapting While Learning: Grounding LLMs for Scientific Problems with Tool Usage Adaptation
  3. ICML 2025Adaptive Estimation and Learning under Temporal Distribution Shift
  4. ICML 2025Addressing Concept Mislabeling in Concept Bottleneck Models Through Preference Optimization
  5. ICML 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization
  6. ICML 2025AdvAgent: Controllable Blackbox Red-teaming on Web Agents
  7. ICML 2025Adversaries Can Misuse Combinations of Safe Models
  8. ICML 2025AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs
  9. ICML 2025AEQA-NAT : Adaptive End-to-end Quantization Alignment Training Framework for Non-autoregressive Machine Translation
  10. ICML 2025Aligning Multimodal Representations through an Information Bottleneck
  11. ICML 2025Aligning Spoken Dialogue Models from User Interactions
  12. ICML 2025Aligning with Logic: Measuring, Evaluating and Improving Logical Preference Consistency in Large Language Models
  13. ICML 2025AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
  14. ICML 2025AlphaPO: Reward Shape Matters for LLM Alignment
  15. ICML 2025AMPO: Active Multi Preference Optimization for Self-play Preference Selection
  16. ICML 2025Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-tuning Attack
  17. ICML 2025Assessing Safety Risks and Quantization-aware Safety Patching for Quantized Large Language Models
  18. ICML 2025Automated Red Teaming with GOAT: the Generative Offensive Agent Tester
  19. ICML 2025Avoiding Catastrophe in Online Learning by Asking for Help
  20. ICML 2025Bayesian Optimization from Human Feedback: Near-Optimal Regret Bounds
  21. ICML 2025BDC-CLIP: Brownian Distance Covariance for Adapting CLIP to Action Recognition
  22. ICML 2025Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safety
  23. ICML 2025Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment
  24. ICML 2025BILBO: BILevel Bayesian Optimization
  25. ICML 2025Boosting Adversarial Robustness with CLAT: Criticality Leveraged Adversarial Training
  26. ICML 2025BOPO: Neural Combinatorial Optimization via Best-anchored and Objective-guided Preference Optimization
  27. ICML 2025Bounded Rationality for LLMs: Satisficing Alignment at Inference-Time
  28. ICML 2025BounDr.E: Predicting Drug-likeness via Biomedical Knowledge Alignment and EM-like One-Class Boundary Optimization
  29. ICML 2025Breaking Barriers: Combinatorial Algorithms for Non-Monotone Submodular Maximization with Sublinear Adaptivity and $1/e$ Approximation
  30. ICML 2025Calibrated Language Models and How to Find Them with Label Smoothing
  31. ICML 2025Calibrating Video Watch-time Predictions with Credible Prototype Alignment
  32. ICML 2025Can RLHF be More Efficient with Imperfect Reward Models? A Policy Coverage Perspective
  33. ICML 2025Cannot See the Forest for the Trees: Invoking Heuristics and Biases to Elicit Irrational Choices of LLMs
  34. ICML 2025CASE-Bench: Context-Aware SafEty Benchmark for Large Language Models
  35. ICML 2025Clipped SGD Algorithms for Performative Prediction: Tight Bounds for Stochastic Bias and Remedies
  36. ICML 2025Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
  37. ICML 2025Clone-Robust AI Alignment
  38. ICML 2025CodeSteer: Symbolic-Augmented Language Models via Code/Text Guidance
  39. ICML 2025Comparing Comparisons: Informative and Easy Human Feedback with Distinguishability Queries
  40. ICML 2025Comparing Few to Rank Many: Active Human Preference Learning Using Randomized Frank-Wolfe Method
  41. ICML 2025Compelling ReLU Networks to Exhibit Exponentially Many Linear Regions at Initialization and During Training
  42. ICML 2025Compressing tree ensembles through Level-wise Optimization and Pruning
  43. ICML 2025Computing Optimal Transport Maps and Wasserstein Barycenters Using Conditional Normalizing Flows
  44. ICML 2025Conformal Tail Risk Control for Large Language Model Alignment
  45. ICML 2025ConfPO: Exploiting Policy Model Confidence for Critical Token Selection in Preference Optimization
  46. ICML 2025Constrain Alignment with Sparse Autoencoders
  47. ICML 2025Contextual Optimization Under Model Misspecification: A Tractable and Generalizable Approach
  48. ICML 2025Counting in Small Transformers: The Delicate Interplay between Attention and Feed-Forward Layers
  49. ICML 2025Cross-City Latent Space Alignment for Consistency Region Embedding
  50. ICML 2025CSV-Occ: Fusing Multi-frame Alignment for Occupancy Prediction with Temporal Cross State Space Model and Central Voting Mechanism

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI