Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

1,421 papers, page 16 of 29

  1. NeurIPS 2025Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimization
  2. NeurIPS 2025On Efficiency-Effectiveness Trade-off of Diffusion-based Recommenders
  3. NeurIPS 2025On Evaluating LLM Alignment by Evaluating LLMs as Judges
  4. NeurIPS 2025On Extending Direct Preference Optimization to Accommodate Ties
  5. NeurIPS 2025On Local Limits of Sparse Random Graphs: Color Convergence and the Refined Configuration Model
  6. NeurIPS 2025On the creation of narrow AI: hierarchy and nonlocality of neural network skills
  7. NeurIPS 2025On the Effect of Negative Gradient in Group Relative Deep Reinforcement Optimization
  8. NeurIPS 2025On the Existence and Complexity of Core-Stable Data Exchanges
  9. NeurIPS 2025On the Stability and Generalization of Meta-Learning: the Impact of Inner-Levels
  10. NeurIPS 2025On-Policy Optimization with Group Equivalent Preference for Multi-Programming Language Understanding
  11. NeurIPS 2025One SPACE to Rule Them All: Jointly Mitigating Factuality and Faithfulness Hallucinations in LLMs
  12. NeurIPS 2025Online Inverse Linear Optimization: Efficient Logarithmic-Regret Algorithm, Robustness to Suboptimality, and Lower Bound
  13. NeurIPS 2025Online Strategic Classification With Noise and Partial Feedback
  14. NeurIPS 2025OpenOmni: Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Real-time Emotional Speech Synthesis
  15. NeurIPS 2025Optimality and NP-Hardness of Transformers in Learning Markovian Dynamical Functions
  16. NeurIPS 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization
  17. NeurIPS 2025Orthogonal Contrastive Learning for Multi-Representation fMRI Analysis
  18. NeurIPS 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents
  19. NeurIPS 2025Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning
  20. NeurIPS 2025OVERT: A Benchmark for Over-Refusal Evaluation on Text-to-Image Models
  21. NeurIPS 2025Pairwise Calibrated Rewards for Pluralistic Alignment
  22. NeurIPS 2025Panacea: Mitigating Harmful Fine-tuning for Large Language Models via Post-fine-tuning Perturbation
  23. NeurIPS 2025Pareto-Optimal Energy Alignment for Designing Nature-Like Antibodies
  24. NeurIPS 2025PC-Net: Weakly Supervised Compositional Moment Retrieval via Proposal-Centric Network
  25. NeurIPS 2025Personalized Image Editing in Text-to-Image Diffusion Models via Collaborative Direct Preference Optimization
  26. NeurIPS 2025Personalized Safety in LLMs: A Benchmark and A Planning-Based Agent Approach
  27. NeurIPS 2025Plug-and-play Feature Causality Decomposition for Multimodal Representation Learning
  28. NeurIPS 2025PolyGuard: Massive Multi-Domain Safety Policy-Grounded Guardrail Dataset
  29. NeurIPS 2025PolyJuice Makes It Real: Black-Box, Universal Red Teaming for Synthetic Image Detectors
  30. NeurIPS 2025Position: Bridge the Gaps between Machine Unlearning and AI Regulation
  31. NeurIPS 2025Position: Require Frontier AI Labs To Release Small "Analog" Models
  32. NeurIPS 2025Position: Towards Bidirectional Human-AI Alignment
  33. NeurIPS 2025Pre-Trained Policy Discriminators are General Reward Models
  34. NeurIPS 2025Predictive Preference Learning from Human Interventions
  35. NeurIPS 2025Preference Distillation via Value based Reinforcement Learning
  36. NeurIPS 2025Preference Learning with Lie Detectors can Induce Honesty or Evasion
  37. NeurIPS 2025Preference Learning with Response Time: Robust Losses and Guarantees
  38. NeurIPS 2025Preference Optimization by Estimating the Ratio of the Data Distribution
  39. NeurIPS 2025Preference Optimization on Pareto Sets: On a Theory of Multi-Objective Optimization
  40. NeurIPS 2025Preference-Driven Multi-Objective Combinatorial Optimization with Conditional Computation
  41. NeurIPS 2025Prior Forgetting and In-Context Overfitting
  42. NeurIPS 2025Probabilistic Stability Guarantees for Feature Attributions
  43. NeurIPS 2025Probabilistic Token Alignment for Large Language Model Fusion
  44. NeurIPS 2025Prohibiting Generative AI in any Form of Weapon Control
  45. NeurIPS 2025Prompt-Guided Alignment with Information Bottleneck Makes Image Compression Also a Restorer
  46. NeurIPS 2025Prot2Text-V2: Protein Function Prediction with Multimodal Contrastive Alignment
  47. NeurIPS 2025Protein Inverse Folding From Structure Feedback
  48. NeurIPS 2025Provably Efficient Online RLHF with One-Pass Reward Modeling
  49. NeurIPS 2025Proximalized Preference Optimization for Diverse Feedback Types: A Decomposed Perspective on DPO
  50. NeurIPS 2025PurpCode: Reasoning for Safer Code Generation

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI