Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

1,363 papers, page 24 of 28

  1. NeurIPS 2025Many LLMs Are More Utilitarian Than One
  2. NeurIPS 2025Matchings Under Biased and Correlated Evaluations
  3. NeurIPS 2025Measuring and Guiding Monosemanticity
  4. NeurIPS 2025Mechanism Design for LLM Fine-tuning with Multiple Reward Models
  5. NeurIPS 2025Median Selection with Noisy and Structural Information
  6. NeurIPS 2025Mesh-RFT: Enhancing Mesh Generation via Fine-grained Reinforcement Fine-Tuning
  7. NeurIPS 2025Meta-Learning Objectives for Preference Optimization
  8. NeurIPS 2025MGUP: A Momentum-Gradient Alignment Update Policy for Stochastic Optimization
  9. NeurIPS 2025Military AI Needs Technically-Informed Regulation to Safeguard AI Research and its Applications
  10. NeurIPS 2025Mitigating Hallucination Through Theory-Consistent Symmetric Multimodal Preference Optimization
  11. NeurIPS 2025Mitigating Reward Over-optimization in Direct Alignment Algorithms with Importance Sampling
  12. NeurIPS 2025Mitigating Sexual Content Generation via Embedding Distortion in Text-conditioned Diffusion Models
  13. NeurIPS 2025Mix Data or Merge Models? Balancing the Helpfulness, Honesty, and Harmlessness of Large Language Model via Model Merging
  14. NeurIPS 2025MJ-Video: Benchmarking and Rewarding Video Generation with Fine-Grained Video Preference
  15. NeurIPS 2025Model Inversion with Layer-Specific Modeling and Alignment for Data-Free Continual Learning
  16. NeurIPS 2025Model–Behavior Alignment under Flexible Evaluation: When the Best-Fitting Model Isn’t the Right One
  17. NeurIPS 2025Multi-step Visual Reasoning with Visual Tokens Scaling and Verification
  18. NeurIPS 2025Multimodal Disease Progression Modeling via Spatiotemporal Disentanglement and Multiscale Alignment
  19. NeurIPS 2025Nabla-R2D3: Effective and Efficient 3D Diffusion Alignment with 2D Rewards
  20. NeurIPS 2025Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
  21. NeurIPS 2025Neural Thermodynamics: Entropic Forces in Deep and Universal Representation Learning
  22. NeurIPS 2025NeuSymEA: Neuro-symbolic Entity Alignment via Variational Inference
  23. NeurIPS 2025No Loss, No Gain: Gated Refinement and Adaptive Compression for Prompt Optimization
  24. NeurIPS 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Models
  25. NeurIPS 2025Non-monotone Submodular Optimization: $p$-Matchoid Constraints and Fully Dynamic Setting
  26. NeurIPS 2025NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit Vector Quantization of KV Cache
  27. NeurIPS 2025nvBench 2.0: Resolving Ambiguity in Text-to-Visualization through Stepwise Reasoning
  28. NeurIPS 2025Object-centric binding in Contrastive Language-Image Pretraining
  29. NeurIPS 2025Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimization
  30. NeurIPS 2025On Efficiency-Effectiveness Trade-off of Diffusion-based Recommenders
  31. NeurIPS 2025On Evaluating LLM Alignment by Evaluating LLMs as Judges
  32. NeurIPS 2025On Extending Direct Preference Optimization to Accommodate Ties
  33. NeurIPS 2025On Local Limits of Sparse Random Graphs: Color Convergence and the Refined Configuration Model
  34. NeurIPS 2025On the creation of narrow AI: hierarchy and nonlocality of neural network skills
  35. NeurIPS 2025On the Effect of Negative Gradient in Group Relative Deep Reinforcement Optimization
  36. NeurIPS 2025On the Existence and Complexity of Core-Stable Data Exchanges
  37. NeurIPS 2025On the Stability and Generalization of Meta-Learning: the Impact of Inner-Levels
  38. NeurIPS 2025On-Policy Optimization with Group Equivalent Preference for Multi-Programming Language Understanding
  39. NeurIPS 2025One SPACE to Rule Them All: Jointly Mitigating Factuality and Faithfulness Hallucinations in LLMs
  40. NeurIPS 2025Online Inverse Linear Optimization: Efficient Logarithmic-Regret Algorithm, Robustness to Suboptimality, and Lower Bound
  41. NeurIPS 2025Online Strategic Classification With Noise and Partial Feedback
  42. NeurIPS 2025OpenOmni: Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Real-time Emotional Speech Synthesis
  43. NeurIPS 2025Optimality and NP-Hardness of Transformers in Learning Markovian Dynamical Functions
  44. NeurIPS 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization
  45. NeurIPS 2025Orthogonal Contrastive Learning for Multi-Representation fMRI Analysis
  46. NeurIPS 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents
  47. NeurIPS 2025Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning
  48. NeurIPS 2025OVERT: A Benchmark for Over-Refusal Evaluation on Text-to-Image Models
  49. NeurIPS 2025Pairwise Calibrated Rewards for Pluralistic Alignment
  50. NeurIPS 2025Panacea: Mitigating Harmful Fine-tuning for Large Language Models via Post-fine-tuning Perturbation

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI