Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

473 papers, page 6 of 10

  1. ICLR 2025LLaMaFlex: Many-in-one LLMs via Generalized Pruning and Weight Sharing
  2. ICLR 2025LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation
  3. ICLR 2025LLM Unlearning via Loss Adjustment with Only Forget Data
  4. ICLR 2025Local Patterns Generalize Better for Novel Anomalies
  5. ICLR 2025Locality Alignment Improves Vision-Language Models
  6. ICLR 2025Logicbreaks: A Framework for Understanding Subversion of Rule-based Inference
  7. ICLR 2025Long-tailed Adversarial Training with Self-Distillation
  8. ICLR 2025LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  9. ICLR 2025Looking Inward: Language Models Can Learn About Themselves by Introspection
  10. ICLR 2025MA-RLHF: Reinforcement Learning from Human Feedback with Macro Actions
  11. ICLR 2025Machine Unlearning Fails to Remove Data Poisoning Attacks
  12. ICLR 2025MACPO: Weak-to-Strong Alignment via Multi-Agent Contrastive Preference Optimization
  13. ICLR 2025Magnetic Preference Optimization: Achieving Last-iterate Convergence for Language Model Alignment
  14. ICLR 2025Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
  15. ICLR 2025MallowsPO: Fine-Tune Your LLM with Preference Dispersions
  16. ICLR 2025MAP: Multi-Human-Value Alignment Palette
  17. ICLR 2025Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMs
  18. ICLR 2025Maximizing the Potential of Synthetic Data: Insights from Random Matrix Theory
  19. ICLR 2025Measuring memorization in RLHF for code completion
  20. ICLR 2025Measuring Non-Adversarial Reproduction of Training Data in Large Language Models
  21. ICLR 2025MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
  22. ICLR 2025MIA-DPO: Multi-Image Augmented Direct Preference Optimization For Large Vision-Language Models
  23. ICLR 2025Mind Control through Causal Inference: Predicting Clean Images from Poisoned Data
  24. ICLR 2025Mitigate the Gap: Improving Cross-Modal Alignment in CLIP
  25. ICLR 2025Mitigating Memorization in Language Models
  26. ICLR 2025Mitigating Reward Over-Optimization in RLHF via Behavior-Supported Regularization
  27. ICLR 2025Mitigating Spurious Correlations in Zero-Shot Multimodal Models
  28. ICLR 2025Mitigating the Backdoor Effect for Multi-Task Model Merging via Safety-Aware Subspace
  29. ICLR 2025Mix-CPT: A Domain Adaptation Framework via Decoupling Knowledge Learning and Format Alignment
  30. ICLR 2025Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN
  31. ICLR 2025MMDT: Decoding the Trustworthiness and Safety of Multimodal Foundation Models
  32. ICLR 2025Model Editing as a Robust and Denoised variant of DPO: A Case Study on Toxicity
  33. ICLR 2025Modeling Future Conversation Turns to Teach LLMs to Ask Clarifying Questions
  34. ICLR 2025Monitoring Latent World States in Language Models with Propositional Probes
  35. ICLR 2025Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning
  36. ICLR 2025Moral Alignment for LLM Agents
  37. ICLR 2025More RLHF, More Trust? On The Impact of Preference Alignment On Trustworthiness
  38. ICLR 2025Multi-objective antibody design with constrained preference optimization
  39. ICLR 2025Navigating Neural Space: Revisiting Concept Activation Vectors to Overcome Directional Divergence
  40. ICLR 2025Near-Exact Privacy Amplification for Matrix Mechanisms
  41. ICLR 2025Neural Interactive Proofs
  42. ICLR 2025NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internals
  43. ICLR 2025No Preference Left Behind: Group Distributional Preference Optimization
  44. ICLR 2025OASIS Uncovers: High-Quality T2I Models, Same Old Stereotypes
  45. ICLR 2025On a Connection Between Imitation Learning and RLHF
  46. ICLR 2025On Calibration of LLM-based Guard Models for Reliable Content Moderation
  47. ICLR 2025On Evaluating the Durability of Safeguards for Open-Weight LLMs
  48. ICLR 2025On Large Language Model Continual Unlearning
  49. ICLR 2025On Linear Representations and Pretraining Data Frequency in Language Models
  50. ICLR 2025On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI