Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

875 papers, page 4 of 18

  1. ICLR 2024Catastrophic Jailbreak of Open-source LLMs via Exploiting Generation
  2. ICLR 2024Chain of Hindsight aligns Language Models with Feedback
  3. ICLR 2024Classification with Conceptual Safeguards
  4. ICLR 2024Compositional Preference Models for Aligning LMs
  5. ICLR 2024Compressing LLMs: The Truth is Rarely Pure and Never Simple
  6. ICLR 2024Confidential-DPproof: Confidential Proof of Differentially Private Training
  7. ICLR 2024Confronting Reward Model Overoptimization with Constrained RLHF
  8. ICLR 2024Continual Learning in the Presence of Spurious Correlations: Analyses and a Simple Baseline
  9. ICLR 2024Contrastive Preference Learning: Learning from Human Feedback without Reinforcement Learning
  10. ICLR 2024Correlated Noise Provably Beats Independent Noise for Differentially Private Learning
  11. ICLR 2024CPPO: Continual Learning for Reinforcement Learning with Human Feedback
  12. ICLR 2024Curiosity-driven Red-teaming for Large Language Models
  13. ICLR 2024Debiasing Attention Mechanism in Transformer without Demographics
  14. ICLR 2024Decongestion by Representation: Learning to Improve Economic Welfare in Marketplaces
  15. ICLR 2024Defining and extracting generalizable interaction primitives from DNNs
  16. ICLR 2024Demonstration-Regularized RL
  17. ICLR 2024DENEVIL: TOWARDS DECIPHERING AND NAVIGATING THE ETHICAL VALUES OF LARGE LANGUAGE MODELS VIA INSTRUCTION LEARNING
  18. ICLR 2024Detecting Machine-Generated Texts by Multi-Population Aware Optimization for Maximum Mean Discrepancy
  19. ICLR 2024Detecting Pretraining Data from Large Language Models
  20. ICLR 2024Distributional Preference Learning: Understanding and Accounting for Hidden Context in RLHF
  21. ICLR 2024DP-SGD Without Clipping: The Lipschitz Neural Network Way
  22. ICLR 2024Early Neuron Alignment in Two-layer ReLU Networks with Small Initialization
  23. ICLR 2024Effective and Efficient Federated Tree Learning on Hybrid Data
  24. ICLR 2024Enabling Lanuguage Models to Implicitly Learn Self-Improvement
  25. ICLR 2024Eureka: Human-Level Reward Design via Coding Large Language Models
  26. ICLR 2024Expressivity of ReLU-Networks under Convex Relaxations
  27. ICLR 2024f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimization
  28. ICLR 2024Fair and Efficient Contribution Valuation for Vertical Federated Learning
  29. ICLR 2024Faster Approximation of Probabilistic and Distributional Values via Least Squares
  30. ICLR 2024FedImpro: Measuring and Improving Client Update in Federated Learning
  31. ICLR 2024FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data
  32. ICLR 2024Few-Shot Detection of Machine-Generated Text using Style Representations
  33. ICLR 2024Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!
  34. ICLR 2024Fine-Tuning Language Models for Factuality
  35. ICLR 2024Finetuning Text-to-Image Diffusion Models for Fairness
  36. ICLR 2024FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  37. ICLR 2024Gaining Wisdom from Setbacks: Aligning Large Language Models via Mistake Analysis
  38. ICLR 2024Generative Judge for Evaluating Alignment
  39. ICLR 2024GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher
  40. ICLR 2024Group Preference Optimization: Few-Shot Alignment of Large Language Models
  41. ICLR 2024How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated Questions
  42. ICLR 2024Identifying the Risks of LM Agents with an LM-Emulated Sandbox
  43. ICLR 2024Implicit Neural Representations and the Algebra of Complex Wavelets
  44. ICLR 2024Improving Generalization of Alignment with Human Preferences through Group Invariant Learning
  45. ICLR 2024Interventional Fairness on Partially Known Causal Graphs: A Constrained Optimization Approach
  46. ICLR 2024Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Models
  47. ICLR 2024Language Model Decoding as Direct Metrics Optimization
  48. ICLR 2024Language Model Inversion
  49. ICLR 2024Language-Interfaced Tabular Oversampling via Progressive Imputation and Self-Authentication
  50. ICLR 2024LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI