Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

4,558 papers, page 69 of 92

  1. ICLR 2024Confidential-DPproof: Confidential Proof of Differentially Private Training
  2. ICLR 2024Confronting Reward Model Overoptimization with Constrained RLHF
  3. ICLR 2024Continual Learning in the Presence of Spurious Correlations: Analyses and a Simple Baseline
  4. ICLR 2024Contrastive Preference Learning: Learning from Human Feedback without Reinforcement Learning
  5. ICLR 2024Correlated Noise Provably Beats Independent Noise for Differentially Private Learning
  6. ICLR 2024CPPO: Continual Learning for Reinforcement Learning with Human Feedback
  7. ICLR 2024Curiosity-driven Red-teaming for Large Language Models
  8. ICLR 2024Debiasing Attention Mechanism in Transformer without Demographics
  9. ICLR 2024Decongestion by Representation: Learning to Improve Economic Welfare in Marketplaces
  10. ICLR 2024Defining and extracting generalizable interaction primitives from DNNs
  11. ICLR 2024Demonstration-Regularized RL
  12. ICLR 2024DENEVIL: TOWARDS DECIPHERING AND NAVIGATING THE ETHICAL VALUES OF LARGE LANGUAGE MODELS VIA INSTRUCTION LEARNING
  13. ICLR 2024Detecting Machine-Generated Texts by Multi-Population Aware Optimization for Maximum Mean Discrepancy
  14. ICLR 2024Detecting Pretraining Data from Large Language Models
  15. ICLR 2024Distributional Preference Learning: Understanding and Accounting for Hidden Context in RLHF
  16. ICLR 2024DP-SGD Without Clipping: The Lipschitz Neural Network Way
  17. ICLR 2024Early Neuron Alignment in Two-layer ReLU Networks with Small Initialization
  18. ICLR 2024Effective and Efficient Federated Tree Learning on Hybrid Data
  19. ICLR 2024Enabling Lanuguage Models to Implicitly Learn Self-Improvement
  20. ICLR 2024Eureka: Human-Level Reward Design via Coding Large Language Models
  21. ICLR 2024Expressivity of ReLU-Networks under Convex Relaxations
  22. ICLR 2024f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimization
  23. ICLR 2024Fair and Efficient Contribution Valuation for Vertical Federated Learning
  24. ICLR 2024Faster Approximation of Probabilistic and Distributional Values via Least Squares
  25. ICLR 2024FedImpro: Measuring and Improving Client Update in Federated Learning
  26. ICLR 2024FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data
  27. ICLR 2024Few-Shot Detection of Machine-Generated Text using Style Representations
  28. ICLR 2024Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!
  29. ICLR 2024Fine-Tuning Language Models for Factuality
  30. ICLR 2024Finetuning Text-to-Image Diffusion Models for Fairness
  31. ICLR 2024FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  32. ICLR 2024Gaining Wisdom from Setbacks: Aligning Large Language Models via Mistake Analysis
  33. ICLR 2024Generative Judge for Evaluating Alignment
  34. ICLR 2024GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher
  35. ICLR 2024Group Preference Optimization: Few-Shot Alignment of Large Language Models
  36. ICLR 2024How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated Questions
  37. ICLR 2024Identifying the Risks of LM Agents with an LM-Emulated Sandbox
  38. ICLR 2024Implicit Neural Representations and the Algebra of Complex Wavelets
  39. ICLR 2024Improving Generalization of Alignment with Human Preferences through Group Invariant Learning
  40. ICLR 2024Interventional Fairness on Partially Known Causal Graphs: A Constrained Optimization Approach
  41. ICLR 2024Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Models
  42. ICLR 2024Language Model Decoding as Direct Metrics Optimization
  43. ICLR 2024Language Model Inversion
  44. ICLR 2024Language-Interfaced Tabular Oversampling via Progressive Imputation and Self-Authentication
  45. ICLR 2024LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
  46. ICLR 2024Learning From Simplicial Data Based on Random Walks and 1D Convolutions
  47. ICLR 2024Leftover Lunch: Advantage-based Offline Reinforcement Learning for Language Models
  48. ICLR 2024Leveraging Generative Models for Unsupervised Alignment of Neural Time Series Data
  49. ICLR 2024Like Oil and Water: Group Robustness Methods and Poisoning Defenses May Be at Odds
  50. ICLR 2024LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI