Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

1,339 papers, page 23 of 27

  1. ICLR 2024Align With Purpose: Optimize Desired Properties in CTC Models with a General Plug-and-Play Framework
  2. ICLR 2024Aligning Relational Learning with Lipschitz Fairness
  3. ICLR 2024An Analytical Solution to Gauss-Newton Loss for Direct Image Alignment
  4. ICLR 2024An Emulator for Fine-tuning Large Language Models using Small Language Models
  5. ICLR 2024An Investigation of Representation and Allocation Harms in Contrastive Learning
  6. ICLR 2024An Unforgeable Publicly Verifiable Watermark for Large Language Models
  7. ICLR 2024ArchLock: Locking DNN Transferability at the Architecture Level with a Zero-Cost Binary Predictor
  8. ICLR 2024ARGS: Alignment as Reward-Guided Search
  9. ICLR 2024AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models
  10. ICLR 2024Backdoor Contrastive Learning via Bi-level Trigger Optimization
  11. ICLR 2024BadEdit: Backdooring Large Language Models by Model Editing
  12. ICLR 2024Benchmarking and Improving Generator-Validator Consistency of Language Models
  13. ICLR 2024Beyond Imitation: Leveraging Fine-grained Quality Signals for Alignment
  14. ICLR 2024Beyond Memorization: Violating Privacy via Inference with Large Language Models
  15. ICLR 2024Beyond Reverse KL: Generalizing Direct Preference Optimization with Diverse Divergence Constraints
  16. ICLR 2024Beyond task performance: evaluating and reducing the flaws of large multimodal models with in-context-learning
  17. ICLR 2024Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs
  18. ICLR 2024Breaking Physical and Linguistic Borders: Multilingual Federated Prompt Tuning for Low-Resource Languages
  19. ICLR 2024BRUSLEATTACK: A QUERY-EFFICIENT SCORE- BASED BLACK-BOX SPARSE ADVERSARIAL ATTACK
  20. ICLR 2024Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression
  21. ICLR 2024CAS: A Probability-Based Approach for Universal Condition Alignment Score
  22. ICLR 2024Catastrophic Jailbreak of Open-source LLMs via Exploiting Generation
  23. ICLR 2024Chain of Hindsight aligns Language Models with Feedback
  24. ICLR 2024Classification with Conceptual Safeguards
  25. ICLR 2024Compositional Preference Models for Aligning LMs
  26. ICLR 2024Compressing LLMs: The Truth is Rarely Pure and Never Simple
  27. ICLR 2024Confidential-DPproof: Confidential Proof of Differentially Private Training
  28. ICLR 2024Confronting Reward Model Overoptimization with Constrained RLHF
  29. ICLR 2024Continual Learning in the Presence of Spurious Correlations: Analyses and a Simple Baseline
  30. ICLR 2024Contrastive Preference Learning: Learning from Human Feedback without Reinforcement Learning
  31. ICLR 2024Correlated Noise Provably Beats Independent Noise for Differentially Private Learning
  32. ICLR 2024CPPO: Continual Learning for Reinforcement Learning with Human Feedback
  33. ICLR 2024Curiosity-driven Red-teaming for Large Language Models
  34. ICLR 2024Debiasing Attention Mechanism in Transformer without Demographics
  35. ICLR 2024Decongestion by Representation: Learning to Improve Economic Welfare in Marketplaces
  36. ICLR 2024Defining and extracting generalizable interaction primitives from DNNs
  37. ICLR 2024Demonstration-Regularized RL
  38. ICLR 2024DENEVIL: TOWARDS DECIPHERING AND NAVIGATING THE ETHICAL VALUES OF LARGE LANGUAGE MODELS VIA INSTRUCTION LEARNING
  39. ICLR 2024Detecting Machine-Generated Texts by Multi-Population Aware Optimization for Maximum Mean Discrepancy
  40. ICLR 2024Detecting Pretraining Data from Large Language Models
  41. ICLR 2024Distributional Preference Learning: Understanding and Accounting for Hidden Context in RLHF
  42. ICLR 2024DP-SGD Without Clipping: The Lipschitz Neural Network Way
  43. ICLR 2024Early Neuron Alignment in Two-layer ReLU Networks with Small Initialization
  44. ICLR 2024Effective and Efficient Federated Tree Learning on Hybrid Data
  45. ICLR 2024Enabling Lanuguage Models to Implicitly Learn Self-Improvement
  46. ICLR 2024Eureka: Human-Level Reward Design via Coding Large Language Models
  47. ICLR 2024Expressivity of ReLU-Networks under Convex Relaxations
  48. ICLR 2024f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimization
  49. ICLR 2024Fair and Efficient Contribution Valuation for Vertical Federated Learning
  50. ICLR 2024Faster Approximation of Probabilistic and Distributional Values via Least Squares

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI