Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

4,558 papers, page 17 of 92

  1. ICLR 2026Towards Understanding Valuable Preference Data for Large Language Model Alignment
  2. ICLR 2026Traceable Black-Box Watermarks For Federated Learning
  3. ICLR 2026Transferable and Stealthy Adversarial Attacks on Large Vision-Language Models
  4. ICLR 2026Translate Policy to Language: Flow Matching Generated Rewards for LLM Explanations
  5. ICLR 2026Tree-based Dialogue Reinforced Policy Optimization for Red-Teaming Attacks
  6. ICLR 2026TriQDef: Disrupting Semantic and Gradient Alignment to Prevent Adversarial Patch Transferability in Quantized Neural Networks
  7. ICLR 2026Trust The Typical
  8. ICLR 2026Truthful or Fabricated? Using Causal Attribution to Mitigate Reward Hacking in Explanations
  9. ICLR 2026Truthfulness Despite Weak Supervision: Evaluating and Training LLMs Using Peer Prediction
  10. ICLR 2026TurboBoA: Faster and Exact Attention-aware Quantization without Backpropagation
  11. ICLR 2026Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learning
  12. ICLR 2026ULD-Net: Enabling Ultra-Low-Degree Fully Polynomial Networks for Homomorphically Encrypted Inference
  13. ICLR 2026Understanding and Improving Continuous LLM Adversarial Training via In-context Learning Theory
  14. ICLR 2026Understanding Sensitivity of Differential Attention through the Lens of Adversarial Robustness
  15. ICLR 2026Uni-DPO: A Unified Paradigm for Dynamic Preference Optimization of LLMs
  16. ICLR 2026UniCon: Unified Framework for Efficient Contrastive Alignment via Kernels
  17. ICLR 2026Unified Privacy Guarantees for Decentralized Learning via Matrix Factorization
  18. ICLR 2026Unifying Stable Optimization and Reference Regularization in RLHF
  19. ICLR 2026Unlearning Isn't Invisible: Detecting Unlearning Traces in LLMs from Model Outputs
  20. ICLR 2026Using cognitive models to reveal value trade-offs in language models
  21. ICLR 2026Value Gradient Flow: Behavior-Regularized RL without Regularization
  22. ICLR 2026VeriCoT: Neuro-symbolic Chain-of-Thought Validation via Logical Consistency Checks
  23. ICLR 2026Verification and Co-Alignment via Heterogeneous Consistency for Preference-Aligned LLM Annotations
  24. ICLR 2026VERIFY: A Novel Multi-Domain Dataset Grounding LTL in Contextual Natural Language via Provable Intermediate Logic
  25. ICLR 2026ViPO: Visual Preference Optimization at Scale
  26. ICLR 2026VisionTrim: Unified Vision Token Compression for Training-Free MLLM Acceleration
  27. ICLR 2026VisJudge-Bench: Aesthetics and Quality Assessment of Visualizations
  28. ICLR 2026VLSU: Mapping the Limits of Joint Multimodal Understanding for AI Safety
  29. ICLR 2026WARP: Weight Teleportation for Attack-Resilient Unlearning Protocols
  30. ICLR 2026Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs
  31. ICLR 2026Watch your steps: Dormant Adversarial Behaviors that Activate upon LLM Finetuning
  32. ICLR 2026WaterDrum: Watermark-based Data-centric Unlearning Metric
  33. ICLR 2026Watermark-based Attribution of AI-Generated Content
  34. ICLR 2026Weak-to-Strong Generalization with Failure Trajectories
  35. ICLR 2026What Do Large Language Models Know About Opinions?
  36. ICLR 2026What happens when generative AI models train recursively on each others' outputs?
  37. ICLR 2026What matters for Representation Alignment: Global Information or Spatial Structure?
  38. ICLR 2026What's In My Human Feedback? Learning Interpretable Descriptions of Preference Data
  39. ICLR 2026What's the plan? Metrics for implicit planning in LLMs and their application to rhyme generation
  40. ICLR 2026When Data is the Algorithm: A Systematic Study and Curation of Preference Optimization Datasets
  41. ICLR 2026When Language Models Lose Their Mind: The Consequences of Brain Misalignment
  42. ICLR 2026When Machine Learning Gets Personal: Evaluating Prediction and Explanation
  43. ICLR 2026When Priors Backfire: On the Vulnerability of Unlearnable Examples to Pretraining
  44. ICLR 2026When Style Breaks Safety: Defending LLMs Against Superficial Style Alignment
  45. ICLR 2026When Weak LLMs Speak with Confidence, Preference Alignment Gets Stronger
  46. ICLR 2026Where Did It Go Wrong? Attributing Undesirable LLM Behaviors via Representation Gradient Tracing
  47. ICLR 2026Why DPO is a Misspecified Estimator and How to Fix It
  48. ICLR 2026Will AI Tell Lies to Save Sick Children? Litmus-Testing AI Values Prioritization with AIRiskDilemmas
  49. ICLR 2026Winter Soldier: Backdooring Language Models at Pre-Training with Indirect Data Poisoning
  50. ICLR 2026Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI