Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

348 papers, page 6 of 7

  1. NeurIPS 2024Risk-Averse Fine-tuning of Large Language Models
  2. NeurIPS 2024Robust Conformal Prediction Using Privileged Information
  3. NeurIPS 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks
  4. NeurIPS 2024Robust Reinforcement Learning from Corrupted Human Feedback
  5. NeurIPS 2024RTify: Aligning Deep Neural Networks with Human Behavioral Decisions
  6. NeurIPS 2024Rule Based Rewards for Language Model Safety
  7. NeurIPS 2024Safe LoRA: The Silver Lining of Reducing Safety Risks when Finetuning Large Language Models
  8. NeurIPS 2024SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset
  9. NeurIPS 2024Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?
  10. NeurIPS 2024SafeWorld: Geo-Diverse Safety Alignment
  11. NeurIPS 2024SampDetox: Black-box Backdoor Defense via Perturbation-based Sample Detoxification
  12. NeurIPS 2024Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planes
  13. NeurIPS 2024Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms
  14. NeurIPS 2024Scanning Trojaned Models Using Out-of-Distribution Samples
  15. NeurIPS 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganography
  16. NeurIPS 2024Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  17. NeurIPS 2024SEEV: Synthesis with Efficient Exact Verification for ReLU Neural Barrier Functions
  18. NeurIPS 2024Selective Generation for Controllable Language Models
  19. NeurIPS 2024Self-Calibrated Tuning of Vision-Language Models for Out-of-Distribution Detection
  20. NeurIPS 2024Self-Calibrating Conformal Prediction
  21. NeurIPS 2024Self-Consuming Generative Models with Curated Data Provably Optimize Human Preferences
  22. NeurIPS 2024Self-Supervised Alignment with Mutual Information: Learning to Follow Principles without Preference Labels
  23. NeurIPS 2024SelfCodeAlign: Self-Alignment for Code Generation
  24. NeurIPS 2024Semi-Discrete Optimal Transport: Nearly Minimax Estimation With Stochastic Gradient Descent and Adaptive Entropic Regularization
  25. NeurIPS 2024Sequential Harmful Shift Detection Without Labels
  26. NeurIPS 2024SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation
  27. NeurIPS 2024SETBENCH: Assessing the Analytical and Semantic Robustness of Language Models
  28. NeurIPS 2024SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Types
  29. NeurIPS 2024Shadowcast: Stealthy Data Poisoning Attacks Against Vision-Language Models
  30. NeurIPS 2024SHDocs: A dataset, benchmark, and method to efficiently generate high-quality, real-world specular highlight data with near-perfect alignment
  31. NeurIPS 2024SimPO: Simple Preference Optimization with a Reference-Free Reward
  32. NeurIPS 2024Soft Prompt Threats: Attacking Safety Alignment and Unlearning in Open-Source LLMs through the Embedding Space
  33. NeurIPS 2024Soft-Label Integration for Robust Toxicity Classification
  34. NeurIPS 2024Spectral Editing of Activations for Large Language Model Alignment
  35. NeurIPS 2024SpeechAlign: Aligning Speech Generation to Human Preferences
  36. NeurIPS 2024SSDM: Scalable Speech Dysfluency Modeling
  37. NeurIPS 2024Stability and Generalization of Adversarial Training for Shallow Neural Networks with Smooth Activation
  38. NeurIPS 2024Stepwise Alignment for Constrained Language Model Policy Optimization
  39. NeurIPS 2024Stress-Testing Capability Elicitation With Password-Locked Models
  40. NeurIPS 2024Studying How to Efficiently and Effectively Guide Models with Explanations - A Reproducibility Study
  41. NeurIPS 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Models
  42. NeurIPS 2024Tackling Uncertain Correspondences for Multi-Modal Entity Alignment
  43. NeurIPS 2024TARP-VP: Towards Evaluation of Transferred Adversarial Robustness and Privacy on Label Mapping Visual Prompting Models
  44. NeurIPS 2024Test-Time Adaptation Induces Stronger Accuracy and Agreement-on-the-Line
  45. NeurIPS 2024Text-Guided Attention is All You Need for Zero-Shot Robustness in Vision-Language Models
  46. NeurIPS 2024TFGDA: Exploring Topology and Feature Alignment in Semi-supervised Graph Domain Adaptation through Robust Clustering
  47. NeurIPS 2024The Art of Saying No: Contextual Noncompliance in Language Models
  48. NeurIPS 2024The Best of Both Worlds: On the Dilemma of Out-of-distribution Detection
  49. NeurIPS 2024The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More
  50. NeurIPS 2024The Importance of Online Data: Understanding Preference Fine-tuning via Coverage

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI