Alignment and Safety papers, 2023–2026

RLHF, preference optimization, red-teaming, and safety alignment

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 4,558 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Alignment and Safety papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
202313887101112438
2024348156246125875
20254554733001351,363
20264806235512281,882

Representative papers

Spread across years and venues so every edition shows up

All Alignment and Safety papers

875 papers, page 16 of 18

  1. NeurIPS 2024ProTransformer: Robustify Transformers via Plug-and-Play Paradigm
  2. NeurIPS 2024Provable Editing of Deep Neural Networks using Parametric Linear Relaxation
  3. NeurIPS 2024Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizer
  4. NeurIPS 2024Provably Safe Neural Network Controllers via Differential Dynamic Logic
  5. NeurIPS 2024PureGen: Universal Data Purification for Train-Time Poison Defense via Generative Model Dynamics
  6. NeurIPS 2024Quantifying and Optimizing Global Faithfulness in Persona-driven Role-playing
  7. NeurIPS 2024Quantifying the Bitter Lesson: How Safety Benchmarks Measure Capabilities Instead of Safety
  8. NeurIPS 2024Query-Based Adversarial Prompt Generation
  9. NeurIPS 2024RA-PbRL: Provably Efficient Risk-Aware Preference-Based Reinforcement Learning
  10. NeurIPS 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts
  11. NeurIPS 2024RAMP: Boosting Adversarial Robustness Against Multiple $l_p$ Perturbations for Universal Robustness
  12. NeurIPS 2024Rapid Plug-in Defenders
  13. NeurIPS 2024RashomonGB: Analyzing the Rashomon Effect and Mitigating Predictive Multiplicity in Gradient Boosting
  14. NeurIPS 2024Reconstruct and Match: Out-of-Distribution Robustness via Topological Homogeneity
  15. NeurIPS 2024RedCode: Multi-dimensional Safety Benchmark for Code Agents
  16. NeurIPS 2024RedCode: Risky Code Execution and Generation Benchmark for Code Agents
  17. NeurIPS 2024Refusal in Language Models Is Mediated by a Single Direction
  18. NeurIPS 2024Regularized Conditional Diffusion Model for Multi-Task Preference Alignment
  19. NeurIPS 2024Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs
  20. NeurIPS 2024Reimagining Mutual Information for Enhanced Defense against Data Leakage in Collaborative Inference
  21. NeurIPS 2024Relational Verification Leaps Forward with RABBit
  22. NeurIPS 2024ReMoDetect: Reward Models Recognize Aligned LLM's Generations
  23. NeurIPS 2024Reproducibility study of "Robust Fair Clustering: A Novel Fairness Attack and Defense Framework"
  24. NeurIPS 2024Reproducibility Study of "Robust Fair Clustering: A Novel Fairness Attack and Defense Framework"
  25. NeurIPS 2024Rethinking LLM Memorization through the Lens of Adversarial Compression
  26. NeurIPS 2024Revisiting Adversarial Patches for Designing Camera-Agnostic Attacks against Person Detection
  27. NeurIPS 2024Revisiting Few-Shot Object Detection with Vision-Language Models
  28. NeurIPS 2024Risk-Averse Fine-tuning of Large Language Models
  29. NeurIPS 2024Robust Conformal Prediction Using Privileged Information
  30. NeurIPS 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks
  31. NeurIPS 2024Robust Reinforcement Learning from Corrupted Human Feedback
  32. NeurIPS 2024RTify: Aligning Deep Neural Networks with Human Behavioral Decisions
  33. NeurIPS 2024Rule Based Rewards for Language Model Safety
  34. NeurIPS 2024Safe LoRA: The Silver Lining of Reducing Safety Risks when Finetuning Large Language Models
  35. NeurIPS 2024SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset
  36. NeurIPS 2024Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?
  37. NeurIPS 2024SafeWorld: Geo-Diverse Safety Alignment
  38. NeurIPS 2024SampDetox: Black-box Backdoor Defense via Perturbation-based Sample Detoxification
  39. NeurIPS 2024Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planes
  40. NeurIPS 2024Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms
  41. NeurIPS 2024Scanning Trojaned Models Using Out-of-Distribution Samples
  42. NeurIPS 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganography
  43. NeurIPS 2024Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  44. NeurIPS 2024SEEV: Synthesis with Efficient Exact Verification for ReLU Neural Barrier Functions
  45. NeurIPS 2024Selective Generation for Controllable Language Models
  46. NeurIPS 2024Self-Calibrated Tuning of Vision-Language Models for Out-of-Distribution Detection
  47. NeurIPS 2024Self-Calibrating Conformal Prediction
  48. NeurIPS 2024Self-Consuming Generative Models with Curated Data Provably Optimize Human Preferences
  49. NeurIPS 2024Self-Supervised Alignment with Mutual Information: Learning to Follow Principles without Preference Labels
  50. NeurIPS 2024SelfCodeAlign: Self-Alignment for Code Generation

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Alignment and Safety papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "alignment-and-safety"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Alignment and Safety papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
4,558 in total: 438 in 2023, 875 in 2024, 1,363 in 2025, 1,882 in 2026.
How many Alignment and Safety papers are at NeurIPS 2026?
NeurIPS 2026 has 480 Alignment and Safety papers, versus 455 the year before.
How many Alignment and Safety papers are at ICLR 2026?
ICLR 2026 has 623 Alignment and Safety papers, versus 473 the year before.
How many Alignment and Safety papers are at ICML 2026?
ICML 2026 has 551 Alignment and Safety papers, versus 300 the year before.
How many Alignment and Safety papers are at CVPR 2026?
CVPR 2026 has 228 Alignment and Safety papers, versus 135 the year before.
Which conference publishes the most Alignment and Safety papers?
NeurIPS, with 1,421 papers from 2023 to 2026.

More in Alignment and Responsible AI