Exploration-Exploitation papers, 2023–2026

Key findings

• Exploration-Exploitation went from 47 papers in 2023 to 71 in 2026, roughly 1.5x in three years.
• NeurIPS publishes the most Exploration-Exploitation work: 93 papers from 2023 to 2026, 40% of the four-venue total.
• The fastest-growing overlap is with Reasoning Models: papers tagged with both rose from 1 in 2023 to 10 in 2026.
• Among the 5 topics under Recommenders and Ads, it ranks #4 by 2026 paper count; the fastest grower in the group, Click-Through Prediction, is up 2.6x versus 1.5x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Decentralized Q-Learning in Markov Potential Games
• ICML 2026Bandit Social Leaning Dynamics with Exploration Episodes
• ICLR 2026Laplacian Kernelized Bandit
• CVPR 2026Underground Plant Exploration Non-Destructive 3D Root Assessment with GPR Based
• NeurIPS 2025DUET: Dual-Perspective Pseudo Labeling and Uncertainty-aware Exploration & Exploitation Training for Source-Free Domain Adaptation
• ICML 2025Clustering Items through Bandit Feedback: Finding the Right Feature out of Many
• ICLR 2025B-STaR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
• CVPR 2025Dynamic Pseudo Labeling via Gradient Cutting for High-Low Entropy Exploration
• NeurIPS 2024Exploration, Exploitation, and Engagement in Multi-Armed Bandits with Abandonment
• ICML 2024A Contextual Combinatorial Bandit Approach to Negotiation
• ICLR 2024Dropout-Based Rashomon Set Exploration for Efficient Predictive Multiplicity Estimation
• CVPR 2024Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation
• NeurIPS 2023Adaptive Algorithms for Relaxed Pareto Set Identification
• ICML 2023Curiosity in Hindsight: Intrinsic Exploration in Stochastic Environments
• ICLR 2023Combinatorial Pure Exploration of Causal Bandits
• CVPR 2023Exact-NeRF: An Exploration of a Precise Volumetric Parameterization for Neural Radiance Fields
• NeurIPS 2026Hit Expansion via Localized Exploration of Synthesizable Chemical Space
• ICML 2026Exploration-free Algorithms for Multi-group Mean Estimation
• ICLR 2026DIVERSE: Disagreement-Inducing Vector Evolution for Rashomon Set Exploration
• CVPR 2026From Exploration to Exploitation A Two-Stage Entropy RLVR Approach for

All Exploration-Exploitation papers

25 papers, page 1 of 1

1. ICML 2024A Contextual Combinatorial Bandit Approach to Negotiation
2. ICML 2024Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models
3. ICML 2024BAGEL: Bootstrapping Agents by Guiding Exploration with Language
4. ICML 2024Bayesian Exploration Networks
5. ICML 2024Constrained Exploration via Reflected Replica Exchange Stochastic Gradient Langevin Dynamics
6. ICML 2024Efficient Exploration for LLMs
7. ICML 2024Exploration and Anti-Exploration with Distributional Random Network Distillation
8. ICML 2024Exploration by Optimization with Hybrid Regularizers: Logarithmic Regret with Adversarial Robustness in Partial Monitoring
9. ICML 2024Fair Classification with Partial Feedback: An Exploration-Based Data Collection Approach
10. ICML 2024Geometric Active Exploration in Markov Decision Processes: the Benefit of Abstraction
11. ICML 2024Handling Heterogeneous Curvatures in Bandit LQR Control
12. ICML 2024Imitation Learning in Discounted Linear MDPs without exploration assumptions
13. ICML 2024Online Learning with Bounded Recall
14. ICML 2024Online Resource Allocation with Non-Stationary Customers
15. ICML 2024Optimal Batched Linear Bandits
16. ICML 2024Provably Efficient Exploration in Quantum Reinforcement Learning with Logarithmic Worst-Case Regret
17. ICML 2024Provably Efficient Long-Horizon Exploration in Monte Carlo Tree Search through State Occupancy Regularization
18. ICML 2024Random Latent Exploration for Deep Reinforcement Learning
19. ICML 2024ReconBoost: Boosting Can Achieve Modality Reconcilement
20. ICML 2024Safe and Robust Subgame Exploitation in Imperfect Information Games
21. ICML 2024Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants
22. ICML 2024Scalable Online Exploration via Coverability
23. ICML 2024Stochastic Bandits with ReLU Neural Networks
24. ICML 2024Straight-Through Meets Sparse Recovery: the Support Exploration Algorithm
25. ICML 2024Testing the Feasibility of Linear Programs with Bandit Feedback

FAQ

How many Exploration-Exploitation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

235 in total: 47 in 2023, 63 in 2024, 54 in 2025, 71 in 2026.

How many Exploration-Exploitation papers are at NeurIPS 2026?

NeurIPS 2026 has 25 Exploration-Exploitation papers, versus 20 the year before.

How many Exploration-Exploitation papers are at ICLR 2026?

ICLR 2026 has 23 Exploration-Exploitation papers, versus 10 the year before.

How many Exploration-Exploitation papers are at ICML 2026?

ICML 2026 has 19 Exploration-Exploitation papers, versus 21 the year before.

How many Exploration-Exploitation papers are at CVPR 2026?

CVPR 2026 has 4 Exploration-Exploitation papers, versus 3 the year before.

Which conference publishes the most Exploration-Exploitation papers?

NeurIPS, with 93 papers from 2023 to 2026.