Exploration-Exploitation papers, 2023–2026

Key findings

• Exploration-Exploitation went from 47 papers in 2023 to 71 in 2026, roughly 1.5x in three years.
• NeurIPS publishes the most Exploration-Exploitation work: 93 papers from 2023 to 2026, 40% of the four-venue total.
• The fastest-growing overlap is with Reasoning Models: papers tagged with both rose from 1 in 2023 to 10 in 2026.
• Among the 5 topics under Recommenders and Ads, it ranks #4 by 2026 paper count; the fastest grower in the group, Click-Through Prediction, is up 2.6x versus 1.5x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Decentralized Q-Learning in Markov Potential Games
• ICML 2026Bandit Social Leaning Dynamics with Exploration Episodes
• ICLR 2026Laplacian Kernelized Bandit
• CVPR 2026Underground Plant Exploration Non-Destructive 3D Root Assessment with GPR Based
• NeurIPS 2025DUET: Dual-Perspective Pseudo Labeling and Uncertainty-aware Exploration & Exploitation Training for Source-Free Domain Adaptation
• ICML 2025Clustering Items through Bandit Feedback: Finding the Right Feature out of Many
• ICLR 2025B-STaR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
• CVPR 2025Dynamic Pseudo Labeling via Gradient Cutting for High-Low Entropy Exploration
• NeurIPS 2024Exploration, Exploitation, and Engagement in Multi-Armed Bandits with Abandonment
• ICML 2024A Contextual Combinatorial Bandit Approach to Negotiation
• ICLR 2024Dropout-Based Rashomon Set Exploration for Efficient Predictive Multiplicity Estimation
• CVPR 2024Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation
• NeurIPS 2023Adaptive Algorithms for Relaxed Pareto Set Identification
• ICML 2023Curiosity in Hindsight: Intrinsic Exploration in Stochastic Environments
• ICLR 2023Combinatorial Pure Exploration of Causal Bandits
• CVPR 2023Exact-NeRF: An Exploration of a Precise Volumetric Parameterization for Neural Radiance Fields
• NeurIPS 2026Hit Expansion via Localized Exploration of Synthesizable Chemical Space
• ICML 2026Exploration-free Algorithms for Multi-group Mean Estimation
• ICLR 2026DIVERSE: Disagreement-Inducing Vector Evolution for Rashomon Set Exploration
• CVPR 2026From Exploration to Exploitation A Two-Stage Entropy RLVR Approach for

All Exploration-Exploitation papers

20 papers, page 1 of 1

1. NeurIPS 2025Balancing Performance and Costs in Best Arm Identification
2. NeurIPS 2025Bohdi: Heterogeneous LLM Fusion with Automatic Data Exploration
3. NeurIPS 2025Deployment Efficient Reward-Free Exploration with Linear Function Approximation
4. NeurIPS 2025DISCOVER: Automated Curricula for Sparse-Reward Reinforcement Learning
5. NeurIPS 2025DUET: Dual-Perspective Pseudo Labeling and Uncertainty-aware Exploration & Exploitation Training for Source-Free Domain Adaptation
6. NeurIPS 2025Exploration from a Primal-Dual Lens: Value-Incentivized Actor-Critic Methods for Sample-Efficient Online RL
7. NeurIPS 2025Exploration via Feature Perturbation in Contextual Bandits
8. NeurIPS 2025From Contextual Combinatorial Semi-Bandits to Bandit List Classification: Improved Sample Complexity with Sparse Rewards
9. NeurIPS 2025Geometry Meets Incentives: Sample-Efficient Incentivized Exploration with Linear Contexts
10. NeurIPS 2025Imagine Beyond ! Distributionally Robust Autoencoding for State Space Coverage in Online Reinforcement Learning
11. NeurIPS 2025Infrequent Exploration in Linear Bandits
12. NeurIPS 2025Instance-Dependent Regret Bounds for Nonstochastic Linear Partial Monitoring
13. NeurIPS 2025Non-Uniform Multiclass Learning with Bandit Feedback
14. NeurIPS 2025Novel Exploration via Orthogonality
15. NeurIPS 2025Order-Level Attention Similarity Across Language Models: A Latent Commonality
16. NeurIPS 2025Reinforcement Learning with Action Chunking
17. NeurIPS 2025Scalable Exploration via Ensemble++
18. NeurIPS 2025True Impact of Cascade Length in Contextual Cascading Bandits
19. NeurIPS 2025Uncertainty-Guided Exploration for Efficient AlphaZero Training
20. NeurIPS 2025Unveiling Transformer Perception by Exploring Input Manifolds

FAQ

How many Exploration-Exploitation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

235 in total: 47 in 2023, 63 in 2024, 54 in 2025, 71 in 2026.

How many Exploration-Exploitation papers are at NeurIPS 2026?

NeurIPS 2026 has 25 Exploration-Exploitation papers, versus 20 the year before.

How many Exploration-Exploitation papers are at ICLR 2026?

ICLR 2026 has 23 Exploration-Exploitation papers, versus 10 the year before.

How many Exploration-Exploitation papers are at ICML 2026?

ICML 2026 has 19 Exploration-Exploitation papers, versus 21 the year before.

How many Exploration-Exploitation papers are at CVPR 2026?

CVPR 2026 has 4 Exploration-Exploitation papers, versus 3 the year before.

Which conference publishes the most Exploration-Exploitation papers?

NeurIPS, with 93 papers from 2023 to 2026.