FIRE: Learning to Navigate and Act on Real-World Files via Stateful Reinforcement Learning

摘要

Large language models still struggle to reliably answer questions grounded in real-world files like spreadsheets and slides, where evidence is scattered across irregular layouts and heterogeneous formats. We address this by formalizing File Reasoning, a setting where agents must interact directly with unprocessed files (XLSX, PDF, DOCX, PPTX) within a persistent sandbox. To support this, we introduce a unified data pipeline and a high-difficulty benchmark of over 400 verifiable questions that preserve native file structure. Furthermore, we propose a reinforcement learning framework grounded in stateful file execution. We train **FIRE** (**F**ile **I**nteractive **R**easoning **E**xpert), a family of models that learn to optimize long-horizon planning using genuine execution feedback. Unlike stateless tool-use methods, this environmental persistence enables agents to iteratively recover from errors and adapt to structural ambiguities. Empirical results show that Qwen3-32B-FIRE achieves the strongest performance among the open-source models of comparable scale under identical execution constraints.