paperlist.ai

AI conference papers

AI conference paper library

Search papers from 30+ top conferences, including NeurIPS, ICLR, ICML, CVPR, ACL and AAAI. Filter by keyword, then open any paper for its abstract, authors and links.

ECCV 2026

PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models

Xianghui Wang, Feng Chen, Wenbo Zhang, Hua Yan, Zixuan Wang, Changsheng Li, Yinjie Lei

Vision-Language-Action (VLA) models provide a unifiedparadigm for robotic manipulation, yet their real-world deploymentremains limited by execution efficiency. While existing efforts predomi-nantly focus on compute-centric efficiency to reduce per-step inferencelatency, the intrinsic policy efficiency of these models remains largelyunexplored. Policy efficiency is fundamentally affected by two factors,namely the effective executable length of predicted action chunks and thetotal physical steps required to complete a task. These two factors jointlydetermine the number of forward inference calls during execution. Weobserve that current VLA policies struggle with planning unreliabilityand action redundancy, suffering from severe tail degradation in actionchunks and tending to generate redundant physical steps. To address this,we propose PolicyTrim, a reinforcement learning-based post-trainingframework that extends reliable action chunk length and reduces redun-dant physical steps. For reliable chunk extension, we employ a dynamicexploration strategy that rewards the successful completion of longer exe-cutable lengths, progressively pushing the trustworthy prediction horizonto its empirical limit. For step efficiency, we design a redundancy-awarereward that favors successful task completion with fewer steps whilepenalizing unreproducible shortcuts, effectively eliminating redundantphysical actions. Experiments on three benchmarks and three VLA mod-els show that PolicyTrim improves action chunk utilization by 3×, re-duces physical execution steps by 51.4%, and delivers up to a 5.83× end-to-end deployment speedup without compromising task success rates.Project Page: https://inceptionwang.github.io/PolicyTrim/

ECCV 2026

Physically Grounded Dual-Opacity Gaussian Splatting for Joint RGB-TIR Reconstruction

Jin Liu, Dabin leng, Jiagang Chen, Haodong LI, Jiguang Li, Zhao Huang, Xiaoshuai Zhang, Zhiwen Zheng, Xingru Huang, Qi Xu

3D Gaussian Splatting (3DGS) enables efficient novel-viewsynthesis, yet its extension to simultaneous RGB and thermal infrared(TIR) reconstruction is hindered by a fundamental spectral mismatch:RGB relies on reflected illumination while TIR captures emitted radi-ance. This disparity in frequency characteristics and physical sensingmechanisms causes gradient interference when naively sharing a unifiedrepresentation. Common methods typically treat TIR as an auxiliary in-tensity channel, ignoring the physical radiative transfer governing ther-mal imaging. Critically, enforcing a single opacity field across modalitiesis physically invalid due to cross-spectral visibility disparities, constrain-ing representational capacity and yielding thermally implausible recon-structions. To address these limitations, we propose Physically GroundedDual-Opacity Gaussian Splatting, a framework that unifies RGB andTIR reconstruction under a shared geometric scaffold with modality-aware visibility modeling. We introduce Radiative Attribute Parameter-ization, explicitly modeling each Gaussian’s thermal response throughemissivity, temperature, and reflectance. Dual-Opacity Rendering en-ables spectrally aware visibility handling by assigning modality-specificopacities to shared location parameters, resolving cross-modal occlusionconflicts. Training jointly optimizes photometric reconstruction, physicalpriors, and RGB-guided geometric regularization to resolve parameterambiguities. Experiments demonstrate competitive performance in bothradiometric accuracy and photorealistic novel view synthesis, highlight-ing the potential of 3DGS for joint thermal field with high-fidelity RGBreconstruction.

ECCV 2026

PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generation

Yuanhao Cai, Kunpeng Li, Menglin Jia, Jialiang Wang, Junzhe Sun, Feng Liang, Weifeng Chen, Felix Juefei-Xu, Chu Wang, Ali Thabet, Xiaoliang Dai, Xuan Ju, Alan Yuille, Ji Hou

Recent advances in text-to-video (T2V) generation have achieved good visual quality, yet synthesizing videos that faithfully followphysical laws remains an open challenge. Existing methods mainly basedon graphics or prompt extension struggle to generalize beyond simplesimulated environments or learn implicit physics reasoning. The scarcityof training data with rich physics interactions and phenomena is alsoa problem. In this paper, we first introduce a Physics-Augmented videodata construction Pipeline, PhyAugPipe, that leverages a vision–languagemodel (VLM) with chain-of-thought reasoning to collect a training dataset,PhyVidGen-135K. Then we formulate a principled Physics-aware Group-wise Direct Preference Optimization, PhyGDPO, framework that usesreal-world video as winning case to guarantee correct physics learningand builds upon the groupwise Plackett–Luce probabilistic model tocapture holistic preferences beyond pairwise comparisons. We design aPhysics-Guided Rewarding (PGR) scheme that uses VLM-based physicalrewards to direct the optimization to focus on challenging physics. Plus,we propose a LoRA-Switch Reference (LoRA-SR) scheme that avoidsfull-model duplication as reference for efficient training. Experimentsshow that our method outperforms state-of-the-art methods. Our codeand data is at https://github.com/caiyuanhao1998/Open-PhyGDPO

ECCV 2026

Pano3D: Unified 3D Reconstruction and Panoptic Segmentation

Victor Barberteguy, Ahmet Iscen, Mathilde Caron, Alireza Fathi, Gul Varol, Cordelia Schmid

Recent advances in 3D feedforward reconstruction neural net-works have achieved remarkable success in dense reconstruction from imageswithout any camera parameters. Yet, equipping these models with robustsemantic understanding remains an open problem. Here we introduce anapproach that performs 3D reconstruction and 3D panoptic segmentationin a unified framework. We build on existing 3D reconstruction models andaugment them with a set-based mask decoder. The approach is jointly trainedwith a geometric and semantic loss, which are shown to be mutually beneficial.More precisely, the features are initialized from the geometric informationand then finetuned to capture jointly geometry and semantics. We demon-strate the generality of our approach by successfully applying our frameworkboth to online and all-to-all attention reconstruction backbones. Our methodachieves state-of-the-art performance in 3D panoptic segmentation acrossScanNet, ScanNet200, and ScanNet++ datasets. Ablation studies show thatsuch joint training of a unified model equips 3D feedforward reconstructionneural networks with panoptic segmentation and yields mutually beneficialimprovements.

ECCV 2026

OneWorld: Taming Scene Generation with 3D Unified Representation Autoencoder

Sensen Gao, Zhaoqing Wang, Qihang Cao, Dongdong Yu, Changhu Wang, Tongliang Liu, Mingming Gong, JiaWang Bian

Existing diffusion-based 3D scene generation methods pri-marily operate in 2D image/video latent spaces, which makes maintain-ing cross-view appearance and geometric consistency inherently chal-lenging. To bridge this gap, we present OneWorld, a framework thatperforms diffusion directly within a coherent 3D representation space.Central to our approach is the 3D Unified Representation Autoencoder(3D-URAE); it leverages pretrained 3D foundation models and augmentstheir geometry-centric nature by injecting appearance and distilling se-mantics into a unified 3D latent space. Furthermore, we introduce token-level Cross-View-Correspondence (CVC) consistency loss to explicitly en-force structural alignment across views, and propose Manifold-Drift Forc-ing (MDF) to mitigate train–inference exposure bias and shape a robust3D manifold by mixing drifted and original representations. Comprehen-sive experiments demonstrate that OneWorld generates high-quality 3Dscenes with superior cross-view consistency compared to state-of-the-art2D-based methods.

ECCV 2026

Moving Beyond More Views: Redundancy-Aware Ego–Exo Fusion for Proficiency Estimation

Xu Dong, Wanqing Li, Anthony Adeyemi-Ejeye, Andrew Gilbert

EgoExo proficiency estimation aims to assess action qual-ity by integrating fine-grained motion cues from egocentric (1st-person)views with spatial context from multiple exocentric (3rd-person) views.Simply adding more exocentric views degrades EgoExo performance, asredundant or noisy perspectives dilute useful motion cues. Our anal-ysis identifies two key causes: (1) Multiview redundancy — Fromthe data perspective, certain views provide limited or noisy informa-tion, diluting discriminative cues; (2) Overfitting — From the featureperspective, conventional fusion increases representational complexity,causing the model to memorise view-specific patterns rather than learngeneralisable representations. To address these issues, we propose twocomplementary modules. AdaMVS adaptively identifies and fuses themost informative view tokens under weak supervision from the data per-spective, while VIB-GB combines Gradient Blending and VariationalInformation Bottleneck regularisation from the feature perspective tocompress redundant signals and suppress overfitting during training.Experiments on EgoExo-4D and EgoExo-Fitness demonstrate that ourmethod learns both which view to look at and how to fuse them,achieving new state-of-the-art results. Our source code is available athttps://github.com/dx199771/AdaMVS

ECCV 2026

Mind2Cloud: EEG-to-Point Cloud Generation with Two-Granularity Diffusion Decoding

Yongyi Lu, Xiongfeng Huang, Zhijing Yang

Reconstructing 3D objects from brain signals offers a promis-ing avenue for understanding human visual cognition. While prior workhas shown initial success using EEG signals for 3D reconstruction, ex-isting methods typically employ a uniform diffusion decoder, overlook-ing the evolving semantic granularity of both EEG representations andthe diffusion denoising process. In this paper, we propose Mind2Cloud, anovel EEG-to-point-cloud generation framework based on two-granularitydiffusion decoding. The core of Mind2Cloud is a time-aware decoder thatintegrates a global Transformer branch and a local Point-Voxel CNN(PVCNN) branch across diffusion timesteps through a learnable fusionmask. Specifically, Transformer layers are incorporated into the earlyupsampling stages to capture global object structure under high uncer-tainty, while PVCNN modules are used in later stages to refine local ge-ometric details. Inspired by the hierarchical nature of EEG-based visualrepresentations, this design dynamically adapts its spatial granularity inaccordance with the coarse-to-fine trajectory of diffusion denoising. Wefurther introduce an adversarial refinement module to enhance geometricrealism and semantic consistency. Extensive experiments on the EEG-3Ddataset across all 12 subjects demonstrate that Mind2Cloud outperformsprior work in both geometric accuracy and semantic alignment, settinga new benchmark for EEG-to-point-cloud generation. Our source code isavailable at https://github.com/duasoi/Mind2Cloud.

ECCV 2026

MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative Control

Kaiqi Liu, Yunyao Mao, Ziqi Cai, Zheng Geng, Jing Wang, Qiulin Wang, Xintao Wang, Pengfei Wan, Kun Gai, Shuchen Weng, Boxin Shi

While recent generative models produce high-fidelity videos,they struggle with the complex narrative control required for coherentmulti-shot audio-visual generation. Existing methods suffer from tem-poral misalignment, limited controllability, and incomplete scripting. Inthis paper, we propose MAVIN, the first framework for multi-shot audio-visual generation with customized narrative control. To resolve tempo-ral misalignment, we propose boundary-aware attention, which lever-ages hierarchical captions and boundary-aware token routing to renderaudio-visual elements within their respective temporal boundaries. Toimprove the controllability for multi-subject scenarios, we propose ID-aware propagation, utilizing identity embeddings and an identity-awaremask to bind specific identities to consistent visual appearances and vocaltimbres. To provide comprehensive audio-visual narratives, we present amulti-agent scripting pipeline to transform free-form user inputs into hi-erarchical captions. Furthermore, we construct MAVINSet, a multi-shotaudio-visual dataset for robust training and evaluation. Extensive exper-iments demonstrate that MAVIN achieves state-of-the-art performance,opening up a new avenue for integrating generative models into profes-sional filmmaking workflows.

ECCV 2026

HippoCamp: Benchmarking Contextual Agents on Personal Computers

Zhe Yang, Shulin Tian, Kairui Hu, Shuai Liu, Hoang-Nhat Nguyen, Yichi Zhang, Zujin Guo, Mengying Yu, Zinan Zhang, Jingkang Yang, Chen Change Loy, Ziwei Liu

We present HippoCamp, a new benchmark designed to eval-uate agents’ capabilities on multimodal file management. Unlike exist-ing agent benchmarks that focus on tasks like web interaction, tool-use, or software automation in generic settings, HippoCamp evaluatesagents in user-centric environments to model individual user profilesand search from massive personal files for context-aware reasoning. Ourbenchmark instantiates device-scale file systems over real-world profilesspanning diverse modalities, comprising 42.4 GB of data across over2K heterogeneous files. Building upon the raw files, we construct 581QA pairs to assess agents’ capabilities in search, evidence perception,and multi-step reasoning. To facilitate fine-grained analysis, we pro-vide 46.1K fine-grained trajectory annotations for step-wise failure di-agnosis. We evaluate a wide range of state-of-the-art multimodal large✉ Corresponding authors.language models (MLLMs) and agentic methods on HippoCamp. Ourcomprehensive experiments reveal a significant performance gap: eventhe most advanced commercial models achieve merely a 48.3% accu-racy in user profiling, struggling particularly with long-horizon retrievaland cross-modal reasoning within dense personal file systems. Further-more, our step-wise failure diagnosis identifies multimodal perceptionand evidence grounding as the primary bottlenecks. Ultimately, Hip-poCamp exposes the critical limitations of current agents in realistic,user-centric environments and provides a robust foundation for develop-ing next-generation personal AI assistants. Our dataset is publicly avail-able at: https://huggingface.co/datasets/MMMem-org/HippoCamp.

ECCV 2026

Hierarchical Style Aggregation for Versatile Chinese Handwriting Generation

Jiangpeng Wang, Fei Gao, Nannan Wang

Few-shot Chinese handwriting generation aims to render char-acters in a target style using limited references. Existing image-levelmethods often suffer from limited stylistic fidelity and poor general-ization. We propose Hierarchical Style Aggregation for Chinese hand-writing generation (HiSAC), a versatile framework that decouples stylemodeling from task-specific generation. Our core idea is to leverage thecompositional nature of Chinese characters: by decomposing charactersinto radicals, components, and strokes, we establish fine-grained spatialcorrespondences between target content and reference glyphs at eachlevel, enabling precise style transfer. To further capture nuanced stylecharacteristics, we design a multi-band frequency encoder that extractsstylistic representations across different spectral ranges. The aggregatedmulti-granularity features can be seamlessly integrated with task-specificdecoders (e.g., Transformer for online trajectory generation, Diffusion foroffline image synthesis) without architectural redesign. By jointly model-ing style in both spatial and frequency domains, our approach enhancesrealism in global structure and stroke dynamics. Extensive experimentsdemonstrate that HiSAC outperforms existing methods both quantita-tively and qualitatively, and generalizes well to out-of-vocabulary andcross-language scripts. Code has been released at https://github.com/IIP-Lab-XDU/HiSAC.

ECCV 2026

GroundSet: A Cadastral-Grounded Dataset for Spatial Understanding with Vector Data

Roger Ferrod, Maël Lecene, Krishna Sapkota, George Leifman, Vered Silverman, Genady Beryozkin, Sylvain Lobry

Precise spatial understanding in Earth Observation is essen-tial for translating raw aerial imagery into actionable insights for criti-cal applications like urban planning, environmental monitoring and dis-aster management. However, Multimodal Large Language Models ex-hibit critical deficiencies in fine-grained spatial understanding withinRemote Sensing, primarily due to a reliance on limited or repurposedlegacy datasets. To bridge this gap, we introduce a large-scale datasetgrounded in verifiable cadastral vector data, comprising 3.8 million an-notated objects across 510k high-resolution images with 135 granularsemantic categories. We validate this resource through a comprehensiveinstruction-tuning benchmark spanning seven spatial grounding tasks.Our evaluation establishes a robust baseline using a standard LLaVAarchitecture. We show that while current RS-specialized and commer-cial models (e.g., Gemini) struggle in zero-shot settings, high-fidelity su-pervision effectively bridges this gap, enabling standard architecturesto master fine-grained spatial grounding without complex architecturalmodifications. Data, pretrained model and code are available at: https://huggingface.co/datasets/RogerFerrod/GroundSet

ECCV 2026

G3AFT: Glance Guided Gradient Aligned Fine-Tuning for Visual Autoregressive Models

Jiayi Zhang, Xiefan Guo, Xinzhu Ma, Di Huang

Autoregressive models in vision have gained widespread at-tention under the scalable next-token prediction paradigm, representingimages as sequences of discrete tokens. Yet their optimization remainschallenging due to the non-differentiability of discrete token samplingand the prohibitive memory costs of full-sequence fine-tuning. We pro-pose G3 AFT, a novel end-to-end fine-tuning framework for discrete-tokenautoregressive models. Within this framework, we introduce two com-plementary techniques, i.e. Global Scope Gradient Recording (GSGR)and Noise Suppressed Gradient Projection (NSGP). GSGR selectivelyupdates periodically sampled tokens by leveraging coarse global signalsthat summarize the overall layout and long-range structure of the image.This design alleviates the prohibitive memory overhead of full-sequencefine-tuning while maintaining long-range coherence. In parallel, NSGPenhances surrogate gradient flow by explicitly aligning updates withsalient sampling alternatives and filtering out spurious signals introducedby softmax relaxations. By suppressing noisy gradient components andreinforcing causally consistent updates, NSGP provides a more faithfulapproximation to discrete sampling, ensuring faithful gradient propaga-tion across long autoregressive trajectories. To the best of our knowl-edge, this is the first method under the next-token prediction paradigmfor discrete-token autoregressive image generation that enables fully dif-ferentiable optimization across the entire generation process. Extensiveexperiments validate that G3 AFT achieves superior image quality andquantitative performance, providing a practical framework for fully dif-ferentiable fine-tuning of autoregressive image generation models. Codeis available at https://github.com/Wotoosh/G3AFT.

ECCV 2026

Flash-Refine: Frustum-Guided Local Incremental Learning for Efficient 3D Gaussian Splatting Completion

Nuocheng Ji, Hanyang Zhuang, Chunxiang Wang, Ming Yang

While 3D Gaussian Splatting (3DGS) has enabled real-time high-fidelity novel view synthesis, maintaining already-deployed static 3DGS assets remains difficult. When a local region is missing or blurred, retraining the whole scene from scratch is costly, while directly finetuning the asset on newly captured repair images causes severe degradation of unobserved views, and geometric stitching introduces boundary and depth conflicts. We propose Flash-Refine, a practical in-situ repair pipeline for static 3DGS assets that operates directly on a native PLY model without access to historical training images. Given newly registered repair views, Flash-Refine uses Point-Wise Consensus Masking and an Adaptive Depth-Bounded Prior to identify a bounded active region, applies Gradient Locking to frozen background Gaussians, propagates the mask through native densification, and protects frozen Gaussians from close-up pruning. Under this constrained active set, gradient-gated densification naturally allocates new parameters to the defective region, enabling rapid local completion from peripheral seeds. Extensive experiments on Deep Blending and Mip-NeRF 360 show that Flash-Refine achieves the best Dropped and Kept PSNR among practical repair methods across four scenes, while requiring only 2–4 minutes on an RTX 4090. We further analyze the method’s scope and limitations: it assumes static scenes and preregistered repair views, and although frozen background parameters remain unchanged, newly densified active Gaussians may still induce scene-dependent visibility interactions in unobserved views.

ECCV 2026

FDR-Occ: Factorized Dense Routing for Full-Spectrum 3D Occupancy Prediction

Dubing Chen, Huan Zheng, Tianyi Yan, Yucheng Zhou, Runzhou Tao, Zhongying Qiu, Jianfei Yang, Shen Jianbing

Vision-based 3D occupancy prediction fundamentally relieson the 2D-to-3D view transformation. Current paradigms predominantlyutilize explicit physical projection, which artificially restricts the routingmatrix to strict, sparse camera rays. While computationally efficient, thisimposes a severe Locality Bottleneck, preventing the network from con-structing holistic contextual understanding and degrading sharply whencamera extrinsics are unreliable or absent. To break this bottleneck, weabstract view transformation as unconstrained bipartite routing and pro-pose Factorized Dense Routing (FDR). By approximating dense2D-to-3D mixing through hierarchical tensor contractions, FDR guar-antees a fully-global receptive field with tractable, sub-quadratic com-plexity. Crucially, the mandatory spatial contraction in dense routingexposes a fundamental Resolution-Context Trade-off. To address this,we introduce a Resolution-Context Decoupled Architecture. Wefactorize the 3D space into a global macroscopic topological anchor (viaFDR) and precise local geometric planes (via explicit projection). Thisdecoupling enables global semantic inference and exact surface localiza-tion to complement each other without mutual compromise. Extensiveexperiments demonstrate that our framework achieves state-of-the-artperformance on the Occ3D-nuScenes and Occ3D-Waymo benchmarks.More notably, in an uncalibrated setting where physical extrinsics arewithheld, our global routing internalizes the implicit multi-camera rigtopology and exhibits substantially stronger structural robustness thanphysical-projection baselines under the same protocol.

ECCV 2026

EgoExoMoCap: Distributed Human Motion Capture via Ego- and Exocentric Body Tracking from Head-Mounted Devices

Jiaxi Jiang, Bharat Bhatnagar, Nan Yang, Lingni Ma, Sebastian Starke, Robin Kips, Nadine Bertsch (Rueegg), Christian Holz, Federica Bogo

Human motion capture from head-mounted devices (HMDs)offers a scalable way to acquire real-world human motion and interac-tion data, which is crucial for applications in embodied AI and VR/AR.Existing approaches focus on either egocentric body tracking, estimat-ing the motion of the subject wearing the device, or exocentric track-ing, capturing the movements of people in the wearer’s surroundings. Sofar, these two paradigms have largely been explored in isolation. In thispaper, we propose a novel distributed framework that jointly leveragesego- and exocentric multi-modal signals for human motion estimationfrom HMDs. Unlike traditional motion capture systems requiring bulkymulti-camera setups or obtrusive mocap suits, our approach, EgoExo-MoCap, is as simple as two (or more) people, each wearing a pair ofsmart glasses. The method leverages head (plus potentially wrist) track-ing signals for accurate estimation of global motion in the 3D world andcombines context-aware image features based on DINOv3 to achieve ro-bustness in the presence of noise and occlusions. Extensive experimentson two in-the-wild datasets show that our approach can robustly recon-struct motion even in challenging scenarios.

ECCV 2026

CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models

Yucheng Zhou, Peng Luo, Qianning Wang, Cheng-zhong Xu, Shen Jianbing

Large Language Models (LLMs) have shown strong potentialfor medical reasoning, yet the scarcity and cost of expert-annotated dataconstrain their progress. While reinforcement learning offers a scalable al-ternative, standard outcome-based methods in medicine often suffer fromautoregressive credit assignment failure and gradient variance explo-sion. This leads to the “Right Answer, Wrong Reason” trap, where mod-els inadvertently reinforce spurious correlations and dataset shortcutsrather than valid clinical deduction. In this work, we propose Causally-Aligned Reasoning Exploration (CARE), a theoretically groundedframework for intrinsic experience curation. CARE is built upon tworigorous conditions for high-quality training trajectories: Causal Suf-ficiency, which utilizes an agreement-based self-verification mechanismto mimic do-calculus interventions and effectively debias gradients; andProximal Learnability, which employs dynamic entropy bounds to se-lect experiences within the model’s zone of proximal development forvariance-bounded optimization. These rigorously filtered experiences areoptimized via a dual-stream objective that combines on-policy group-relative exploration with difficulty-weighted experience replay. Extensiveexperiments on diverse medical multimodal and text-only benchmarksdemonstrate that CARE consistently outperforms other strong competi-tors, substantially reducing correct-but-inconsistent reasoning and im-proving training stability.

ECCV 2026

AnchorGUI: Asymmetric Memory for Dual-Scale Learning in GUI Navigation

Shengjie Jin, Zelong Sun, Hengbo Xu, Yanbiao Ma, Zhiwu Lu

Vision-Language Models (VLMs) enable autonomous GUInavigation, but agents still struggle to process and learn from dense,continuous visual histories. This bottleneck hinders both immediate errorcorrection within a single episode (intra-trial) and experience distilla-tion across multiple attempts (cross-trial). We trace these challenges toan empirical informational asymmetry in GUI navigation: while expectedtransitions can often be compressed into lightweight textual summaries,unexpected outcomes benefit from preserved screenshots as causal evi-dence for accurate diagnosis. Building on this insight, we propose An-chorGUI, a unified framework driven by the Cognitive State Anchor(CSA). The CSA acts as a per-step primitive that actively comparesexpected and observed transitions, converting passive multimodal tra-jectories into explicit prediction-error signals. These signals orchestratea dual-scale learning mechanism via an asymmetric memory. Forintra-trial correction, a sliding window selectively retains visual evidencefor detected mismatches, providing immediate, visually-grounded feed-back. For cross-trial distillation, this asymmetric memory focuses thecomputationally expensive credit assignment search space on likely fail-ure steps. Experiments across four benchmarks validate the effectivenessof our approach. On AndroidWorld, AnchorGUI achieves a 57.3% successrate with a 2.4× token reduction per step. Furthermore, cross-trial distil-lation reaches 69.2% success (+11.9% gain), significantly outperformingstandard reflection methods while maintaining sub-linear context scaling.

ECCV 2026

Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection

Yang Guo, Zihan Yang, Feifei Kou, Yulan Hu, Ran Zhang, Siyuan Yao

Small Object Detection (SOD) is a fundamental yet chal-lenging problem in computer vision due to its limited spatial resolu-tion and weak visual cues. Although recent approaches have achievedremarkable advances, the background distractors in different frequencyspectra still degrade the performance. In this paper, we propose a novelsmall object detection framework termed SFDNet, which is capableof detecting small objects via efficient spectrum-aware feature disentan-glement. Specifically, we propose an Adaptive Spectrum Disentangle-ment (ASD) module that decomposes backbone features into multiplecomplementary spectral components, aiming to construct discriminativeobject-relevant representations by discarding the background distrac-tors for each component. Afterwards, to strengthen the semantic con-sistency of the similar objects in the same class, we propose a Class-Wise Prototype Distillation (CPD) procedure, which establishes classprototypes for the object instances and enforces the compact repre-sentation by efficient prototype distillation. Extensive experiments onmultiple challenging benchmarks show that SFDNet outperforms exist-ing state-of-the-art methods by a large margin. Our code is available athttps://github.com/ManOfStory/SFDNet.

ECCV 2026

Adapting MLLMs for Nuanced Video Retrieval

Piyush Nitin Bagad, Andrew Zisserman

Our objective is to build an embedding model that capturesthe nuanced relationship between a search query and candidate videos.We cover three aspects of nuanced retrieval: (i) temporal, (ii) negation,and (iii) multimodal. For temporal nuance, we consider chiral actionsthat need distinguishing between temporally opposite actions like “open-ing a door” vs. “closing a door”. For negation, we consider queries withnegators such as “not”, “none” that allow a user to specify what theydo not want. For multimodal nuance, we consider the task of composedretrieval where the query comprises a video along with a text edit in-struction. The goal is to develop a unified embedding model that handlessuch nuances effectively. To that end, we repurpose a Multimodal LargeLanguage Model (MLLM) trained to generate text into an embeddingmodel. We fine-tune it with a contrastive loss on text alone with carefullysampled hard negatives that instill the desired nuances in the learned em-bedding space. Despite the text-only training, our method achieves stateof the art performance on all benchmarks for nuanced video retrieval. Wealso analyze how this improvement is achieved, and show that text-onlytraining reduces the modality gap between text and video embeddingsleading to better organization of the embedding space.

ECCV 2026

X-Stream: Benchmarking MLLMs as Multiplexers for Multi-Stream Understanding

Peiwen Sun, Xudong Lu, Huadai Liu, Yang Bo, Dongming Wu, Huankang Guan, Minghong Cai, Jinpeng Chen, Xintong Guo, Shuhan LI, Fang Liu, Rui Liu, Xiangyu Yue

While video streaming understanding has made significantstrides, real-world applications, such as live sports broadcasting, au-tonomous driving, and multi-screen collaboration, inherently demandcontinuous, multi-stream interactions. However, existing benchmarks areconfined to single-stream paradigms, leaving a critical gap in evaluatingonline, cross-stream reasoning. To bridge this, we introduce X-Stream,the first benchmark dedicated to multi-stream streaming understand-ing. Comprising 4,220 rigorously curated QA pairs across 932 videos,X-Stream evaluates 11 subtasks across multi-window, multi-view, andmulti-device scenarios. Crucially, our dataset is constructed using a noveldual-verification pipeline that prevents over-reliance on a single stream.Furthermore, we pioneer the conceptualization of multi-modal large lan-guage models (MLLMs) as naive multiplexers, systematically evaluat-ing their performance through the lens of Signal Multiplexing Theory. Ourextensive online inference experiments reveal a stark reality: state-of-the-art MLLMs struggle significantly with concurrent streams, achieving only∼50% score and exhibiting a poor proactive ability. Ultimately, X-Streamexposes the trade-off of current multiplexing schemes, providing both apractical evaluation protocol and empirical guidance for next-generationmulti-stream agents. Code and data are released at Œhomepage.

Keep browsing

More papers from top AI conferences

30+ top conferences, by conference, year, and topic.