paperlist.ai

AI conference papers

AI conference paper library

Search papers from 30+ top conferences, including NeurIPS, ICLR, ICML, CVPR, ACL and AAAI. Filter by keyword, then open any paper for its abstract, authors and links.

ECCV 2026

CubicSplat: Differentiable Vector Graphics via Error-Bounded Forward Relaxation

Chenglong Liu, Xin Zhang, Yimeng Zhu, Liyang He, Yixiao Ma, Yu Su, Zhenya Huang, Qi Liu

Vector graphics are prized for their resolution independence,compact storage, and direct editability, making differentiable optimiza-tion of their parametric primitives an attractive goal. Yet classical ras-terization is discontinuous with respect to geometry, and existing reme-dies that smooth the forward pass demand increasingly elaborate heuris-tics as scene complexity grows. We trace this fragility to a gradientseesaw: design choices that improve forward geometric exactness cansystematically degrade the induced gradient signal, and vice versa. Tonavigate this tension we introduce CubicSplat, a differentiable vectorrasterizer that replaces Bézier closest-point solvers with uniform poly-line surrogates whose geometric error is bounded at O(S −2 ). The re-sulting static computation graph yields well-conditioned gradients byconstruction, while a compositing-derived visibility mechanism prunesdegenerate primitives without auxiliary regularization. On DIV2K andKodak benchmarks CubicSplat achieves state-of-the-art reconstructionquality with over 2 dB PSNR gain in the closed-fill setting, while train-ing up to 4× faster than prior methods. The code is available at https://github.com/CubicSplat/repo

ECCV 2026

Cross-View Yaw Estimation in Location Uncertainty with Line-Aligning Yaw Scoring

Taeho Kang, Nairan Zhang, Yelin Kim, Yujiao Shi, Youngki Lee

Accurate yaw estimation is a bottleneck in cross-view lo-calization between ground view and Bird’s Eye View (BEV). Existingmethods couple yaw with translation and rely on height or projectionassumptions that degrade under large yaw ambiguity. We disentangleyaw from location accuracy and introduce LAYS, a radially invariantline-consensus voting method. By exploiting the radial invariance of ourformulation, we achieve sub-degree yaw precision via 3D voting over allcandidate poses, while eliminating the need for accurate location. Ourkey observation is that a ground-image column matched to BEV pixelsinduces the same yaw across all camera positions along the radial direc-tion of the pixels. LAYS matches BEV pixels to ground columns usingfeature similarity and accumulates the induced yaw votes into discrete3D bins, where correct correspondences along the radial line concentrateinto a sharp peak for the correct yaw. Experiments on Mapillary, Ford,KITTI, and VIGOR show significant gains under unknown yaw, particu-larly for normal FoV with unknown yaw (+28∼45%p), and using LAYSas a yaw prior improves downstream 3-DoF localization.

ECCV 2026

Continuous Speculative Decoding for Autoregressive Image Generation

Zili Wang, Zheng Zhang, Kun Ding, Qi Yang, Fei Li, Shiming Xiang

Continuous visual autoregressive (AR) models have demon-strated promising performance in image generation, but their inherentlysequential nature results in slow inference speed. Speculative decoding, asuccessful acceleration technique for large language models (LLMs), haseffectively accelerated discrete visual AR models. However, the absenceof an analogous theory for continuous distributions precludes its use inaccelerating continuous AR models. To fill this gap, this work presentscontinuous speculative decoding, and addresses challenges from: 1) lowacceptance rate, caused by inconsistent output distribution modeled bytarget and draft models, and 2) modified distribution without analyticexpression, caused by a complex integral. For challenge 1), we addresslow acceptance rates through an approximated criterion, a novel denois-ing trajectory alignment strategy based on reparameterization proximity,and token pre-filling. For challenge 2), we introduce acceptance-rejectionContinuous speculative decodingDiscrete speculative decoding Proposal distribution VerificationProposal distribution VerificationDraft model Target model Draft model Target modelY Inconsistency existsYModified distribution NModified distributionResample Modify & Modify & NNormalize NormalizeNo analytic expression Hard to integrateFig. 2: Comparison between discrete and continuous speculative decoding. Discretesituation offers the convenience of directly computing probabilities and simply samplingfrom modified distributions. In contrast, continuous situation faces challenges in theinconsistency of output distributions, leading to low acceptance criterion as well as lowacceptance rate, and the modified distributions without analytic expression, caused bycomplex integral.sampling algorithm with an appropriate upper bound, thereby avoid-ing explicitly calculating the integral. Furthermore, our denoising trajec-tory alignment is also reused in acceptance-rejection sampling, effectivelyavoiding repetitive diffusion model inference. Extensive experiments onvarious models at 256×256 and 512×512 resolutions demonstrate thatour approach achieves over 2× wall-time speedup while preserving theimage generation quality.

ECCV 2026

Continuous Heart Rate Variability Estimation from Egocentric Systems for Skill Assessment

Berken Utku Demirel, Christian Holz

Egocentric vision systems capture human behavior from visi-ble cues, but overlook physiological indicators of autonomic states suchas stress, engagement, and attention. Heart rate variability (HRV) is awidely used noninvasive marker of autonomic regulation under stress.HRV reflects small timing differences between successive heartbeats andhas so far been out of reach for egocentric platforms, where motion andnoise in gaze video mask exactly this fine-grained timing. We proposeEgoHRV, a method that estimates HRV as well as heart rate (HR) fromthe gaze cameras that are already integrated into egocentric headsets. Ourpipeline combines a 3D backbone with a novel low–high decompositionmodule that extracts the blood volume pulse (BVP) signal from gazevideo. Our cross-domain pretraining aligns the frequency-domain repre-sentations of contact-based and camera-derived signals. This alignmentgives EgoHRV the temporal precision to recover HRV from the subtlefluctuations in gaze video. EgoHRV achieves state-of-the-art accuracy forHR and HRV estimation from egocentric video, and its uncertainty-awaredesign improves downstream behavioral modeling. Integrating our HRVestimates and confidence measures into EgoExo4D’s proficiency estimatorraises accuracy by 17.8%. Beyond skill, continuous HRV estimation alsoopens egocentric systems to stress- and arousal-aware estimation tasks.Code: https://github.com/eth-siplab/EgoHRV

ECCV 2026

Ceptor: Vision-Language Model-Infused Diverse Guidance for Detecting Anything

Jinyang Li, Bin-Bin Gao, Weifu Fu, Jingnan Luo, Hanqiu Deng, Yue Guo, Jun Liu, Yong Liu, Chengjie Wang, Wenbing Tao

Open-set object detection leverages language prompts toguide the perception of categories outside the training set. However,for categories that are difficult to describe or cannot be effectively ab-stracted semantically, models exhibit reduced receptiveness to guidanceprovided by textual descriptions. Recent approaches have explored vi-sual prompting, but they often lack inherent generalization capabilitiesand suffer from limitations in semantic, spatial, and contextual aware-ness during prompt construction. Additionally, isolated prompt path-ways hinder unified optimization. Inspired by the general process of hu-man object search, we designed Ceptor, a unified detector guided bydiverse prompts for open-set object detection. Specifically, we proposeInfusion Strategies to infuse our framework with the generalizationcapabilities of a vision-language model (VLM), leveraging its alignmentproperties and generalizable feature space to construct diverse promptsfor different object types and varying category distributions. Further-more, we introduce a novel prompt generation method, PRE, whicheffectively preserves generalization, contextual information, and spatialaccuracy. Harmonization strategies are also incorporated to ensurecoordinated optimization across various prompts. Ceptor achieves strongperformance with various prompts across multiple datasets, demonstrat-ing the effectiveness of our methodology. Models and code are releasedat https://github.com/jinyanglii/Ceptor.

ECCV 2026

BitRIC: Efficient Neural Compression of LiDAR Range Images via Hierarchical Bitplanes

kang you, Tong Chen, Dandan Ding, M. Salman Asif, Zhan Ma

The rapid evolution of 3D scene understanding relies heav-ily on high-resolution LiDAR, which generates massive data volumesthat impose significant bottlenecks on transmission and storage. WhileRange Image Compression (RIC) provides a more structured and com-putationally efficient alternative to conventional Point Cloud Compres-sion (PCC), existing RIC frameworks frequently fail to achieve an op-timal trade-off between coding efficiency and real-time performance. Tobridge this gap, we propose BitRIC, a novel learning-based frameworktailored for high-performance LiDAR range image compression. BitRICdecomposes raw range images into hierarchical bitplanes and processesthem through a coarse-to-fine autoregressive entropy model. At its core, ashared contextual backbone leverages cross-bitplane dependencies to in-form two specialized pathways: a Probability Estimation Module (PEM)that predicts probability maps for lossless entropy coding, and a One-Step Refinement Module (ORM) that reconstructs residual details dur-ing bitplane truncation for lossy compression. Extensive experiments onthe Waymo Open Dataset and SemanticKITTI demonstrate that BitRICachieves superior rate-distortion performance, yielding over 60% BD-BRsavings compared to standard image codecs, while offering higher down-stream task accuracy. Furthermore, BitRIC supports real-time lossy andnear-real-time lossless processing, making it a highly practical candidatefor real-world applications.

ECCV 2026

Anatomy of a Lie: A Multi-Stage Diagnostic Framework for Tracing Hallucinations in Vision-Language Models

Lexiang Xiong, Qi Li, Jingwen Ye, Xinchao Wang

Vision-Language Models (VLMs) frequently `hallucinate'_x0015_generate plausible yet factually incorrect statements_x0016_posing a criticalbarrier to their trustworthy deployment. In this work, we propose a newparadigm for diagnosing hallucinations, recasting them from static out-put errors into an auditable process-level anomaly. Our framework isgrounded in a normative principle of computational rationality, allowingus to model a VLM's generation as a dynamic cognitive trajectory. Wedesign a suite of information-theoretic probes that project this trajec-tory onto an interpretable, low-dimensional Cognitive State Space.Our central discovery is a governing principle we term the geometric-information duality: a cognitive trajectory's geometric abnormalitywithin this space is fundamentally equivalent to its high information-theoretic surprisal. Hallucination detection is thus elegantly re-framedas a geometric anomaly detection problem. Evaluated across diversesettings_x0016_from rigorous binary QA (POPE) and comprehensive reason-ing (MME) to unconstrained open-ended captioning (MS-COCO)_x0016_ourframework achieves state-of-the-art performance. Crucially, it operateswith high e_x001E_ciency under weak supervision and remains highly robusteven when calibration data is heavily contaminated. This approach en-ables a causal attribution of failures, mapping observable errors to dis-tinct pathological states: perceptual instability (measured by Percep-tual Entropy, HEvi ), logical-causal failure (measured by InferentialCon_x001D_ict, SConf ), and decisional ambiguity (measured by Decision En-tropy, HAns ). Ultimately, this opens a path toward building AI systemswhose reasoning is transparent, auditable, and diagnosable by design.

ECCV 2026

V-REX: Benchmarking Exploratory Visual Reasoning via Chain-of-Questions

Chenrui Fan, Yijun Liang, Shweta Bhardwaj, Kwesi Cobbina, Ming Li, Tianyi Zhou

While many vision language models (VLMs) are developed to passively answer well-defined, straightforward questions with highly specified targets, as in most benchmarks, they often struggle in practice with complex open-ended tasks, which usually require multiple rounds of active exploration and reasoning in the visual space. Such visual thinking paths not only provide step-by-step exploration and verification as an AI detective but also produce better interpretations of the final answers. However, these paths are challenging to evaluate due to the large exploration space of intermediate steps. To bridge the gap, we develop an evaluation suite, “Visual Reasoning with multi-step EXploration (V-REX)”, which is composed of a benchmark of challenging visual reasoning tasks requiring native multi-step exploration and an evaluation protocol. V-REX casts the multi-step exploratory reasoning into a Chain-of-Questions (CoQ) and disentangles VLMs’ capability to (1) Planning: determining the exploratory direction to gather information at each step for solving the task; and (2) Following: answering curated CoQ sequentially to collect information for deriving the final answer. By curating finite options of questions and answers per step, V-REX achieves a reliable quantitative and finegrained analysis of the intermediate steps. By assessing SOTA proprietary and open-sourced VLMs, we reveal consistent scaling trends, significant differences between planning and following abilities, and substantial room for improvement in multi-step exploratory reasoning.

ECCV 2026

Allo{SR}2: Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flows

Zihan Wang, Xudong Huang, Junbo Qiao, Wei Li, Jie Hu, Xinghao Chen, Shaohui Lin

Real-world image super-resolution (Real-SR) has been rev-olutionized by leveraging the powerful generative priors from DiffusionModels (DMs) and Flow Matching (FM). However, existing one-stepmethods typically replace Gaussian noise with degraded low-resolution(LR) latents at initialization, introducing a substantial distribution shiftthat further leads to trajectory deviation and prior collapse under ex-treme acceleration. To overcome these limitations, we propose Allo{SR}2 ,a novel FM-based framework that rectifies one-step SR flows via allomor-phic generative flows to maintain high-fidelity generative realism. Specifi-cally, we utilize SNR-Guided Trajectory Initialization to identify a statis-tically aligned intermediate state along the pre-trained path to integrateLR representations into the generative flow. To ensure a stable, low-curvature path for one-step inference, we propose Flow-Anchored Trajec-tory Consistency (FATC), which explicitly regularizes the velocity fieldof the underlying probability flow. Furthermore, we develop AllomorphicTrajectory Matching (ATM), a self-adversarial distillation strategy thatjointly models the SR flow and the generative flow within a unified ve-locity field, enabling one-step Real-SR while preserving the generativeprior. Extensive experiments on both synthetic and real-world bench-marks demonstrate that Allo{SR}2 achieves state-of-the-art performancein one-step Real-SR, offering a superior balance between fidelity and re-alism while maintaining extreme efficiency.

ECCV 2026

Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPO

Xin Zhang, Haochen Wang, Yikang Zhou, Zhuochen Wang, Robby T. Tan, Xiangtai Li

This paper introduces Actor as Its Own Critic, a unifiedreinforcement learning framework, Cycle Group Relative Policy Opti-mization (CycleGRPO), that jointly optimizes region understanding andlocalization for Multimodal Large Language Models (MLLMs). Unlikeexisting separate pipelines, we leverage the inherent duality between thetwo tasks to construct a self-evaluating reinforcement learning paradigm:“region → text → region”. Specifically, a single MLLM first acts as theactor to generate region captions, then immediately transitions to a criticto ground its generated text back in the spatial domain. Therefore, Cy-cleGRPO requires only region inputs, e.g., masks or bounding boxes,entirely bypassing the need for textual ground truths. A quality-awaretoken-level cycle-consistency reward is employed to assess the seman-tic discriminability of text captions via their physical localization ac-curacy. Empirically, built upon SAMTok, our CycleGRPO frameworksuccessfully bootstraps both capabilities simultaneously. Without anytask-specific fine-tuning, the framework yields consistent performancegains across a wide range of benchmarks, including region captioning,region VQA, grounded dialogue, and referring segmentation. Overall,CycleGRPO offers a straightforward and scalable way to advance pixel-level capabilities in MLLMs. Code and models are released at https://github.com/devinxzhang/CycleGRPO.

ECCV 2026

Evaluating and Understanding Model Editing for Medical Vision Language Models

Guli Zhu, Chenwei Wu, Liyue Shen

Model editing promises a fast, targeted way to correct postdeployment mistakes in medical vision–language models (VLMs) without costly retraining. However, existing multimodal model editing benchmarks focus on general-purpose tasks and do not reflect realistic clinical domain requirements and variability. To address this, we introduce M3Bench, a clinically grounded benchmark for multimodal model editing that evaluates whether an edit remains reliable, precise and generalizable under the challenges of image and text variation, modality and protocol shifts, clinical knowledge composition, and temporal progression. M3Bench contains 16,276 questions spanning diverse anatomy, modalities, and specialties, and supports both single and sequential edits: Evaluating 4 representative editors across 6 medical and general VLMs, we indicate that no method excels across all criteria. Gradient-based editors achieve strong transfer but suffer from catastrophic locality violations, whereas memory-based methods preserve locality but lack compositional generality and exhibit high backbone-dependent hyperparameter sensitivity. We further attribute these failures to the latent space geometry of VLMs and how different editing methods shift its landscape. Overall, M3Bench establishes a rigorous clinical stress test for multimodal model editing and offers actionable guidance for safer post-deployment adaptation. The benchmark is publicly available at https://github.com/BioMed-AI-Lab-U-Michgan/M3Bench.

ECCV 2026

A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models

Nuo Chen, Lulin Liu, Zihao Li, Ziyao Zeng, Zihao Zhu, Wenyan Cong, Junyuan Hong, Yunhao Yang, Zhengzhong Tu, Yan Wang, Boris Ivanovic, Marco Pavone, Zhangyang Wang, Yang Zhou, Zhiwen Fan

Generative world models hold immense promise as scalablesimulators for autonomous systems, particularly for synthesizing rare butsafety-critical multi-agent interactions, such as vehicle collisions. How-ever, current evaluation paradigms index heavily on visual fidelity and se-mantic alignment, leaving a critical blind spot: they cannot reliably quan-tify whether generated dynamics actually obey the fundamental physicallaws required for reliable simulation. Assessing this physical plausibilityis inherently difficult due to a lack of physical metrics and the challengeof extracting metric-scale kinematics from uncalibrated video rollouts.To bridge this gap, we introduce CrashTwin, a physics-grounded eval-uation framework designed to stress-test the physical trustworthiness ofworld models. CrashTwin couples a diverse dataset of multi-agent colli-sion scenarios, comprising 25K controllable synthetic and 12K in-the-wildreal-world collision sequences with a novel calibration-free reconstruc-tion pipeline, enabling the recovery of 3D physical attributes directlyfrom world model rollouts. We propose a diagnostic suite that systemat-ically evaluates three dimensions: spatio-temporal consistency, momen-tum and kinetic energy conservation, and world-dynamics integrity. Ex-tensive benchmarking of state-of-the-art models reveals a crucial insight:high perceptual quality frequently masks severe physical violations dur-ing complex interactions. By quantitatively exposing these failure modes,CrashTwin provides a vital diagnostic tool for developing physicallygrounded world models capable of reliable real-world simulation. Codeand dataset are available at: https://github.com/phai-lab/CrashTwin.

ECCV 2026

WildCity: A Real-World Dataset for City-Scale Rendering and Beyond

Xiangyu Han, Mengyu Yang, Jiaqi Li, Bowen Chang, Ziyu Chen, Hexu Zhao, Rahul Agrawal, Anthony Rodriguez, Rajani Acharya, Fiona Hua, Marco Pavone, Chen Feng, Yiming Li

Humans can navigate an unfamiliar city and gradually forma coherent spatial mental map spanning tens of square kilometers. CanAI build spatial representations at a comparable scale? Although recentfoundation models have advanced scene reconstruction and embodied in-telligence, scaling to entire cities remains an open challenge, primarilydue to the lack of city-scale data. To bridge the gap, we introduce Wild-City, a real-world multimodal dataset collected by autonomous fleetstraversing complex urban environments. Our dataset includes 18 tra-jectories, each averaging 83.7 kilometers in length, and preserves thecore challenges of in-the-wild perception, e.g., dynamic objects, lightingvariations, and imperfect camera poses. We further establish an urban-tailored reconstruction baseline and convert the reconstructed environ-ments into a closed-loop simulator. Beyond the dataset and baseline, wesystematically analyze the key challenges on the path to simulation-readyurban digital twins: scalability, extrapolation, and uncertainty. Ul-timately, WildCity aims to catalyze progress not only in city-scale render-ing, but more broadly in the pursuit of AI that can perceive, remember,and reason across space at a scale comparable to human cognition.

ECCV 2026

VideoSfM: Exploiting Temporal Structure for Video-Based Structure-from-Motion

Zador Pataki, Paul-Edouard Sarlin, Marc Pollefeys

Accurately recovering the camera’s calibration and metricposes for any unconstrained video would unlock large-scale training datafor navigation and scene understanding. The dominant approaches tothis problem are severely limited: Simultaneous Localization and Map-ping (SLAM) is sensitive to initialization and transient failures due to itscausal, incremental nature; it is often over-optimized for real-time oper-ation and generally requires known camera calibration; while Structure-from-Motion (SfM) typically forgoes any image ordering, enabling opti-mal initialization and global optimization, but lacks robustness to visualsymmetries and extreme motions. To bridge this gap, we introduce asystem that combines the strong sequential constraints of SLAM withthe flexibility and global optimization of offline SfM, enabling the met-ric reconstruction of arbitrary, long, uncalibrated videos. This systemleverages recent advances in wide-baseline dense image matching, treatstemporal ordering as a first-class citizen for reliable loop closure, andaugments global optimization with metric monocular depth priors. Asa result, thorough evaluations on diverse, challenging datasets that ex-hibit extreme motion and visual symmetries reveal that our approach issignificantly more robust and accurate than both state-of-the-art SLAMand SfM, classical or learned, with given or unknown camera calibration.

ECCV 2026

UniTac: A Unified Multimodal Model for Cross-Sensor Tactile Understanding and Generation

Jiahang Tu, Fengyu Yang, Chenyang Ma, Xihang Yu, Ziyao Zeng, Shaokai Wu, Hanbin Zhao, Zhi Tao, Chao Zhang, Hui Qian, Alex Wong

Unified multimodal models (UMMs) have shown great promise in integrating understanding and generation across diverse modalities. However, existing research rarely extends this paradigm to the tactile domain, where both object-level semantics and sensor-level configurations jointly determine the meaning of touch. To address this gap, we propose UniTac, the first UMM designed for tactile understanding and generation. UniTac models the tactile process as a transition from noncontact to contact, capturing the physical interaction between sensors and objects through a dual-level representation that encodes both sensor and object attributes. For tactile understanding, UniTac introduces two tasks, object property description and sensor identification, to enhance reasoning over physical and cross-sensor information. For tactile generation, we design a two-stage training paradigm consisting of reconstruction and alignment, together with a sensor-prior-based sampling strategy that simulates realistic tactile contact. Trained on large-scale multi-sensor datasets, UniTac achieves state-of-the-art performance in tactile understanding and generates realistic tactile signals across sensors.

ECCV 2026

UniGeo: Unifying Geometric Constraints for Camera-Controllable Image Editing via Video Priors

Hong Jiang, Wensong Song, Zongxin Yang, Ruijie Quan, Yi Yang

Camera-controllable view synthesis aims to synthesize novelviews of a given scene under varying camera poses while strictly preservingcross-view geometric consistency. However, existing methods typicallyrely on fragmented geometric guidance, such as only injecting point cloudsat the representation level despite models containing multiple levels, andare mainly based on image diffusion models that operate on discreteview mappings. These two limitations jointly lead to geometric drift andstructural degradation under continuous camera motion. We observethat while leveraging video models provides continuous viewpoint priorsfor camera-controllable view synthesis, they still struggle to form stablegeometric understanding if geometric guidance remains fragmented. Tosystematically address this, we inject unified geometric guidance across thethree levels that jointly determine the generative output: representation,architecture, and loss function. To this end, we propose UniGeo, a novelcamera-controllable editing framework. Specifically, at the representationlevel, UniGeo incorporates a frame-decoupled geometric reference injectionmechanism to provide robust cross-view geometry context. Furthermore,at the architecture level, it introduces a geometric anchor attention toalign multi-view features, and at the loss function level, it proposes atrajectory-endpoint geometric supervision strategy to explicitly reinforcethe structural fidelity of target views. Experiments across multiple publicbenchmarks, encompassing both extensive and limited camera motionsettings, demonstrate that UniGeo significantly outperforms existingmethods in visual quality and geometric consistency.

ECCV 2026

TraversRL: Traversable Pedestrian Pathway Generation With Reinforcement Learning

Bin Han, Robert Wolfe, Bill Howe

Automatically generating pedestrian pathways from aerialimages requires producing a connected network suitable for routing, notjust detecting where sidewalks appear. Sidewalks and crossings, in con-trast to roads, may be partially occluded, implicitly defined, and exhibitcomplex connectivity patterns. Existing segmentation-based approachesfocus on labeling pixels to infer segments, but often produce disconnectedor fragmentary graphs that are unreliable for navigation. We introduceTraversRL, a vision-conditioned model that iteratively grows a path-way network from an aerial image, simulating a traveler navigating thebuilt environment. TraversRL uses an action space of short and long di-rection–distance segments designed to adapt to complex patterns andspan occlusions, and uses a combination of graph-level and step-wise re-wards to balance overall connectivity with precise edge placement. Acrossthree visual backbones and three intersection datasets, TraversRL sub-stantially improves buffered IoU with the ground-truth graph relative toa state-of-the-art segmentation baseline, and more than doubles metricsof connectivity. Moreover, combining global and local rewards producescleaner graphs with fewer spurious branches while further improvingoverall performance. These results demonstrate that modeling pathwayextraction as a sequential decision process from the perspective of a trav-eler, while optimizing for final graph quality with reinforcement learning,produces significantly more reliable pedestrian networks.

ECCV 2026

TETO: Tracking Events with Teacher Observation for Motion Estimation and Frame Interpolation

Jini Yang, Eunbeen Hong, Soowon Son, Hyunkoo Lee, Sunghwan Hong, Sunok Kim, Seungryong Kim

Event cameras capture per-pixel brightness changes with mi-crosecond resolution, offering continuous motion information lost be-tween RGB frames. However, existing event-based motion estimatorsdepend on large-scale synthetic data that often suffers from a signifi-cant sim-to-real gap. We propose TETO (Tracking Events with TeacherObservation), a teacher-student framework that learns event motionestimation from only ∼25 minutes of unannotated real-world record-ings through knowledge distillation from a pretrained RGB tracker. Ourmotion-aware data curation and query sampling strategy maximizes learn-ing from limited data by disentangling object motion from dominantego-motion. The resulting estimator jointly predicts point trajectoriesand dense optical flow, which we leverage as explicit motion priors tocondition a pretrained video diffusion transformer for frame interpola-tion. We achieve state-of-the-art point tracking on EVIMO2 and opticalflow on DSEC using orders of magnitude less training data, and demon-strate that accurate motion estimation translates directly to superiorframe interpolation quality on BS-ERGB and HQ-EVFI.

ECCV 2026

SRRA: Stable-Rank-Based Residual Adaptation for Generalizable Deepfake Detection

Huakun Liu, Wenjie Li, Changsheng Xu

Deepfake detection faces challenges in generalization, prompt-ing recent studies to fine-tune pretrained Vision Transformers for im-proved performance. Existing fine-tuning-based detection approaches of-ten assign the same rank to the tunable residual components of alllayers. However, the shallow layers exhibit a distinctly low-rank struc-ture, whereas the middle and deep layers present more complex struc-tures. Therefore, we argue that only slight fine-tuning is required forthe shallow layers, which are able to effectively capture low-level forgerycues, while the middle and deep layers require higher residual ranks tomodel long-range dependencies and extract high-level forgery artifacts.To achieve these goals adaptively, we propose the Stable-Rank-BasedResidual Adaptation (SRRA) strategy. It utilizes singular value decom-position to decompose the pretrained weight matrices and adaptively al-locates frozen principal components and learnable residual componentsbased on the Stable Rank. In addition, we design the Residual En-ergy Constraint (REC) and Residual Subspace Orthogonalization (RSO),which suppress excessive perturbations and promote subspace decou-pling, avoiding overfitting and improving the generalization performance.Extensive experiments demonstrate that SRRA achieves remarkable im-provements in cross-domain generalization across multiple deepfake de-tection benchmarks. Our code is available at https://github.com/LHK-CodeLab/SRRA.

ECCV 2026

SIMON: SImultaneous Multi-Object Navigation

Yifeng Zhu, Siyuan Huang, Jun Bao, Jun Yu, Buyu Liu

This paper tackles the challenge of simultaneously manipu-lating multiple objects in image editing—a scenario that extends beyondthe capabilities of existing methods focused on single-object manipula-tion. Our approach SIMON efficiently handles complex rearrangementssuch as object shuffling, achieving higher visual quality at both image andregion levels, while reducing inference time. To this end, we propose threekey modules: a content-aware attention mechanism for region-adaptivefocus, a multi-object energy guidance strategy for subtask-specific con-sistency, and a latent initialization technique for artifact suppression.Together, these components enhance visual coherence across inpainting,object relocation, and background preservation subtasks. To evaluate ourframework, we curate 1,000 images from the 3D-FUTURE dataset, eachcontaining 2 to 5 target objects. For every object, we annotate a newtarget location, ensuring that the resulting layouts are physically plausi-ble and semantically meaningful. We conduct comparative experimentsagainst three state-of-the-art methods, using both image-level, region-level, and instance-level metrics. Both quantitative results and humananalysis confirm that our framework delivers significant improvementsin both visual quality and computational efficiency. We further validateour design through extensive ablation studies with diverse architecturesand applications. The code and annotated dataset are publicly avail-able at https://github.com/yijichar/SIMON-SImultaneous-Multi-Object-Navigation.

Keep browsing

More papers from top AI conferences

30+ top conferences, by conference, year, and topic.