paperlist.ai

AI conference papers

AI conference paper library

Search papers from 30+ top conferences, including NeurIPS, ICLR, ICML, CVPR, ACL and AAAI. Filter by keyword, then open any paper for its abstract, authors and links.

ECCV 2026

Following Motion for Sequential Modeling in Video Frame Interpolation

Jaehyun Park, Nam Ik Cho

State Space Models (SSMs) have surfaced as a promisingarchitecture in Video Frame Interpolation (VFI), as they can capturelong-range dependencies with linear computational complexity. However,their predefined scanning order limits their effectiveness in modelingthe dynamic motion trajectories inherent in VFI problems. To tacklethis challenge, we propose Motion-Guided Mamba for Video FrameInterpolation (MGMVFI), an adaptation of the selective state spacemodel tailored explicitly for VFI. MGMVFI introduces Motion-GuidedSerialization (MGS), which leverages optical flow to define a motion-adaptive 1D input order for the SSM. This aligns the causal state up-dates with semantically related tokens, enabling motion-consistent fea-ture propagation, particularly for large and dynamic motions. Addition-ally, to mitigate the unreliable feature representations caused by inaccu-rate optical flow estimates, we introduce contextual synthesis that uti-lizes the surrounding spatial context for robust inter-frame feature syn-thesis. These components are seamlessly integrated within our tailoredMamba architecture, which also employs a lightweight refinement blockto enhance local detail reconstruction at a reduced computational cost.Extensive experiments on standard VFI benchmarks demonstrate thatMGMVFI achieves state-of-the-art performance, particularly on complexand dynamic motions, thereby establishing a new direction for sequencemodeling in video interpolation.

ECCV 2026

Every Dog Has Its Day, Probably: A Balanced Synthetic Benchmark and Probabilistic Modeling for 3D Dog Pose Estimation

Joo Young Choi, Wonkwang Lee, Juhyeong Seon, Gunhee Kim

3D dog pose estimation is hindered by two limitations in ex-isting benchmarks: distributional bias toward canonical viewpoints, sta-ble poses, and narrow morphologies, and alignment degradation betweenimages and 3D annotations. We instead synthesize a large-scale bal-anced benchmark (4.2M images with exact 3D ground truth) by decou-pling pose, shape, and texture into independent libraries (70K retargetedposes, 500 breed shapes, 1,000 appearance maps) and rendering directlyto guarantee pixel-perfect alignment and broad view coverage. However,this balanced distribution exposes a challenge previously masked by bi-ased data: non-canonical combinations of pose, shape, and viewpointcreate multimodal 3D ambiguities that deterministic regression cannotresolve. We therefore propose a flow-based probabilistic framework thatmodels the conditional distribution of 3D poses given an image, pro-ducing multiple plausible hypotheses under ambiguity while convergingto precise estimates for clear views. Experiments on StanfordExtra, An-imal3D, and our synthetic benchmark demonstrate that our method,trained solely on synthetic data, outperforms state-of-the-art approaches(79.9 vs. 33.2 PCK on the synthetic benchmark). Dataset available here.

ECCV 2026

Dynamic Inverse Rendering for Enhanced Material-Lighting Decomposition

Raza Yunus, Benjamin Ummenhofer, Jan Eric Lenssen, Eddy Ilg

Decomposing outgoing surface radiance into material and illumination during inverse rendering is essential for applications such as relighting and augmented reality, yet it is severely ill-posed since multiple combinations can result in the same observed colour. Capturing an object under multiple lighting conditions usually helps resolve this ambiguity as it constrains the optimization towards correct solutions. In this work, we explore the potential of reconstructing rigidly moving objects—which provides observations of diverse light-surface interactions—to resolve the material-lighting ambiguity in inverse rendering. For this purpose, we introduce a relightable approach that marries object tracking and reconstruction with inverse rendering for general rigidly moving objects. Our experimental analysis on synthetic data demonstrates that motion can be an advantage for disentangling material and lighting: the reconstructed material is significantly more accurate when the object is observed under rigid motion than when it is static. Moreover, results on RGB videos of real hand-held objects show that our pipeline preserves this advantage even under noisy real-world conditions.

ECCV 2026

DeCoFlow: Structural Decomposition of Normalizing Flows for Continual Anomaly Detection

Hun Im, Jungi Lee, Subeen Cha, Pilsung Kang

In industrial environments, new product categories arrive se-quentially, requiring continual anomaly detection without access to pastdata. Normalizing Flows (NFs) provide exact density estimation but suf-fer from catastrophic forgetting as parameter updates across tasks dis-tort the density manifold. While parameter isolation can prevent inter-ference, it must preserve the strict invertibility and Jacobian validityof NFs. To satisfy these requirements, we exploit the inherent propertythat affine coupling layers maintain transformation validity regardless ofsubnet parameterization. Based on this, we propose DeCoFlow, which de-composes subnets into a frozen universal base and task-specific low-rankadapters to isolate updates. We further introduce Task-Specific Align-ment, Auxiliary Coupling Layers, and Tail-Aware Loss to compensatefor frozen-base rigidity. DeCoFlow achieves state-of-the-art image-levelAUROCs of 98.40% on MVTec-AD and 93.00% on VisA, while maintain-ing parameter-level zero forgetting (0.00% FM under correct routing)with only 2.27M parameters per task.

ECCV 2026

CloSeR: Unified Relational Distillation from Closed-Set Teachers for Category Discovery

Yuanpei Liu, Zhenqi He, Jialu Tang, Kai Han

Generalized Category Discovery (GCD) is an intriguing open-world problem that has garnered increasing attention: given partially la-belled data, the goal is to correctly recognize known classes while discov-ering coherent novel categories from unlabelled samples. Recent GCDmethods typically adapt foundation models by jointly optimizing su-pervised classification and unsupervised discovery objectives on mixedlabelled–unlabelled data. While effective, this coupled training can en-tangle closed-set recognition and open-set discovery, leading to objectiveconflict and biased predictions, and may disturb the semantic geome-try of pretrained representations under limited labels and noisy pseudo-labels. We propose CloSeR, a simple plug-and-play framework that in-jects Closed-Set Relational knowledge into GCD training. CloSeR firstbuilds a domain-adapted closed-set teacher by tuning lightweight block-wise adapters on labelled known-class data while keeping the founda-tion model backbone frozen, thereby preserving pretrained priors at lowtraining cost. It then transfers the teacher’s knowledge to downstreamGCD via Unified Relational Distillation (URD), which distills comple-mentary global sample-to-prototype relations to anchor known-class se-mantics and local sample-to-sample relations to preserve neighborhoodstructure, using separate feature pathways to reduce optimization in-terference. CloSeR is head-agnostic and readily integrates with bothparametric and non-parametric GCD methods. Extensive experimentswith DINO and DINOv2 backbones on six benchmarks (CIFAR-10/100,ImageNet-100, CUB, Stanford-Cars, and FGVC-Aircraft) show consis-tent gains over GCD baselines, achieving state-of-the-art performance.Project page: https://visual-ai.github.io/closer/

ECCV 2026

Category-Level Articulated Object Pose Estimation via Pose–Shape Hypothesis Generation and Verification

Kaifeng Tang, Chi Xu, Xin Ao, Yuting Ge, Tingrui Guo, JUN ZHOU

Category-level 6D pose estimation of articulated objects froma single-view input is a fundamental yet challenging task. Its core dif-ficulty lies in occlusion-induced pose and shape ambiguities, which arefurther exacerbated by highly entangled pose-shape representations andreal-world depth noise. Existing generative methods often neglect theinherent correlations between pose and shape, resulting in geometricallyinconsistent or physically implausible predictions. To address this limi-tation, we propose a novel generation-and-verification framework for thistask: First, a Pose-Shape Hypothesis Generator jointly models the dis-tributions of pose and shape to generate intrinsically coupled hypothesispairs, providing explicitly paired candidates for subsequent verification.Second, a Part-Level Point Cloud Denoising module recovers clean pointclouds from noisy and partial depth observations, ensuring robust inputsfor the verification stage. Finally, a Cross-Space Consistency Verifica-tion module explicitly verifies the geometric consistency between the ob-served point clouds and canonical shapes using a continuous SDF-basedscoring mechanism, which effectively prunes geometrically implausiblehypotheses. Extensive experiments on challenging benchmarks demon-strate that our method significantly improves the robustness and accu-racy of pose estimation in complex, heavily occluded scenarios. Projectpage: https://github.com/KaifengT/ArtPS.

ECCV 2026

Beyond the Black Box: Identifiable Interpretation and Control in Generative Models via Causal Minimality

Lingjing Kong, Shaoan Xie, Guangyi Chen, Yuewen Sun, Xiangchen Song, Kun Zhang

Deep generative models, while revolutionizing image gener-ation, largely operate as opaque “black boxes”, hindering human un-derstanding, control, and alignment. While methods like sparse autoen-coders (SAEs) show remarkable empirical success, they often lack theo-retical guarantees, risking subjective insights. Our primary objective is toestablish a principled foundation for interpretable generative models. Wedemonstrate that the principle of causal minimality – favoring the sim-plest causal explanation – can endow the latent representations of gener-ative models with clear causal interpretation and robust, component-wiseidentifiable control. We introduce a novel theoretical framework for hi-erarchical selection models, where higher-level concepts emerge from theconstrained composition of lower-level variables, better capturing thecomplex dependencies in data generation. Under theoretically derivedminimality conditions that manifest as sparsity constraints, we show thatlearned representations can be equivalent to the true latent variables ofthe data-generating process. Empirically, applying these constraints totext-to-image diffusion models allows us to extract their innate hierarchi-cal concept graphs, offering fresh insights into their internal knowledgeorganization. Furthermore, these causally grounded concepts serve aslevers for fine-grained model steering, paving the way for transparent,reliable systems.

ECCV 2026

BEVOpen3D: Towards Open-World 3D Object Detection in Bird's-Eye-View

Huyue Zeng, Jiaqi Yang, Xian-Feng Han

The reliance on extensively annotated 3D data confines cur-rent autonomous driving systems to a closed-set detection paradigm, lim-iting their robustness in real-world open-world scenarios where novel ob-jects frequently emerge. To bridge this gap, we propose BEVOpen3D,a novel distillation framework that facilitates open-world 3D object de-tection by effectively transferring knowledge from 2D vision-languagemodels into the 3D domain via the Bird’s-Eye-View (BEV) space undera partial-label setting. Our approach first generates initial 3D proposalsfor both seen and unseen categories using an open-vocabulary 2D detec-tor combined with a greedy spatial search strategy. We then introducea Triple-Source Label Refinement mechanism, which fuses original, lo-cally rectified (via a Seen-Guided Local Query), and globally re-examinedproposals to produce high-quality pseudo labels for unseen-category. Fi-nally, we propose a Heatmap Proposal Distillation strategy, where animage-based BEV teacher transfers its vision-grounded semantic priorsto a LiDAR-based student through aligned BEV heatmaps, enabling thestudent to detect both seen and unseen objects without requiring addi-tional 3D annotations. Extensive experiments validate the effectivenessof BEVOpen3D in open-world 3D detection.

ECCV 2026

AVSR-Diff: Scale-Agnostic Diffusion Priors for Temporally Consistent Arbitrary-Scale Video Super-Resolution

Geunhyuk Youk, Jeonghyeok Do, Dayeon Kim, Jihyong Oh, Munchurl Kim

Diffusion models have significantly advanced video super-resolution (VSR) but remain largely constrained to fixed upsamplingscales. Conversely, while coordinate-based arbitrary-scale VSR methodsoffer scale flexibility, they inherently suffer from severe over-smoothingat large scaling factors. Integrating generative priors with continuous de-coding is promising but currently hindered by severe temporal flickeringcaused by the stochasticity of diffusion sampling. To address this, wepropose AVSR-Diff (Arbitrary-scale Video Super-Resolution with Dif-fusion), a novel decoupled framework that separates scale-agnostic la-tent denoising from continuous coordinate rendering, effectively avoid-ing computationally heavy resolution-specific sampling. Our approachintroduces a Temporally-Gated Feature Recurrence (TGFR) module toextract strictly aligned, temporally consistent latent priors. Furthermore,we design a continuous video VAE decoder incorporating a Scale-AwareFourier Refinement (SAFR) module to dynamically adapt frequencycomponents to any target scale. Extensive experiments demonstrate thatAVSR-Diff consistently preserves high-frequency details and strong tem-poral stability across various scales, surpassing state-of-the-art arbitrary-scale baselines. Remarkably, our framework outperforms recent fixed-scale generative models even on their native resolution.

ECCV 2026

Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods

Xingsong Ye, Yongkun Du, Jiaxin Zhang, Haojie Zhang, Chong Sun, Chen Li, Jing Lyu, Zhineng Chen

WordArt (artistic text) features highly customized fonts,textures, and layouts, making WordArt-oriented scene TExt Recogni-tion (WATER) substantially more challenging than general Scene TextRecognition (STR). Existing STR datasets and methods, typically builtaround regular scene text and fixed-template inputs, struggle to scale toWATER. Thus, we aim to advance this task from both data and modelperspectives. On the data side, we construct a 2M synthetic dataset,WATER-S, with the scale improved by hundreds of times comparedto existing artistic text data. WATER-S consists of two complementarysubsets. One rendered by an upgraded rendering pipeline (SynthWor-dArt), which provides highly accurate and controllable synthetic Wor-dArt data. The other is generated by combining Qwen3-VL for promptmining and Z-Image for image synthesis, which improves the coverage ofrealistic and diverse data. On the model side, we propose WATERec.It adopts a visual encoder supporting arbitrary-shaped inputs and anautoregressive decoder to model complex layouts, structurally breakingthe bottleneck of fixed-template STR on WordArt. Experiments showthat this architecture outperforms prior STR methods, achieving state-of-the-art performance on irregular texts such as WordArt. Togetherwith WATER-R, carefully reorganized from existing real STR data, ourstrong baseline with the new synthetic data and model design reaches90.40% accuracy on WordArt-Bench, surpassing both general-purposeand OCR-specialized vision-language models by a large margin. Codeand data are available at https://github.com/YesianRohn/WATER.

ECCV 2026

Why Feature Magnitude Deceives OOD Detectors: An Angular Separation Perspective

Hanlin Li, Jing Ma, Zehang Wei, Jiamin Yan, Xiang Xiang

Out-of-Distribution (OOD) detection is a critical safety requirement for deploying deep neural networks in open-world environments. While recent advances increasingly rely on more computationally intensive training methods involving synthetic outliers, contrastive objectives, or specialized loss functions, their gains often come with substantial computational overhead and implementation complexity. In this work, we revisit the fundamentals of OOD detection and uncover a key flaw in common distance-based detectors: sensitivity to feature magnitude. We show that low-norm OOD samples can appear closer to in-distribution (ID) class centroids than actual ID samples, evading detection. To this end, we introduce Angular Separation Learning (ASL), a simple and highly effective strategy that applies ℓ -normalization to features before 2 the final classification layer. This modification compels the network to optimize for angular separation, achieving robust feature learning without additional regularization mechanisms, synthetic samples, or costly negative mining. Through extensive experiments on diverse benchmarks, we demonstrate that ASL not only matches but often surpasses state-of-theart methods, especially in challenging near-OOD scenarios, while maintaining training efficiency. Our results indicate that a minimalist rethink of standard training can achieve superior OOD performance, prompting a re-evaluation of the complexity-to-performance trade-off in OOD detection. Codes are available at https://github.com/HAIV-Lab/ASL.

ECCV 2026

Temporal and Cross-modal Alignment for Enhanced Audiovisual Video Captioning

Chen Zhao, Jiajun Ma, Qilong Huang, Tiehan Fan, Hongyu Li, Zhuoliang Kang, Xiaoming Wei, Jian Yang, Ying Tai

While Multimodal Large Language Models (MLLMs) have advanced video understanding, achieving precise temporal and crossmodal alignment in audiovisual video captioning remains a formidable challenge. Most existing approaches suffer from modality detachment and temporal incoherence, failing to accurately bind auditory events to visual entities or capture complex causal dynamics. To address these deficiencies, we propose TCA-Captioner, a framework specifically engineered to enhance Temporal and Cross-Modal Alignment for audiovisual video captioning. We first introduce the Observer-Checker-Corrector (OCC) framework, an iterative refinement strategy that generates high-fidelity, meticulously grounded training data. Leveraging a curated high-density human interaction dataset, TCA-Captioner is optimized to model sophisticated audiovisual interactions. Furthermore, we present TCA-Bench, a diagnostic benchmark utilizing a Decoupled Evaluation Protocol to isolate and quantify model proficiency in audiovisual binding and temporal relational reasoning. Extensive experiments demonstrate that TCACaptioner sets a new standard for temporally-coherent and synchronized audiovisual narratives.

ECCV 2026

Structure Gaussian Splatting SLAM

Yan Li, Yingzhao Li, Gim Hee Lee

Recent Gaussian Splatting SLAM (GS-SLAM) methods alignrendered and observed images through photometric and geometric resid-uals to achieve high-quality reconstruction and rendering. However, thesesignals weaken in low-texture and repetitive environments, which leadsto floaters, inconsistent geometry, and drift. Existing systems mitigatedrift through loop closure or global layout assumptions, but these mech-anisms are opportunistic or lack persistent structural entities that pro-vide reliable constraints throughout mapping. We introduce a structure-aware GS-SLAM framework that models planar structures as persistentPlanar Gaussian Instances (PGIs) within a 3D Gaussian map. EachPGI represents a planar surface associated with Gaussian primitives andmaintains a consistent identity across frames. This representation pro-motes planes from transient observations to map entities and convertsplanar structures into stable geometric constraints. Building on PGIs,we propose structure closure, which estimates relative camera pose frommultiple non-parallel planes without requiring trajectory revisits. Wefurther integrate PGIs into a joint optimization that combines photo-metric–depth supervision with plane-instance consistency to improvemulti-view geometric coherence and suppress floater growth. Experi-ments on public benchmarks show that the proposed system achievesstate-of-the-art performance in camera tracking, dense reconstruction,and novel-view rendering, with strong robustness in scenes with largetextureless surfaces and repetitive layouts. Our code is publicly availableat https://github.com/yanyan-li/StructureGS-SLAM.

ECCV 2026

Stealthy Multi-task Adversarial Attacks

Jiacheng Guo, Tianyun Zhang, Lei Li, Haochen Yang, Hongkai Yu, Minghai Qin

Deep neural networks are highly vulnerable to adversarialperturbations, raising serious safety concerns in the real-world systems.While prior work mainly explores single-task attacks or jointly degradingall tasks in multi-task models, practical scenarios often demand moreselective and stealthy attack strategies. To address this challenge, wepropose Stealthy Multi-Task Adversarial Attack (SMTA2 ), a novelframework that selectively degrades a targeted task while strictly pre-serving the performance of non-targeted tasks. We formulate this objec-tive as a constrained multi-objective optimization problem and designtask-aware adversarial perturbations that maximize degradation on thetargeted task without causing collateral damage on non-targeted tasks.To enhance practicality, we further introduce an automated loss-weighttuning strategy that dynamically balances attack and preservation objec-tives. Experiments on two multi-task benchmarks NYUv2 and Cityscapesdemonstrate that SMTA2 achieves strong attack performance on tar-geted tasks while maintaining non-targeted tasks intact on both unde-fended and adversarially trained models, establishing the first systematicframework for stealthy and selective multi-task attack framework.

ECCV 2026

Simple Filtering Improves Masked Autoencoders

Takumi Kobayashi

Deep models are successfully applied to various fields, whiledemanding large amount of annotated data for high-performance recog-nition. To remedy the data-hunger issue, self-supervised learning, espe-cially masked autoencoder (MAE), is a promising approach to effectivelypre-train the deep models. The MAE leverages random masking to con-struct pretext tasks where masked image patches are reconstructed byusing unmasked (visible) ones. In vision domain, however, inherent imageproperties of high redundancy and correlation in local neighbors couldinterfere with the mask-based pretext tasks. In this study, we analyze twomain processes of masking and reconstruction in MAE through the lensof difficulty of the pretext task. The analysis inspires us to propose simpleyet effective approaches based on filtering to improve random maskingas well as raw-pixel reconstruction by properly controlling difficulty ofMAE task with a negligible extra computation cost. In the experimentson image classification, the proposed method renders favorable perfor-mance improvement to MAE using ViTs.

ECCV 2026

Segmentation-Guided Homography Estimation for Long-Term Planar Tracking

Jonas Serych, Jiri Matas

Recent state-of-the-art visual trackers produce high qualityand long-term-stable segmentation masks. We propose to leverage thesestrengths for planar object tracking, in which the goal is to estimate aprecise 8-degrees-of-freedom homography pose, a geometric representationnot estimated by segmentation trackers. We present SAM-H – a planarobject tracker that estimates homographies from segmentation mask con-tours via a training-free pipeline. When SAM-H is applied to masks fromSAM 2 [21], it sets a new state-of-the-art performance on the challengingPlanarTrack [15] benchmark by a large margin, +18.4pp on the p@5metric. We further show that segmentation-based and correspondence-based homography estimation are complementary, and propose WOFT-SAM, which out-performs all prior methods on both PlanarTrack [15]and POT-210 [14]. We also provide precise re-annotations of Planar-Track initial poses, enabling more accurate benchmarking in the high-precision p@5 metric. The code and the re-annotations are available athttps://github.com/serycjon/WOFTSAM.

ECCV 2026

Decoding Multimodal Causality: End-to-End Multimodal Mediation Pathways Inference

Yulong Li, Xiwei Liu, Niranjana Menon, Yuxuan Zhang, Jianxu Chen, Rong Xia, Haolin Yang, Peixin Guo, Yutong Xie, Imran Razzak

The nonparametric identification of causal mediation effectsfrom heterogeneous multimodal observational data remains an opentheoretical problem. Existing single-modal methods cannot handlecross-modal causal relationships, while multimodal learning methodslack causal inference capabilities, preventing reliable mediation pathwayidentification and effect quantification under structural uncertainty.We propose the Multimodal Structure-Informed Guided MediationAnalysis (MM-SIGMA) framework, which achieves automated cross-modal mediation pathway identification and end-to-end uncertaintypropagation through probabilistic causal structure discovery. Weestablish nonparametric identification conditions for the Cross-ModalNatural Direct Effect and Cross-Modal Natural Indirect Effect fromheterogeneous multimodal observational data, and build MM-SIGMAupon this theoretical foundation. Specifically, it employs multimodalvariational autoencoders for causality-preserving latent representation,differentiable Flow-Structural Equation Models for asymptoticallyconsistent latent structure learning, Cross-Modal Path Stability Scoringfor high-confidence pathway identification, and Efficient InfluenceFunctions with Bayesian Model Averaging for end-to-end uncertaintypropagation. Experiments on synthetic data demonstrate state-of-the-art performance under structural uncertainty, nonlinearity, andcross-modal heterogeneity. On the HPP dataset, MM-SIGMA identifiescross-modal mediation pathways connecting sleep, fundus imaging, andcardiovascular health, revealing undiscovered cross-system mechanisms.

ECCV 2026

Reconstructing 3D Human-Object Interaction via a Unified Triplane Space

Yuhang Chen, Chenxing Wang

Reconstructing 3D Human-Object Interaction (HOI) from asingle image is challenging due to the diversity of the reconstructed tar-gets. Ordinarily, the human body follows a fixed parametric template,whereas objects exhibit diverse and irregular shapes. Such differenceslead to inconsistent geometric priors and scale variations, making jointmodeling within a unified framework highly difficult. Existing vertex-level methods struggle to effectively handle this structural discrepancy.We propose to bridge this gap by introducing a unified triplane featuremap that models both human and object meshes within a shared 3Dlatent space. Our framework comprises three components: (1) a HOI Tri-plane Variational AutoEncoder (HOIT-VAE) that learns a compact andstable triplane latent space from large-scale human-object mesh data; (2)a HOI Triplane Transformer (HOIT-T) that predicts triplane featuresfrom a single image, regularized by the learned priors of HOIT-VAE;(3) a pose-fitting method for estimating the human pose from the re-constructed human mesh. Experiments on the BEHAVE and InterCapdatasets show that our approach achieves competitive reconstruction per-formance, validating the effectiveness of the unified triplane representa-tion in capturing the mesh structures and interactions between humansand objects.

ECCV 2026

Pistachio: Towards Synthetic, Balanced, and Long-Form Video Anomaly Benchmarks

Jie Li, Hongyi Cai, Mingkang Dong, Muxin Pu, Shan You, Fei Wang, Tao Huang

Automatically detecting abnormal events in videos is cru-cial for modern autonomous systems, yet existing Video Anomaly De-tection (VAD) benchmarks lack the scene diversity, balanced anomalycoverage, and temporal complexity needed to reliably assess real-worldperformance. Meanwhile, the community is increasingly moving towardVideo Anomaly Understanding (VAU), which requires deeper seman-tic and causal reasoning but remains difficult to benchmark due to theheavy manual annotation effort it demands. In this paper, we introducePistachio, a new VAD/VAU benchmark constructed entirely through acontrolled, generation-based pipeline. By leveraging recent advances invideo generation models, Pistachio provides precise control over scenes,anomaly types, and temporal narratives, effectively eliminating the bi-ases and limitations of Internet-collected datasets. Our pipeline inte-grates scene-conditioned anomaly assignment, multi-step storyline gen-eration, and a temporally consistent long-form synthesis strategy thatproduces coherent 41-second videos with minimal human intervention.Extensive experiments demonstrate the scale, diversity, and complexityof Pistachio, revealing new challenges for existing methods and motivat-ing future research on dynamic and multi-event anomaly understanding.

ECCV 2026

PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided VLM

Siwei Meng, Yawei Luo, Ping Liu

Inferring physical properties from a single image is funda-mentally under-constrained. Attributes such as density, elasticity, andyield stress govern how objects move, yet they are largely invisible ina static frame. Existing physics-aware methods attempt to resolve thisambiguity through task-specific fine-tuning or supervised property es-timation, but both strategies struggle to generalize across diverse ma-terials and scenes. We observe that different motions expose comple-mentary physical cues. Building on this observation, we propose Phy-MAGIC, a training-free framework that actively probes physical prop-erties by synthesizing targeted motions from a single image. Specifically,PhyMAGIC uses a pretrained image-to-video model to construct mo-tion probes that generate diverse dynamic sequences from the inputimage. A vision-language model then analyzes these sequences to esti-mate physical parameters, each accompanied by a confidence score. Pa-rameters with low confidence trigger targeted prompt refinement, whichgenerates additional probe motions to gather complementary evidence.Once all parameters reach sufficient confidence, PhyMAGIC compilesthem into a complete physical specification and executes it in a differ-entiable Material Point Method simulator initialized from 3D Gaussianreconstructions. Experiments on diverse real-world scenes demonstratethat PhyMAGIC achieves stronger text-motion alignment and higherhuman-rated physical plausibility than state-of-the-art open-source videogenerators and physics-aware baselines. Code is available at: https://mengsiwei.github.io/MAGIC/.

Keep browsing

More papers from top AI conferences

30+ top conferences, by conference, year, and topic.