AI conference papers

AI conference paper library

Search papers from 30+ top conferences, including NeurIPS, ICLR, ICML, CVPR, ACL and AAAI. Filter by keyword, then open any paper for its abstract, authors and links.

IJCAI 2026

DyG-Seg: Unsupervised 3D Point Cloud Segmentation via Geometric Manifold Rectification

Benyu Wu, Kun Zhou, Xulun Ye

Unsupervised 3D semantic segmentation is vital for label-free open-world perception. However, current methods typically struggle with two core limitations: fixed category assumptions that restrict adaptability in complex scenes, and geometric incompleteness caused by irregular point sampling, which degrade the integrity of local geometric descriptors for fine-grained or long-tail objects. To address these, we propose DyG-Seg, a Dynamic Geometric-Semantic Alignment framework. First, targeting the challenge of incomplete geometry, the Geometric Manifold Rectification (GMR) leverages a diffusion model to reconstruct integral object geometry and recover the underlying manifold topology, thereby enhancing feature discriminability. Utilizing this geometric prior, the Dynamic Prototype Contrastive Clustering (DPCC) applies non-parametric Bayesian inference to automatically estimate the optimal number of clusters and generate pseudo-labels. Finally, our Iterative Optimization with Dynamic Constraints integrates Dynamic Class Balancing (DCB) to mitigate long-tail bias. Capitalizing on the recovered manifold topology, we enforce Spatial Geometric Consistency to rectify structural incompleteness and ensure spatially coherent semantic predictions. Extensive experiments on ScanNet and S3DIS demonstrate that DyG-Seg discovers latent semantic structures and significantly outperforms state-of-the-art unsupervised methods.

IJCAI 2026

GeoMind: Explicit Spatial Reasoning via Dual-Reference Geometric Modeling

Xing Wei, Aoxiang Tian, Shaofan Liu, Jiansheng Peng, Chong Zhao, Xiang Bi, Yang Lu, Benhong Zhang, Fan Yang

While Vision-Language Models (VLMs) excel at semantic understanding, they struggle to comprehend 3D spatial relationships from limited views. Their reliance on implicit geometric encoding often leads to severe hallucinations and inconsistencies in spatial reasoning tasks. To address this, we introduce GeoMind, a model-then-reason framework that employs a single LLM to autoregressively generate an explicit Geometric Description Language (GDL) map, serving as a grounded context to derive the final answer. This intermediate GDL map provides an explicit and queryable world representation. Leveraging this explicit representation, we enforce a strict referential constraint, compelling the model to ground reasoning solely on the instantiated entities to ensure referential integrity and auditability. Specifically, we lift multi-view observations into object-centric tokens using frozen geometric priors and instance masks. The LLM is trained via a two-stage curriculum with programmatic supervision to generate the GDL map as a prerequisite for answering. On five spatial understanding benchmarks in both image and video settings, GeoMind delivers average accuracy gains of +6.9% (2B) and +9.8% (8B) over Qwen3-VL baselines. Our results suggest that explicit geometric grounding enables robust spatial reasoning without human annotation, providing a scalable and practical route to stronger spatial intelligence in large VLMs.

IJCAI 2026

InterLight: Leveraging Intrinsic Illumination Priors for Low-Light Image Enhancement

Ziqi Wang, Xu Zhang, Laibin Chang, Shi Chen, Jiaqi Ma, Huan Zhang

Low-Light Image Enhancement (LLIE) has long been a challenging problem in low-level vision, as insufficient illumination often leads to low contrast, detail loss, and noise. Recent studies show that deep learning-based Retinex theory can effectively decouple illumination and reflectance. However, existing methods frequently suffer from over-enhancement or color distortion, and often assume uniform noise or ideal lighting. To address these limitations, we propose InterLight, a novel framework that systematically excavates and operationalizes intrinsic illumination priors for LLIE. Our core insight is that robust enhancement requires not just estimating illumination, but constructing an illumination-aware pipeline. We first inject sensor-level illumination-response priors via physics-guided augmentation, then represent the degradation through adaptive prompts conditioned on the scene's latent illumination state. This explicit representation directly guides a luminance-gated intrinsic memory mechanism to selectively compensate for information loss, prioritizing reconstruction in dark regions while preserving fidelity in bright ones. Finally, the entire process is regularized by a self-supervised consistency objective that distills illumination-invariant features. By deeply exploiting intrinsic illumination priors, our method achieves clearer textures and more visually coherent enhancement results. Extensive experiments across multiple benchmarks demonstrate the effectiveness of our approach. Code is available at: https://github.com/House-yuyu/InterLight.

IJCAI 2026

Complex-Valued Residual Diffusion with GRPO for Pansharpening

Zhiyuan Wang, Dong Li, Kaixin Fu, Chunhui Luo, Xueyang Fu

Pansharpening aims to fuse a high-resolution panchromatic (PAN) image with a low-resolution multispectral (MS) image to generate a highresolution multispectral output that preserves both fine spatial details and faithful spectral responses. However, enhancing spatial textures without introducing spectral distortion remains challenging due to the inherent spectral–spatial trade-off. To address this issue, we propose a two-stage pansharpening framework that tackles the problem from both modeling and optimization perspectives. In the first stage, we formulate pansharpening as spectral-prior conditioned residual diffusion, where a stable spectral base constrains the generation process and allows the diffusion model to focus on PAN-guided high-frequency details, leading to improved training stability and reduced spectral drift. To better capture the coupled spatial and frequency characteristics of PAN–MS fusion, we adopt a complex-valued denoising network to enhance spectral–spatial interaction modeling. In the second stage, to bridge the gap between distortionoriented training objectives and practical quality preferences, we introduce Group Relative Preference Optimization (GRPO) to fine-tune the diffusion model using multi-objective preference signals, explicitly balancing spectral fidelity, texture sharpness, and perceptual quality. Extensive experiments on standard benchmarks demonstrate that the proposed method achieves a more favorable trade-off between fidelity and perceptual quality compared to competitive end-to-end and diffusionbased approaches.

IJCAI 2026

HyLoVQA: Dynamic Hypernetwork-Generated Low-Rank Adaptation for Continual Visual Question Answering

Yiran Wang, Chenyi Xiong, Ziyue Qin, Miao Zhang, Kui Xiao, Zhifei Li

Continual Visual Question Answering (VQA) requires learning from non-stationary streams of visual inputs and questions while preserving past knowledge. Most prior methods adapt by updating a largely shared parameter set. This often leads to cross-level task interference, hindering accurate adaptation to the current task and object. To address this limitation, we propose HyLoVQA. It maintains a drift-resilient memory bank of anchors. The bank stores the content of visual objects and textual tasks, and they are updated using current input features. Conditioned on retrieved anchors, a hypernetwork generates lightweight Low-Rank Adaptation (LoRA) adapters. This ensures parameter efficiency, allowing the model to adapt to each task and object dynamically. Additionally, we formulate an alignment loss that aligns semantic discrepancies in the feature space with functional changes in the parameter space, thereby constraining LoRA adapters to remain focused on the current task and object. Extensive experiments on VQA v2 and NExT-QA under both standard and compositional settings demonstrate the superiority of HyLoVQA over prior state-of-the-art methods. The code is available at https://github.com/HubuKG/HyLoVQA.

IJCAI 2026

S³-TIR: Coupled Spatial-Spectral Splatting for Thermal Infrared Novel View Synthesis

Yaoxing Wang, Yuheng Li, Yan Di, Shan Gao

We present S³-TIR (Coupled Spatial-Spectral Splatting), a physics-inspired framework for high-fidelity thermal infrared (TIR) novel view synthesis. Existing 3D Gaussian splatting methods struggle to capture the unique duality of TIR imagery: the coexistence of diffusive smoothness from heat conduction and structural sharpness from material discontinuities. To address this issue, we leverage the intrinsic frequency properties of thermal scenes, where conduction creates smooth fields while discontinuities cause sharp signal jumps. Accordingly, S³-TIR couples adaptive spatial support with internal spectral modulation via a unified generalized-exponential Gabor primitive. This design utilizes spatial support as a physical truncation controller, confining high-frequency textures within sharp boundaries while maintaining smooth diffusion elsewhere. Furthermore, we propose a frequency-aware deferred splatting scheme that enforces multi-view frequency consistency, anchoring frequency distributions to the 3D structure rather than view-dependent appearance. Experiments on diverse benchmarks demonstrate that S³-TIR achieves state-of-the-art performance, notably reducing LPIPS by 42.5% and improving PSNR by 3.2% on the RGBT-Scenes dataset, while yielding structurally stable thermal sequences free from jittering artifacts.

IJCAI 2026

SpatialV2A: Visual-Guided High-fidelity Spatial Audio Generation

Yanan Wang, Linjie Ren, Zihao Li, Junyi Wang, Tian Gan

While video-to-audio generation has achieved remarkable progress in semantic and temporal alignment, most existing studies focus solely on these aspects, paying limited attention to the spatial perception and immersive quality of the synthesized audio. This limitation stems largely from current models' reliance on mono audio datasets, which lack the binaural spatial information needed to learn visual-to-spatial audio mappings. To address this gap, we introduce two key contributions: we construct BinauralVGGSound, the first large-scale video-binaural audio dataset designed to support spatially aware video-to-audio generation; and we propose an end-to-end spatial audio generation framework guided by visual cues that explicitly models spatial features. Our framework incorporates a visual-guided audio spatialization module that ensures the generated audio exhibits realistic spatial attributes and layered spatial depth while maintaining semantic and temporal alignment. Experiments show that our approach substantially outperforms state-of-the-art models in spatial fidelity and delivers a more immersive auditory experience, without sacrificing temporal or semantic consistency. All datasets, code, and model checkpoints are available at: https://github.com/renlinjie868-web/SpatialV2A.

IJCAI 2026

TPPMG: Temporal Planning-driven Progressive Motion Generation

Ruoyu Wang, Can Deng, Xinyi Li, Zhuo Li

Most text-to-motion models treat motion duration as a fixed hyperparameter rather than a variable inferred from semantics, inducing two systematic failure modes: duration trailing on short prompts and stage-wise semantic collapse on long, multi-stage prompts. To address this issue, we propose TPPMG (Temporal Planning-driven Progressive Motion Generation), which factorizes generation as semantics -> temporal structure -> motion realization. TPPMG comprises two components: (1) a Temporal Planner that maps text to an explicit stage-duration script via an LLM with a lightweight duration calibrator; and (2) a Progressive Diffusion Generator that bridges fixed-length diffusion training and variable-length inference through heterogeneous noise scheduling and a sliding-window mechanism, enabling budget-driven variable-length motion synthesis. To evaluate both failure modes with verifiable ground truth, we construct three benchmarks: HumanML3D-Short, HumanML3D-Concat, and BABEL-Concat, along with a comprehensive evaluation suite. Experiments show that TPPMG suppresses duration trailing (UR: 0.52 -> 0.85), substantially improves multi-stage structure recovery (PhaseRecall: 0.56 -> 0.90, BoundaryF1: 0.28 -> 0.56), and reduces boundary discontinuity at stage transitions.

IJCAI 2026

Riemannian Graph Convolutional Network for Skeleton-Based Two-Person Interaction Recognition

Rui Wang, Zihao Bi, Chen Hu, Xiaoning Song, Xiao-Jun Wu, Nicu Sebe, Ziheng Chen

In the field of skeleton-based human action recognition, Graph Convolutional Networks (GCNs) have become a dominant framework. However, existing GCN-based approaches often treat the sequences of two-person interaction as separate entities, ignoring the inherent semantic dependencies and spatial correlations between interacting subjects. Furthermore, high-order skeleton representations naturally exhibit non-Euclidean structures, where Euclidean deep learning models are inherently limited in explicitly capturing and preserving such geometric information. As a countermeasure, we propose a Riemannian Graph Convolutional Network (RGCN) that operates on the Symmetric Positive Definite (SPD) manifolds. Specifically, we model high-order skeletal statistics via Gaussian embedding and propose a Riemannian network to capture inter-subject interactions and global correlations. The proposed RGCN is instantiated under three SPD geometries, and its effectiveness is validated through extensive experiments on three interaction benchmarks. Extensive experimental results show that RGCN provides a competitive and geometrically grounded alternative for skeleton-based interaction recognition.

IJCAI 2026

World4V2X: A Consistency-driven World Model for Robust V2X Cooperative Perception

Rui Wang, Shuai Wang, Xiangyi Qin, Ze Yu, Xiaojun Tan

Cooperative perception allows agents to extend perceptual capabilities through inter-agent communication. However, most existing methods still adopt a frame-wise paradigm, which limits the exploitation of spatio-temporal consistency in dynamic scenes. Therefore, when observations are partially occluded or degraded, these methods are unable to leverage historical context for compensation, leading to unstable perception and reduced detection accuracy. To address these challenges, we propose World4V2X, the first world model framework tailored for V2X cooperative perception. The proposed method first introduces a spatial observability modeling module that defines spatial consistency boundaries to distinguish reliable regions from uncertain ones, thereby enabling spatial consistency modeling over multi-agent heterogeneous observations. Building upon this, we construct a consistency-guided world modeling module. Specifically, a temporal consistency evolution mechanism leverages features from historical and current frames to model the state evolution of the scene, capturing environmental dynamics and producing temporal consistency beliefs. Meanwhile, a consistency-guided deterministic reconstruction mechanism exploits spatial boundaries and temporal beliefs to perform diffusion-based refinement for robust cooperative perception. Extensive experiments on the OPV2V and V2XSet datasets demonstrate that World4V2X achieves state-of-the-art perception performance across diverse V2X scenarios.

IJCAI 2026

Listen and Count: Expanding the Frontier of Zero-shot Object Counting to Sound-centric Counting

Mingjie Wang, Zhuohang Li, Qi Zhang, JUN ZHOU, Zili Yi, Minglun Gong

While class-agnostic object counting has recently evolved from image-exemplar to language-guided paradigms, existing methods are limited by text polysemy and the lack of prompts in audio-sensing scenarios. To overcome these challenges, we introduce a sound-centric counting paradigm, enabling models to "listen and count" using the vivid and discriminative signatures of sound cues. We propose S2ICount, which achieves seamless, fine-grained audio-visual alignment for sound-guided counting. At its core, SoundMamba leverages linear-complexity long-range semantic modelling to align cross-modal features, while the Sound Calibration Module designs a circular scanning mechanism to progressively reconcile modality discrepancies using multi-scale cues from a Stable Diffusion backbone. To enhance saliency awareness, a Multi-tier Hybrid Optimization strategy enforces consistency across magnitude, semantics, and distribution. In addition, we introduce SoundCount, the first large-scale sound-oriented counting dataset, comprising over 2,000 scenes and 1,650 audio sources across 66 object categories. Extensive experiments demonstrate that S2ICount achieves state-of-the-art performance, validating the effectiveness of sound as a robust guidance modality for counting. The dataset, demo and implementation code are made publicly accessible at https://github.com/ZSTU-CV-Lab/S2ICount.

IJCAI 2026

BAG-Net: Bidirectional Receptive-Field Graph Network for Two-View Correspondence Pruning

Leyi Wang, Hao Chen, Changcai Yang

Learning reliable two-view correspondences is essential for geometric computer vision applications. Existing graph-based pruning methods typically aggregate information unidirectionally, capturing only whether a correspondence receives neighborhood support while ignoring its structural contribution during aggregation. This makes it difficult to distinguish locally clustered outliers from globally critical inliers. To overcome this limitation, we propose a Bidirectional Aggregation Graph Network (BAG-Net), which introduces a bidirectional aggregation perspective for correspondence pruning. Specifically, we design Bidirectional Dynamic Graph Convolution (BiDGC) that jointly models forward consistency aggregation and reverse structural dependency, enabling the network to identify key inliers that are widely referenced during feature propagation. To further enhance robustness, we design a Stage-wise Graph Expansion-Contraction (SGEC) architecture that combines multi-scale receptive field evolution with Stage-wise Squeeze-and-Excitation (SSE) and Deep-Guided Modulation (DGM) to stabilize feature propagation across network stages. Extensive experiments on the YFCC100M and SUN3D datasets demonstrate that BAG-Net significantly outperforms existing SOTA methods in both outlier rejection and camera pose estimation, achieving 66.10% and 78.88% mAP5^o% on YFCC100M in known and unknown scenes, respectively. Source code: https://github.com/LeyiWang13/BAG-Net.

IJCAI 2026

SpecBridge: Spectral Structure Alignment and Transitive Bridging for 3D–2D–Text Pre-Training

Dong Wang, Jie Jiang, Weidong Min, Lixin Zhan, Xinpeng Zhao, Ze Zhang

Open-vocabulary 3D understanding aims to align 3D representations with a unified vision-language semantic space. However, existing methods suffer from the challenge of structural asymmetry caused by sparse observations and holistic geometries. Additionally, the inherent semantic chasm between discrete coordinates and abstract natural language hinders cross-modal mapping. This work introduces SpecBridge, a 3D-2D-Text pre-training framework that leverages CLIP priors as a foundational bridge to connect three modalities by synergizing spectral graph theory with transitive semantic learning. The method consists of two main sub-modules. First, Spectral Eigen-Modal Alignment is presented to construct cross-modal correlations within the intrinsic eigen-spectral space via Laplacian eigendecomposition. By aligning low-frequency geometric harmonics with CLIP-guided observation inference, it maintains structural consistency between 3D geometries and 2D projections. Second, a Transitive Spectral-Semantic Alignment method is developed to establish a 3D→2D→Text propagation chain across the CLIP priors bridge. It distills dense CLIP priors into 3D representations through transitive distillation, effectively mitigating the semantic chasm between geometry and language. Extensive experiments confirm that the proposed SpecBridge demonstrates state-of-the-art performance by overcoming challenges triggered by modality discrepancies.

IJCAI 2026

OrienDiffusion: Taming Diffusion Towards Fine-grained Portrait Matting

Zhengzheng Tian, Wei Ma, Hongbin Zha

Recently, diffusion models have been applied to reformulate the regressive portrait matting task as a gradual denoising-driven generative process, alleviating the inherent limitations of discriminative models via iterative error correction. However, due to the lack of high-quality ground-truth mattes, existing generative methods for portrait matting still suffer from severe detail degradation, especially in structurally delicate hair strands and pixels with ambiguous colors and context. To address these challenges, we propose OrienDiffusion, a diffusion-based framework tailored for fine-grained portrait matting. Specifically, we construct a Hair Orientation Field to conditionally guide the denoising process, constraining the generation toward authentic structural consistency in hair regions. Furthermore, instead of relying on overly encoded deep features or ambiguous original color cues as existing methods do, we develop a Pixel Color-anchored Local Structure Embedding approach, which models alpha matte transitions as local structural variations, achieving accurate alpha estimation in pixels with ambiguous colors or context. Extensive experiments on multiple portrait matting datasets demonstrate that OrienDiffusion achieves state-of-the-art performance in these matting challenging regions. Code is available at https://github.com/xtz0001/OrienDiffusion.

IJCAI 2026

Object-Centric Alignment and Anchor Distillation for Weakly Supervised Referring Expression Comprehension

Yi Tian, Cheng Yang, Qingbao Huang

Weakly supervised Referring Expression Comprehension (WREC) aims to localize referred objects using only image-text pairs without box-level annotations. Existing one-stage methods predominantly rely on anchor-level alignment, which suffers from two fundamental limitations: (1) anchors represent local visual patches rather than holistic objects, and (2) they lack the capability to model inter-object relations. To address these issues, we propose OCAAD, an Object-Centric Alignment and Anchor Distillation framework. Our key insight is that different self-attention heads in DINOv2 naturally attend to distinct semantic regions, effectively capturing object-level information. Building on this, OCAAD introduces two complementary modules: (1) Anchor-Object Distillation Module (AODM), which bridges the semantic gap between anchors and objects by transferring object-level knowledge from attention heads to anchors via overlap-aware contrastive learning; and (2) Intra-Modal Relation Consistency (IRC), which explicitly models inter-object relations by enforcing the relational structure among linguistic entities to match that of their visual counterparts. Extensive experiments on RefCOCO, RefCOCO+, and RefCOCOg demonstrate that OCAAD achieves new state-of-the-art performance, validating the effectiveness of objectcentric alignment for WREC. Code is available at https://github.com/VILAN-Lab/OCAAD.

IJCAI 2026

Communication-Efficient Federated Video Human Activity Recognition via Discriminative Subspace Discovery

Allassan Tchangmena A Nken, Susan McKeever, Peter Corcoran, Ihsan Ullah

Federated learning (FL) enables privacy-preserving video human activity recognition without centralizing data. Despite its potential, FL remains fundamentally constrained by the high communication overhead incurred during training. Existing methods, such as model quantization, gradient sparsification and low-rank approximation, aim to mitigate this overhead but often at the cost of model expressivity, leading to reduced classification accuracy. In this work, we take a representation-centric perspective and show that for video-base activity recognition using pretrained embeddings, class-discriminative information lies in a very low-dimensional subspace, that preserves linear seperability between activity classes. Motivated by this observation, we propose Federated discriminative subspace discovery, a framework that collaboratively identify and operate within such a subspace. Instead of communicating full classifier updates, each client first projects its local video embeddings using a shared random projection matrix. It then computes the covariance of the projected embeddings and transmits this statistic to the server for aggregation. The server reconstructs a global covariance matrix, performs singular value decomposition, and selects the top-k eigenvectors that define the global class-discriminative subspace. Subsequent communication occurs only in this compact subspace. Extensive experiments on UCF101, HMDB51, and Toyota-SmartHome demonstrate that, learning and sharing the classifier in the discovered subspace, reduces communication costs by up to 61%, with a moderate drop in activity recognition accuracy compared to the full model.

IJCAI 2026

SpatialSV: Internalizing Interpretable 3D Spatial Awareness in MLLMs via Task-Oriented Visual Supervision

Jiayu Tang, Yuchen Zhou, Chao Gou

Unlocking the spatial intelligence of multimodal large language models (MLLMs) is crucial for understanding and interacting with the 3D world. Prevailing approaches typically inject spatial priors via external tools, which impose significant inference overhead, or rely on latent feature distillation, which remains uninterpretable and lacks fine-grained geometric constraints. To address these issues, we propose SpatialSV, a framework designed to internalize robust 3D spatial awareness within MLLMs while simultaneously offering inherent interpretability. Deviating from passive feature imitation, SpatialSV employs task-oriented visual supervision, compelling the model to actively lift its 2D visual features into explicit 3D representations, including depth maps, camera poses, and point clouds. Crucially, this 2D-to-3D lifting process provides a transparent window into the model’s representations: the resulting 3D reconstructions serve as an intuitive proxy for visualizing and diagnosing the quality of the model’s intrinsic spatial knowledge. Extensive experiments across multiple benchmarks and models demonstrate the effectiveness of SpatialSV in enhancing and interpreting MLLMs’ spatial intelligence. Furthermore, the framework exhibits strong generalization in semi-supervised settings, validating its potential to leverage unlabeled visual data for scalable, interpretable spatial representation learning.

IJCAI 2026

IdentityMask: A Robust Face-Centric Privacy Protection Against Unauthorized Personalization of Diffusion Models

Weiwei Tan, Rui Wang, Lihua Jing, Yanjun Zhang, Runbo Li, Leo Yu Zhang

Unauthorized personalization based on diffusion models pose a severe and growing threat to digital privacy by enabling the unauthorized replication and exploitation of individual identities. Existing disrupting-based defenses primarily add invisible perturbations arbitrarily across the entire image space to disrupt the generation process. However, we reveal that these methods fundamentally overlook the spatio-temporal dynamics of the personalization process, resulting in inefficient optimization that fails to sufficiently disrupt the core identity encoding mechanism. To mitigate these limitations, we propose IdentityMask, a robust protection framework that shifts the paradigm from arbitrary confusion to precise, targeted feature corruption. By anchoring the perturbation on subject-specific semantics and prioritizing the most critical diffusion timesteps, our framework ensures the disruption is maximized precisely where the identity is encoded. Additionally, a novel manifold projection strategy is introduced to embed the adversarial signals into the intrinsic structure of the image, rendering the protection resilient against state-of-the-art purification. Extensive experiments across diverse datasets, personalization techniques, and defense settings demonstrate that IdentityMask consistently outperforms prior state-of-the-art approaches in both protection efficacy and robustness.

IJCAI 2026

Open-Vocabulary Object 6D Pose Estimation via Modulated Textual Semantics

Zixuan Sun, Hui Shuai, Qingshan Liu

Estimating the 6D pose of novel objects without CAD models or video sequences remains a challenging problem. Recent works explore text-driven approaches to address this challenge in an open-vocabulary manner. However, these methods typically treat text embeddings as static priors, which lack the flexibility to adapt to specific visual scenes, thereby limiting reliable cross-view correspondences. In this paper, we propose a framework that modulates static textual embeddings into adaptable semantic guidance for RGB-D open-vocabulary 6D pose estimation. Specifically, we introduce a Text Feature Modulation (TFM) module that uses learnable queries to transform fixed text embeddings into adaptive semantic representations. These representations are explicitly calibrated by a Foreground-Grounded Semantic Alignment (FGSA) strategy, which suppresses background distractions via contrastive learning. Furthermore, we design a Semantic-Anchored Cross-view Fusion (SACF) module that aggregates image features from the reference and query views using modulated semantics as an invariant anchor. Finally, we predict object segmentation and establish semantic-aware correspondences, leveraging modulated textual semantics to filter mismatches for robust 6D pose estimation. Extensive experiments on standard benchmarks demonstrate that our method achieves superior performance.

IJCAI 2026

GRASP: Enhancing Zero-Shot Multi-Modal Anomaly Detection via Geometric Refinement and Semantic Prompting

Zhongbin Sun, Yuze Cui, Yong Zhou

Zero-shot multimodal anomaly detection is critical for identifying structural defects that are often invisible to traditional RGB images, particularly in scenarios lacking target domain samples. However, existing methodologies face two significant impediments: the prohibitive computational overhead caused by relying on multi-view rendering for depth processing, and the inability of static text prompts to adapt to fine-grained local anomalies. To address these challenges, a unified zero-shot multimodal anomaly detection framework GRASP is proposed. Firstly, a Frequency Domain Enhancement module is introduced to replace costly rendering with spectral transformations, directly synthesizing high-fidelity depth images for efficient utilization. Secondly, a Prompt-Conditioned Variational module is designed to bridge the semantic gap by grounding global textual descriptions into local visual nuances. Finally, a Dual Cross-Injection Alignment module is proposed to enable robust feature fusion for enhancing anomaly classification performance, while a Pyramid Anomaly Map Recalibration module further refines anomaly localization across multiple scales. Extensive experiments on MVTec 3D-AD and Eyecandies demonstrate that GRASP establishes a new state-of-the-art, yielding substantial improvements of 3.0 points in I-AUROC and 2.7 points in AUPRO compared to the SOTA method.

Keep browsing

More papers from top AI conferences

30+ top conferences, by conference, year, and topic.