Learning to Decode Against Compositional Hallucination in Video Multimodal Large Language Models

Abstract

Current research on video hallucination mitigation primarily focuses on isolated error types, leaving *compositional* hallucinations—arising from incorrect reasoning over multiple interacting spatial and temporal factors largely underexplored. We introduce **OmniVCHall**, a benchmark designed to systematically evaluate both isolated and compositional hallucinations in Video Large Language Models (VLLMs). OmniVCHall spans diverse video domains, introduces a novel camera-based hallucination type, and defines a fine-grained taxonomy, together with adversarial answer options (*e.g.*, “All are correct” and “None of the above”) to prevent shortcut reasoning. The evaluations of 39 representative VLLMs reveal that even advanced models (*e.g.*, Qwen3-VL and GPT-5) exhibit substantial performance degradation. We propose **TriCD**, a contrastive decoding framework with a triple-pathway calibration mechanism. An adaptive perturbation controller dynamically selects distracting operations to construct negative video variants, while a saliency-guided enhancement module adaptively reinforces grounded token-wise visual evidences. These components are optimized via reinforcement learning to encourage precise decision-making under compositional hallucination settings. Experimental results show that **TriCD** consistently improves performance across two representative backbones, achieving an average accuracy improvement of over 10\%. The data and code are released at https://github.com/BMRETURN/OmniVCHall.