NeuroMamba: A Universal Spatiotemporal Module for Robust Perception in Degraded Sensory Streams
Authors: Jinfeng Li, Huijia Song, Xiangyue Hu, HanLiang Zhou, Jiahui Zhang, Xinpeng Jiang, Fangli Guan, Bin Lin, Dingran Dong, Liqi Yan, Pan Li
Abstract
In open-world intelligent systems, processing continuous sensory streams disrupted by heterogeneous degradation sources presents a fundamental challenge: reconciling the inherent tension between observational completeness and reconstruction fidelity. Methods that prioritize completeness by bridging long-term occlusions often introduce spurious artifacts, while approaches that focus on aggressive noise suppression inevitably disrupt temporal continuity and erase valid structures. To address this challenge, we propose NeuroMamba, a universal plug-and-play module that enhances spatiotemporal consistency in degraded streams. NeuroMamba tackles the dual objectives through two synergistic components. First, we introduce a regional Hybrid Spatiotemporal Rectification (HSR) module, which leverages Mamba-based inertial modeling of linear complexity to recover short-horizon temporal dependencies and infer missing modalities under partial observability. Second, we design a Spiking Confidence Gate (SCG) that enforces reconstruction fidelity under occupancy-guided supervision. Implemented as a hard-thresholding spiking gate unit based on leaky integrate-and-fire (LIF) neurons, SCG distinguishes valid geometric features from sensor noise based on accumulated temporal evidence. Extensive experiments on the nuScenes robustness benchmark demonstrate that NeuroMamba effectively reconciles the trade-off between completeness and fidelity, outperforming the performance of existing approaches in restoring high-fidelity spatiotemporal features from severely incomplete and degraded observations.