LooseControlVideo: Directorial Video Control using Spatial Blocking

摘要

Precise 3D spatial orchestration in text-to-video generationremains a signi_x001C_cant challenge, particularly for multi-object scenes wheresemantic layout and temporal dynamics are often entangled. While exist-ing depth-conditioned models achieve good structural _x001C_delity, they neces-sitate dense, frame-accurate guidance that is labor-intensive to authorfor dynamic events involving deformable objects. We present LooseC-ontrolVideo (LCV), a framework that enables intuitive and expressivecontrol by using sparse, oriented 3D boxes as a _x0010_blocking_x0011_ proxy. Thisallows users to author high-level layout and trajectory while leveraginga video generative model to generate realistic occlusions, dynamics andinteractions. We achieve this by _x001C_ne-tuning a Wan 2.2 backbone on avideo dataset annotated with DNOCS, a novel encoding for 3D size, ori-entation and depth-ordered occlusions. Furthermore, our method allowsfor localized re_x001C_nement_x0016_such as adjusting a jump trajectory or addingan interaction_x0016_with minimal disruption to the global scene context. Ex-tensive evaluations on the nuScenes, HO-3D, and BEHAVE benchmarksdemonstrate that LCV signi_x001C_cantly outperforms existing 2D-box and_x001D_ow-based baselines. Our _x001C_ndings indicate a 1.2-3x improvement in Tra-jectory Error; 2x improvement in Rigid Motion Consistency; and a 1.5-2x increase in Occlusion Accuracy over current state-of-the-art layout-conditioned models, demonstrating that oriented 3D primitives providegood geometric prior for complex, multi-agent video authoring.