CameraAnything: Refilming Videos with Arbitrary Camera Control
作者: Yixuan Li, Yanhong Zeng, Ka Leong Cheng, Jiayi Zhu, Hanlin Wang, Wen Wang, Yihao Meng, Hao OUYANG, Qiuyu Wang, Yue Yu, Zidong Wang, Yiyuan Zhang, Yujun Shen, Dahua Lin
摘要
We introduce CameraAnything, the first unified frame-work for camera controlled video editing that enables joint control ofboth intrinsic and extrinsic camera parameters. Existing approaches ei-ther rely on expensive 3D reconstruction to achieve full camera function-ality or restrict editing to extrinsic parameter manipulation. Moreover,the coupled influence of intrinsic and extrinsic parameters on video ap-pearance makes disentangled modeling particularly challenging. To ad-dress this, we adopt per-pixel Plücker ray injection alongside resolution-aware 3D RoPE in self-attention, building both camera conditioning andspatial positional encoding on the target latent to jointly control cam-era position, focal length, and native resolution editing without croppingor outpainting. To overcome the scarcity of paired training data, wefurther develop a scalable synthetic pipeline that constructs diverse dy-namic scenes through structured multi-camera recording and generatessynchronized videos with varied camera configurations. With a tailoredorthogonal training strategy, CameraAnything enables expressive videoreshooting with arbitrary viewpoint control, focal length adjustment, res-olution adaptation, and multi-shot transitions within a single generationprocess, offering strong practical value for cinematic video editing andcross-platform content adaptation in video production.