Multiview Mannequins for Deep Depth Estimation in 360º Videos

Abstract

We estimate depth maps from real-life monocular 360º VR videos using a Deep Neural Net architecture trained on 3D point-based renderings of people (called depth “mannequins”) captured with a Multi36 camera setup and processed with a combined pipeline of AI Instance Segmentation, Structure from Motion and Multi View Stereo methods.