World-Consistent Video Diffusion With Explicit 3D Modeling - Apple Machine Learning Research - WiredFocus

World-Consistent Video Diffusion With Explicit 3D Modeling - Apple Machine Learning Research - WiredFocus

As diffusion models dominating visual content generation, efforts have been made to adapt these models for multi-view image generation to create 3D content. Traditionally, these methods implicitly learn 3D consistency by generating only RGB frames, which can lead to artifacts and inefficiencies in training. In contrast, we propose generating Normalized Coordinate Space (NCS) frames alongside RGB frames. NCS frames capture each pixel’s global coo…