New Apple AI model generates 3D scenes from just three images

New Apple AI model generates 3D scenes from just three images

Apple’s Machine Learning team, in collaboration with researchers from Nanjing University and The Hong Kong University of Science and Technology, has announced an interesting 3D AI model called Matrix3D. This so-called Large Photogrammetry Model is able to reconstruct 3D objects and scenes from just a few 2D photos, but with a big difference from current pipelines. Here’s why this is a big deal. more…

Apple research paper unveils Matrix3D for 3D content generation

Photogrammetry has long been a staple in 3D scene reconstruction, but its traditional pipeline, dense image requirements, disconnected processing stages, and cumulative error, has been a stubborn bottleneck. Apple’s new Matrix3D model, detailed in a recently released research paper, presents a unified framework designed to remove those barriers by integrating multiple photogrammetry tasks into a single, generative system. Unlike traditional phot…

Apple's New Matrix3D Model Can Turn Flat Images Into Dynamic 3D Scenes

Apple researchers released a new artificial intelligence (AI) model that can generate 3D views from multiple 2D images. The large language model (LLM), dubbed Matrix3D, was developed by the company’s Machine Learning team, in collaboration with Nanjing University and the Hong Kong University of Science and Technology (HKUST). The Cupertino-based tech giant has made the AI model available to the open community, and it can be downloaded via Apple’…