In conjunction with the launch of OpenAI’s new GPT-5 model, Microsoft introduced an innovative tool called Copilot 3D. This feature allows users to convert standard 2D images into dynamic 3D models, which can be utilized in a variety of applications including game development, animation, 3D printing, and virtual or augmented reality.
Copilot 3D only requires a clean, high-quality 2D image and does not necessitate any text prompts. Microsoft suggests that images with clear backgrounds or distinct subject separation yield the best results. During testing, it was observed that images with uniform lighting and depth facilitate the conversion process more effectively.
This tool is part of Copilot Labs, indicating that it remains a preview feature accessible to a limited group of users. Notably, all Copilot users across the globe can experiment with it, even those who are not subscribed to Copilot Pro. Interested users can access it via the web version.
While Copilot 3D shows promise, it appears to struggle with rendering anatomical features accurately. For instance, a test with an image of a dog produced unexpected results. The AI mistakenly represented a section of the dog’s anatomy in an unintended manner.
In contrast, Copilot 3D excels in converting various 2D objects into 3D forms. Successful attempts included 3D models of Ikea furniture, beach balls, umbrellas, and bananas. The furniture, sourced from the IKEA website, yielded impressive 3D models that could be seamlessly integrated into augmented reality applications. Although the tool initially faced difficulties with the umbrella, a clearer image resulted in a nearly perfect reproduction. The AI even retained the shadow from the original image, which can be easily modified using design software. Bananas proved to be particularly easy for Copilot 3D to process.
Users are restricted to uploading 2D images that are smaller than 10MB in either JPG or PNG formats. The conversion results will be stored for 28 days, allowing users to download them in the GLB format, compatible with numerous 3D viewers and design software. Additionally, these files can be converted into STL format for use in Blender or for 3D printing.
Attempts to generate 3D models from images of celebrities like Tim Cook and Taylor Swift were unsuccessful, with the tool returning a “Cannot generate content” message, likely due to copyright protections in place. Microsoft advises users to upload only original images they possess the rights to, and prohibits content depicting individuals without their consent. A test to model a personal photograph revealed that the results were not ideal.
Despite restrictions, creating 3D models of video game characters, such as Mario, was possible, although the results varied significantly in quality. Microsoft warns that accounts may be restricted if illegal content or violations of their Copilot Code of Conduct are detected.
