Skip to main content

OpenAI’s new Shap-E tool is Dall-E for 3D objects

OpenAI‘s latest endeavor, Shap-E, is a model that allows you to generate 3D objects from text, not unlike how Dall-E can create 2D images.

According to OpenAI, Shap-E is “a conditional generative model for 3D assets. Unlike recent work on 3D generative models which produce a single output representation, Shap-E directly generates the parameters of implicit functions that can be rendered as both textured meshes and neural radiance fields.”

The company’s GitHub posting goes on to explain how Shap-E is trained on a combination of mapping 3D assets and a conditional diffusion model.

However, this free-to-run program is a little more challenging to install and set up than the company’s ever-popular ChatGPT, as was explored by Tom’s Hardware.

You can download the Shap-E model on GitHub at no charge and access it on Microsoft Paint 3D. It also works when converted into an STL file, which allows the renders you create to be brought to life via 3D printers.

While this basic knowledge of the Shap-E model might seem simple enough, some tech savviness might be required to get the model installed and running.

The publication’s editor-in-chief, Avram Piltch, tested out Shap-E, which he claims took him eight hours to wrap his mind around. He added that OpenAI offers little by way of instructions outside of explaining that you should use a Python pip command for installation.

Once installed, Piltch says he was able to test prompts with color-animated GIF files and monochrome PLY files, with the animated GIFs being favorable, he noted.

Some prompts included a shark, a Minecraft creeper, and “an airplane that looks like a banana,” all of which had varying levels of quality depending on their file type. Piltch also used the model’s function, which lets users upload a 2D image for conversion into a 3D object.

The editor noted that those attempting to install Shap-E and render 3D objects should keep in mind that the model requires a lot of system resources from a PC.

In particular, Shap-E is compatible only with Nvidia GPUs and requires high-performance CPUs to render in a matter of minutes as opposed to hours.

Editors' Recommendations

Fionna Agomuoh
Fionna Agomuoh is a technology journalist with over a decade of experience writing about various consumer electronics topics…
GPT-4 vs. GPT-3.5: how much difference is there?
The ChatGPT website on an iPhone.

Have you heard of GPT-4? It's the latest language model for OpenAI's natural language chatbot, and it's said to be much better than GPT 3.5, which is available on ChatGPT. But how much better is it and what makes it different?

That's what we're here to find out, with a direct head-to-head comparison of these two exciting, but distinctly different language models. Ultimately, we can decide whether it's worth paying the extra for a ChatGPT Plus subscription, or if it's better to just use GPT-4 for free.
What are GPT 3.5 and GPT-4?

Read more
MiniGPT-4: A free image-to-text AI tool you can try out today
what is minigpt 4 screenshot 2023 04 26 at 06 55 pm

ChatGPT is great, but right now, it's limited to just text -- text in, text out. GPT-4 was supposed to expand on this by adding image processing to allow it to generate text based on images.

MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models

Read more
Why pay for GPT-4? This AI tool gives it to you for free, plus more
A grid showing avatars of fictional and historical personas available as chatbots from Forefront AI.

An AI company you've probably never heard of just launched an advanced chatbot that provides free access to OpenAI's GPT-4 and lets you save and share conversations, generate images, and more.

Forefront AI announced the new service via a tweet that contains video demonstrations of the various features. Barsee, a well-known AI enthusiast, amplified the message with a tweet that led to a surge in traffic.

Read more