I made a Unity tool that creates 3D models from text instructions. I’m hoping to get some feedback before it goes through the submission process. Especially whether you’d use AI generated 3D models at all?
If you’re interested in testing it for free, please message me and I can send a copy. In return, I’d appreciate some constructive feedback.
This video shows the 3D generation process. Note that this is an earlier version and the plugin no longer needs API keys.
Workflow:
Entering “A chibi fluffy sheep” would create a 3D model of a fluffy sheep.
Takes about 10 seconds.
Another option would be to upload an image and it creates a 3D model from it.
The model is saved to your Assets directory.
Quality:
The generated models are generally good enough for background characters/objects. But you wouldn’t be using them for anything that’s close up.
It is not good at creating models with flat surfaces, such as tables or chairs.
Polygon count can be high (10k-100k) depending on what you’re generating. This can be decreased significantly, but would be a work-in-progress.
The plugin would be a subscription since it needs cloud GPUs for inference. Unless people are ok with doing some manual installation, which can get a bit complicated.
Oh, nice! Is it generating on the server? The high poly count is definitely a barrier, but that’s a problem with those AI algos. I have my own ideas about how to generate the low-poly’s but after studying the market seems like a very risky product. So I’ll just tell you there is an interested audience at YCombinator’s Hacker News, and you can promote it on Product Hunt. Good luck.
This is cool and certainly useful, but I wanted to note two things:
Legality of the created models. What are these based on? What guarantees can you make that these are not infringing anyone’s copyright? This is crucial info for potential customers.
While it’s not been announced, Unity Muse will eventually feature model generation since the claim is to be able to “generate anything” that one needs for a game project. Generating animations for rigged characters is currently in development.
Neat. Quick tiny feedback: “Generate” button should switch to “Generating [ # seconds ]” so the button seems more responsive, or any similar feature, since it’s a bit long of a wait.
Yes it generates the model on the server, then the plugin downloads the model to the Asset directory in your Unity project.
The high poly count is something that can definitely be improved. I’ve made a lot of progress into this already.
I’m curious about your ideas on generating low polys. If you want to talk about it more, send me an email at david@makedraft.com. Maybe we can even collab on something. I agree, it certain looks to be a risky market.
I’ll definitely look into posting on Product Hunt and Hacker News. Thanks for the suggestion!
It was trained on datasets with licenses that permit for training. In terms of copyright, it comes down to the customer. The plugin can’t control what anyone puts in the prompt. Plus it could be for parody or legitimate use. If you were to contract a freelancer to design say an “anthropromorphic yellow cartoon mouse”, you’d still need to make sure it doesn’t look like a certain copyrighted model.
Yep that’s something I’m looking out for, but I’m not worried about this.
