Muse First impression

The last time I used Muse was way back when it was in early beta, and now a lot of things have changed

Good Things

  1. I liked how Muse is now part of the editor - This has made it a lot easier and convenient, whether it’s directly being able to share scripts or get Muse to make changes in something directly

  2. It takes more time to answer - but it’s a good thing. Not only does it give a more realistic effect of thinking, but it’s also better to get a proper answer one time rather than generating multiple responses.

  3. Excels in unity specific takes - I’ve used other general AI models for general gamedev-related tasks, whether it’s asking about errors or fixing bugs. But for Muse, there are some things that I couldn’t find a solution to elsewhere. Unlike other models, Muse gives accurate information on engine-related issues and settings.

Improvements:

  1. A mode for quicker response - Although I like that Muse takes longer to process and give answers with better accuracy, I think there should be a mode for quicker response. Even a “Hi” prompt takes a lot longer to respond to. This would be useful when asking general and simple things

  2. Old chats get removed while entering game mode - Whenever I enter game mode or do something that causes scripts to load, it makes previous chats unavailable and starts a new chat. Although the chat is still available in history, this doesn’t always happen.

That’s it for now. Other than that, I’ve seen a huge improvement in Muse and hope to see the same in the future.

3 Likes

Hi @NIKUNG, I’m so glad to hear and appreciate the feedback! We are working hard to provide tooling that’s helpful so this is really great to hear! Do keep sharing your thoughts on improvements and what you find useful.

If you want to join the beta to try out more features of Muse Chat, we have a fast track process in place! :clap:

  1. Sign up on the AI-beta list if you haven’t already: Unity AI updates | Join the mailing list
  2. Sign up on the fast track here: https://forms.gle/4VZTRzjrnJ3BCy4A6

Hey! I’ve taken a look at this my side and I’m not seeing this behaviour. What I am seeing is that entering play mode clears the Muse Chat window, then reloads the history and current chat a few about 2-3 seconds later. The time is likely to vary depending on the system and latency.

I did witness one time where the chat did not reload after play mode (but the history did). This seems like a race condition.

Anyway, I’ve made a ticket to investigate this.

I’m curious, are you on the latest version of the product? I’ve tested against the latest release as of today. If you’re up to date, we’ll try to repro the problem and find a fix.

yes i am on the latest version and t the issue doesn’t always happens but i have notice it happened so maybe it is a uncommon issue

Great, thanks for the info! I’ve made a ticket and we’ll try and track down the issue.

Here are some of my impressions:

Installed Unity 6 and chatted with Muse. My first surprise was asking for textures and being told to use Photoshop because Muse was incapable of generating textures. It took me a while to independently figure out I needed to install a separate tool. (I was expecting image generation to happen within the chat box.)

My request for a “brick wall” texture returned dozens of worthless results before I gave up. My request for “grass” returned some decent results, but most had a strange line through them. I was looking forward to PBR materials, unfortunately the maps are only 512x512 with poor resolution. In my opinion none of it is usable. I was really hoping we could generate skyboxes, which would be awesome.

Sprites were generally usable. I was impressed how reliable the transparent background option worked.
It would be amazing if we could generate sprite sheets for animated particles.

I asked about shaders and was given some advice that seemed moderately helpful. Obviously it would be ideal if Muse could automatically add nodes and connect them instead of telling me to do it.

Humanoid animations were not usable either. I think it would help a lot if they looped seamlessly. Also it would be really cool if we could edit them a little to fix their mistakes. Probably this tool should be integrated with an existing library of curated animations so we can start from a base instead of reinventing the wheel.

1 Like

Hi @Pliny2020 - This is such valuable feedback! Thank you for sharing, and pls keep it coming.

The texture question should actually direct you to the Muse Texture tool, so if you could let me know what the exact prompt was that you used – I’ll file a bug for that. Also thank you for sharing your expectations, that’s very helpful!

A few points: We are running a beta for integrating sprite generations from third-party model providers directly in the same window. Sign up here if you are curious to try it out!

I am glad to hear that you are positively surprised by how well deleting backgrounds! worked Also - interesting comment about shader nodes, we haven’t gotten there yet but it sure is something we might investigate going forward. If you want to try out the ability to run commands on your behalf, you can also sign up on the beta for Muse Chat /run.

For looping the animation, you can change this in the settings so that they do, the same goes for adjusting the effectors on the animation to adjust the body in specific positions at every frame. Is that what you are referring to or is it something else?

Have a look in our Unite demo for seeing all tools and features that I mentioned above :smiley: https://www.youtube.com/watch?v=1somUEsi0t8