SALSA Lipsync Suite - lip-sync, emote, head, eye, and eyelid control system

Faster!

:stuck_out_tongue:

2 Likes

The following add-ons should now be available:

A quick pass has been completed on the original blog posts for info/instructions. We will be moving documentation to the /docs repository in the near future.

NOTE: SalsaMicInput no longer needs to be configured to use an attenuated mixer group. With the new analysis engine in SALSA LipSync v2, you can mute the microphone at the AudioSource and lip-sync will get along just fine!

1 Like

OK! This should solve an issue I had with the MicInput… I always got a late echo like a weird sampling loop that came back 20sec later, but pitched slower… I could never solve it. I also route my mic through an audio app to delay it a fraction of a second to match the SALSA delay, but that weird sampling loop was a spoiler…. This new way should let me just mix my live Mic with Unity audio output (externally) and avoid the sampling issue.

1 Like

Oh dang! That totally works!

BUY THIS THING, Y’ALL! :smile: MUTE IS WORTH ANY PRICE! :stuck_out_tongue:

1 Like

Will the old toon box head work with salsa 2? I’ve grown quite fond of him.

Our Dissonance Voice Chat integration add-on, SalsaDissonanceLink is now live in downloads (and docs should be good to go as well). Dissonance Voice Chat - SALSA LipSync Suite v2

Yep, he should work just fine. :wink:

Unity’s Microphone input is a touchy little beastie. Input data is stored in a circular AudioClip of configurable length and if the AudioSource play-head gets ahead of the Microphone record-head, you get that weird delay of how ever many seconds the clip buffer is set to. I believe the old version of micInput was set to 10 seconds. I can’t explain the slower/lower pitch - that’s weird. It is also pretty easy for the heads (pointers) to get out of sync. One of the biggest culprits is application focus and pausing – at least from what I’ve seen. If the application is paused for whatever reason, it’s best to simply restart the micInput recording using StopMicrophone() & StartMicrophone().

Regardless of where playback thinks it is, SALSA LipSync v2’s analysis is continually calibrated to the microphone’s record position. That doesn’t solve the audible playback issues, but it does make the analysis as close to real-time as it can be. So, if you don’t need the microphone playback to be audible, it works about as good as it can. For those that need to output to loudspeakers, it may work best to split microphone output to an amp (preferably with a small or adjustable delay to really dial things in) and avoid using the AudioSource output from Unity’s microphone input.

Thanks for the feedback wetcircuit!
Darrin

1 Like

Is there an equivalent to the properties for in v1? I want to trigger an event and none of the component types look particularly suited for that.

Hello,

Which v1 properties are you referring to? Can you tell us more about what you’re trying to do?

Our blog posts for the following add-ons have been updated for SALSA LipSync Suite:

Wow, SALSA LipSync Suite is currently listed as the 3rd most popular asset on the store. That’s amazing…thanks everyone!

2 Likes

Um, not really, I can’t find the original documentation and don’t see what I’m looking for in v1. I had a foggy memory of there being a public property or properties set to the current “state” (saySmall, sayMedium, and so on.) I had planned to use that to drive properties on materials and VFX for animation.

The v1 documentation is still available.
https://crazyminnowstudio.com/unity-3d/lip-sync-salsa/manuals/

In v2, you can drive textures and materials directly from the UI by changing the animation controller type.

Dialogue System integration for SALSA LipSync Suite is now available. Please see [this post]( [RELEASED] Dialogue System for Unity - easy conversations, quests, and more! page-108#post-4677815) for details.

2 Likes

Since I upgraded to V2 I got this:
Assembly ‘Library/ScriptAssemblies/Assembly-CSharp-Editor-firstpass.dll’ will not be loaded due to errors:
Reference has errors ‘SALSA-LipSync’.
Before I was OK. Please help.
Thank you,
CJ

Hi metafunnel,

It sounds like you might be using the unsupported Unity beta version 2019.2? Is this in a new project? SALSA v2 is not backwards compatible with v1 since it is a complete rewrite and require a new setup on all SALSA enabled character.

Congrats on the V2 release, I just bought it. Very excited to get started. I wanted to know if you have a demo video showcasing the new head and eye animations? Curious to see how they look. Great job btw on the new version.

Yep. that’ll be good for a wholesale change to a from one material to another, but won’t let me change their exposed properties as I understand it. Neither is any help with VFX graphs.

— Edited above to be slightly more clear about what I DO want to change using an expression component or whatever it would take. Also sent mail to support. Thanks.

Send us all of your pertinent information (in an email to assetsupport@crazyminnow.com), including your invoice number and a reference to your ID in this thread. It will, of course, be necessary to have sufficient detail about what you want to accomplish. SALSA v2 is very flexible in its underlying design, so we’ll see what we can figure out for you.

1 Like