Importing Kokoro-82M TTS ONNX Model: Current Unsupported Features and Future Support Timeline

Unity Engine
, , ,
1

I’m trying to import kokoro-82M (TTS) onnx model but I get these errors (I’m using the latest Sentis 2.1.1):

  • ConcatFromSequence not supported
  • Loop not supported
  • SequenceEmpty not supported
  • SplitToSequence not supported

when are these going to get supported?

2

I am not in the position to promise anything. We will take a look at the kokoro model and the missing operators.

Meanwhile, here is the list of supported ONNX operators.

3

This model is great. I would like to use it in my games with sentis. Please support it.

4

Another vote for Kokoro please, searching for “kokoro Unity” brought me here :slight_smile: Thanks for all your hard work!

5

We really need more TTS solution so I’m adding my vote

6

Yes, this would be fantastic. Kokoro seems like one of the best quality and small TTS. Would be fantastic to get it to narrate some parts of the game.

7

Looking forward to being able to use Kokoro!

8

I would also like to see Kokoro in Unity.

9

I’ve tried it out with the new Unity Inference Engine, but unfortunately, it’s still not supported due to missing operators:

telegram-cloud-photo-size-2-5276113705773428346-y
telegram-cloud-photo-size-2-5276113705773428346-y1280×345 74.3 KB

Are there any updates about supporting these operators?

10

We have developed an alternative to Kokoro called Lingotion Thespeon - it does not use the unsupported operators and thus works with the current version of Inference Engine. If you are interested in trying it out, check out our github repo!

11

Unity is now officially supporting Kokoro TTS. They have added an example here:

12

Interesting, it looks like those operators still aren’t supported: Supported ONNX operators | Sentis | 2.5.0