[RELEASED] Dialogue System Addon for OpenAI (ChatGPT), ElevenLabs, and Overtone

Flash Deal - Limited Time 70% off

The Dialogue System Addon for OpenAI is 70% off for a very limited time in the Asset Store’s Flash Deals sale.

If you missed the initial flash deal, you can still get the Dialogue System Addon for OpenAI at a whopping 50% off.

There’s a detailed Video Tutorial Series, including – for those RPG Builder users out there – a step-by-step setup of NPCs that you can chat with freeform at runtime using your microphone and they’ll speak back using voiceover and lipsync animation:

Dialogue System Addon for OpenAI (and other generative AI) 50% Off

Also keep an eye on the Flash Deals – the Dialogue System for Unity will be in a flash deal next week!

“Directing” Voice Performances With ElevenLabs

9785148--1403805--upload_2024-4-21_22-39-22.png
A dev recently asked how to “direct” the voice performances generated by the Dialogue System Addon’s ElevenLabs integration.

You can do it contextually.

For example, I tested this line in the Dialogue System’s Demo:

  • Private Hart says “Any luck downloading the launch codes?”
  • If I change the line to “Any luck downloading the launch codes???” the voice is more emphatic and excited.
  • If I change it to “any… luck, uh, downloading the launch codes…?” the voice is subdued and hesitant.

If you want a pause that doesn’t imbue the voice with hesitation or shyness, use a dash (-) instead of ellipsis (…).

Also, the choice of voice actor affects the results. Some actors recorded very monotone performances. Other actors overacted every line so you can get very melodramatic readings.

All CAPS makes them shout, btw.

Reminder - The Dialogue System Addon for OpenAI, ElevenLabs, and Overtone is 50% Off right now in the Spring Sale.
(Requires the Dialogue System for Unity, and is nicely integrated with the Dialogue System.)

The Dialogue System Addon for OpenAI, ElevenLabs, Overtone, and Other Generative AI is 50% off in the Spring Sale!

Here’s a video that shows how to set up an RPG Builder project from scratch with the Addon for OpenAI to run dynamic conversations at runtime with ElevenLabs-generated voice acting and SALSA lipsync animation:

Get Dialogue System for Unity - Addon for Generative AI - Quest Machine

how do you generate audio for other languages other than english with elevenlabs? generate voiceover only shows english language

Hi! In the upcoming version 1.0.14 (releasing Monday), the localization field’s AI button is now a dropdown that lets you select Translate or Voiceover:

9854733--1419057--upload_2024-5-25_9-44-29.png

With ElevenLabs, you don’t need to specify a language. From their manual:

Supported languages

Our TTS API is multilingual and currently supports the following languages:

Chinese, Korean, Dutch, Turkish, Swedish, Indonesian, Filipino, Japanese, Ukrainian, Greek, Czech, Finnish, Romanian, Russian, Danish, Bulgarian, Malay, Slovak, Croatian, Classic Arabic, Tamil, English, Polish, German, Spanish, French, Italian, Hindi and Portuguese.

To use them, simply provide the input text in the language of your choice.

thank you for your fast response. that update is just what I needed.

1 Like

Version 1.0.14 of the Dialogue System Addon for OpenAI, ElevenLabs, and other generative AI is live on the Asset Store – now with powerful GPT-4o integration!

Another nice addition: The “AI” button in localized dialogue text fields is now a dropdown so you can choose to translate the text using OpenAI or generate localized voiceover audio.

The Addon is currently 50% off in the Template Toolkit Sale, too.

Amazing Update. Just tried it out. You guys should add the ability to select the Elevenlabs model when doing voiceover. Because when I tried using Multilingualv2 in Spanish(my native language) for a girl character, sometimes it gives me a male voice. When I changed the model to Multilingualv1(Elevenlabs website recommends using it for this voice when doing it through the website) it gives a female voice every time.

Thanks for the feedback! I’ll add that option in the next update.

Dialogue System Addon for OpenAI+ v1.0.19 Released

Version 1.0.19 is now available on the Asset Store!

Recent release notes:

  • Updated optional assembly definitions package to work with Dialogue System assembly definitions.
  • Handles new format **ActorName:** returned by OpenAI.
  • Improved: Disambiguates namespaces from other third party OpenAI-Unity packages.
  • Improved: Now supports and defaults to GPT-4o-mini.
  • Improved: Assistant Window lets you choose any chat model and defaults to GPT-4o-mini.
  • Added: OpenAI text to speech generation.
  • Added: Branching dialogue text generator. (Dialogue Smith replacement.)
  • Improved: Different base URL can now be set for editor time use, too.
  • DeepVoice: Added integration.
  • ElevenLabs: Added Multilingual1 and Multilingual2 options.