AudioStreamSpeechCerulean [Azure platform speech services friendly to users and games]

Community Showcases
1

This Unity user friendly interface for Speech-to-text and Text-to-speech parts
of Microsoft Azure Cognitive Services.

  • Recognition and Synthesis basic tasks
  • Synthesis integrates properly with Unity AudioSource / AudioClip
  • synthesized audio can be optionally cached locally
  • Recognition/Synthesis components are scriptable ‘the Unity way’ and interaction is provided via Unity Events

1950×1300 307 KB

For more details please also see latest [documentation]
and Asset Store page which has also links for demo builds

2

Other speech modules are planned,

currently there’s also Google Cloud Platform Speech to text and Text to speech available separately, upon request only.
(Until GCP C# SDK supports HTTPV2 the solution is not fully featured and suited for public release)

3

the initial version is live

4

pls help i got some error using AudioSreamSpeechCerulean on Android App.
thanks

9130834--1267582--Screenshot_2023-07-07-15-14-00-115_com.r618.AudioStreamSpeechCeruleanDemo.jpg
9130834--1267582--Screenshot_2023-07-07-15-14-00-115_com.r618.AudioStreamSpeechCeruleanDemo.jpg2400×1080 179 KB

5

Hi, is this demo app from the store page, or your own Unity build ? Does the player work in editor / standalone ?
Let me know what phone/OS is this if it’s on the device, and make sure you have microphone access enabled in the manifest

  • there’s also newer version of Microsoft CognitiveServices Speech SDK than what’s included in the asset currently, if might be worth to import it [ https://aka.ms/csspeech/unitypackage ] and make build for the device
6

That was my own Unity build.
Currently i use Xiaomi Redmi Note 11 Pro 5G for testing.

I already installed Microsoft CognitiveServices Speech SDK version 1.30.00 in my Unity, but i got new error when testing on SynthesisDemo. How to run this asset on Andorid OS using my own build?

9151139--1272215--upload_2023-7-17_11-43-23.png

7

can you please do IL2CPP build ? i have a suspicion this is Mono file I/O failing

How was previous Error 0x15 resolved ? Was the reason microphone permission ?

/ - it will take some time until I get to this properly

Thanks !

8

An update pushed to store (could be online hopefully soon):

V 1.32.1 092023

  • updated MS SDK & demo builds
  • asset’s version is following version of the Microsoft.CognitiveServices.Speech unitypackage with which it was released
  • cosmetic UI changes
9

-** December '23 SALE **-

  • For two weeks - until about ~28th - the asset is 40% OFF

Don’t forget to download demos and enjoy the holidays - \o|

10

PSA: the asset’s included MS Speech SDK is at version 1.32.1 and will stay this way for foreseeable future probably since Microsoft apparently stopped distributing a ready to use unitypackage file –
(latest v. of the official SDK is currently 1.44.0)

All features of the asset against Azure Cloud seems to be fully functional currently, however -

It is possible to bring latest (1.44.0) SDK to Unity, but it’s right now not planned (at least not immediately).