WebGL and Microphone

[ammarvohra]

Hello @gfoot I download and run it on WebGL platform but I cannot see the things happening as your build file.

I am not getting the init actually…

please help me out…

[dakume]

hey @gfoot do you have this code on github somewhere? i think the library may need to get tweaked because it’s breaking. i don’t mind working on it a bit.

[dawidk]

hey @gfoot would you mind sharing your work on github? the link mentioned above is dead. just as @dakume mentioned a few people would be interested in developing a solution for mic input in webgl and it seems like a good starting point.

[arnabghosh]

Hello everyone,
Can you tell me where do i find the MicrophoneWebGL.unitypackage.
Because above links are showing.
“This site can’t be reached”

[arnabghosh]

@gfoot

Here is a microphone plugin then: http://www.gfootweb.webspace.virginmedia.com/MicrophoneWebGL.unitypackage

It is crude and basic. Look at TestMicrophoneWebGL.cs for a usage example.

You can also try out that example here: http://www.gfootweb.webspace.virginmedia.com/TestMicrophoneWebGL/

Note that the demo only works on Firefox due to limitations in Unity’s audio playback code. The microphone side of things works fine on both - at least, I see sensible-looking data even on Chrome, I just can’t get it into an audioclip to actually play it back again.

As shown in the example, you should call Init(), then call PollInit() until it stops saying “pending”. Hopefully it then says “ready”, in which case you can carry on; otherwise it will say an error of some sort. One reason for the polling is that the user will be prompted to allow access to the microphone, so we need to wait for that.

Once it is initialized you can call Start() to start recording and Stop() to stop recording. During recording, the plugin buffers up the microphone data in units of whatever buffer size you passed into Init(). You can query how many buffers it is holding using GetNumBuffers(), and you can pop the next buffer using GetBuffer().

These functions should work fine both during recording and after stopping, and you could in theory record indefinitely, so long as you consume the buffers. If there are no pending buffers then GetBuffer() also returns false, so you could just poll it from your Update() function and ignore GetNumBuffers.

Hello gfoot,
Can you tell me where do i find the MicrophoneWebGL.unitypackage.
Because above links are showing.
“This site can’t be reached”

[theylovegames]

@arnabghosh

Hello gfoot,
Can you tell me where do i find the MicrophoneWebGL.unitypackage.
Because above links are showing.
“This site can’t be reached”

Bah must’ve switched phone providers and lost the web storage.

Okay starting over… WebGL plugins…

Unity - Manual: Interaction with browser scripting

[theylovegames]

I have a few more tweaks to go, but it’s basically working. I still need to incorporate supporting multiple microphones and multiple sample rates in the WebGL plugin.

The HTML5 media API is a beast. When you just want the raw wave data it gives you blobs. When you have a blob you need to run it through a request to extract the bytes. Or you can bypass that and get the direct float data and you have to handle the timing manually.

There’s another nice things like needing to run in HTTPS if you don’t want to always see the Microphone access prompt.

Anyway, I’m improving this over time. WIP demo: Unity WebGL Player | WordDetection

I have a C# interface that mirrors the regular Microphone API and uses the WebGL jslib when needed.

[specweapons]

I am building a very small API C# interface to the WebGL JS AudioCapture Device for Unity3d to replace the missing microphone. It is in testing but the result is looking very pleasing right now. It has testing modes to show what is happening, and will be just bringing the data back into the standard Unity engine as a set of buffers being recorded, pointer to where the next buffer is going to, and buffer status information. This can be used by application programmers or applied to Audio Source for games. I want to sell it to fund important future motherboard GPU hardware improvements.

How big of demand is there for this? I am going to use it for my own testing of some AI I have worked on for years and in school. Just using Unity3D to model it. Are there people out there willing to pay for a functional testable, “Unity3d WebGL Microphone Asset”. I would probably version different Asset Products according to what their functionality is. I can get it ready for simple use as a (dll/js script) nuget package as an asset and get it on the Unity Asset store if anyone thinks it would be useful.

Here is some of the Test Debug Info it outputs as a visual output to verify functionality, i.e. Integration Test.

[twobob]

• Cough *
  Wayback Machine

[sama-van]

@twobob

• Cough *
  https://web.archive.org/web/20160512222051/http://www.gfootweb.webspace.virginmedia.com/MicrophoneWebGL.unitypackage

dead URL

@ :
Still not in build?
Microphone still not working in the last version of Unity…

[Schubkraft]

Sorry, but it is still not supported by Unity.

You might give this Unity Asset Store - The Best Assets for Game Making a go for your microphone needs.

[sama-van]

@Schubkraft

Sorry, but it is still not supported by Unity.
You might give this https://www.assetstore.unity3d.com/en/#!/content/79989 a go for your microphone needs.

[sama-van]

Found this which is free :
https://github.com/tgraupmann/UnityWebGLMicrophone

It detects my microphones from the webGL player but didn’t success to use it yet…

I am actually trying to use it with this :

• GitHub - zombience/audio_analyzer: base project for basic real-time audio amplitude analysis in unity3d

Wondering if someone made it works?

[twobob]

@sama-van

dead URL

@ :
Still not in build?
Microphone still not working in the last version of Unity…

It isn’t dead. I just downloaded it again. no issues grabbing it.

And individually both of those other components you listed work “okay” on my builds here.
Perhaps if you were a bit more explicit with your intentions people could be more helpful.
There are some notes that the audio_analyzer is not “real-time ready” and other notes to indicate a code hook is required to get the mic working as you might expect. Perhaps it is one of those caveats. Probably a new question is appropriate at that point.

The support for getUserMedia is spotty at best at the moment. - that possibly needs love https://stackoverflow.com/questions/28991835/firefox-navigator-getusermedia-is-not-a-function/28991938

Short answer. No. No native support yet

[sonicviz]

I just tried another project to build to WebGL and getting the dreaded error CS0103: The name `Microphone’ does not exist in the current context two and half years later.

Is this likely to be in soon?
WebAudio supports it no?

ah…I see. Still at “The Microphone class is not supported in WebGL.”

Unity - Manual: Audio in WebGL

[system]

@Schubkraft Opened 2015, asking in 2019. WebGL Microphone support? Upcoming?

[system]

This looks like a good alternative for now:

Unity ID

[Psyco92]

@Schubkraft

There is no timeline associated with the mic support.
So if you really need it now go the way pointed out by gfoot.
Sorry.

Clearly…

[xzesstence]

@Schubkraft

Well, it is on our list but the priority is not high at all.

Sorry Unity Team but as a User who switched from another Big Engine, i can not understand points like this.
In 5 Years you didn’t provide mic support for WebGL… wow

[Marvbr]

Any news? Would be very useful for a project I am working on right now.