Streaming live video from desktop over web into Unity (VNC, OBS, IP camera, MJPEG...)

Unity Engine
1

Hello guys,

hopefully, I’m in the right forum here.

I’m currently starting on a project where we want to stream the desktop of one PC to another PC into a Unity application (Hololens 2 app) over the web.

Our initial thought was to utilize VNC - however, unsuccessful until now. Similar projects (e.g., GitHub - cfloutier/Unity-VNC-Client: Unity 3D Vnc Client : Port of the VncSharp: A .NET VNC Client Library) are outdated and do not run correctly anymore (either due to Unity version, I do use 2021.3.2f1 or due to older VNC protocols).

Other ideas were utilizing OBS or common streaming technologies, (e.g., MJPEG streaming from some online IP web cameras for testing). Still, only deprecated reference projects were found or projects that only work locally.

I would really appreciate any hint or any pointing into the right direction.

Thanks

2

Unfortunately, we don’t have something right now, but we plan to support it at one point. You can vote or request features on our roadmap for any features. It helps us to prioritize our work. Platform roadmaps | Unity

But to answer, I don’t know any workaround other than finding a plugin or external library. We have a package for WebRTC, but I don’t think WebRTC is great for streaming desktops. WebRTC | WebRTC | 2.3.3-preview

1 Like