Streaming images to both eyes

Hello,

I’m trying to implement a NVidia CloudXR client for Unity (basically I have to render a dual video stream coming from CloudXR to both eyes).

I was able to implement the whole pipeline in Unity (by studing the CloudXR Quest native sample). Basically I blit the buffers directly to Unity left/right cameras.

Buffers seem to be fine (I checked in RenderDoc) but for some reason the stereo is broken when testing in the headset.

Does anybody have experience with streaming data directy to both eyes in VR ? Does anybody tried to implement a CloudXR client in Unity ?

Not sure what I’m missing here… I was wondering if some matrix needs to be applied during the blit to camera buffer to fix this stereo issue.

Any help would be greatly appreciated! Thanks!

1 Like

Hi,

Are you sure the cloud is streaming left, and right images with the desired ipd for you?
Perhaps rendering a few frames to some textures, to compare will tell.

Haven’t tested this my self at all.

Hello,

Thanks for the suggestion. As far I know the ipd is correct. I’ll double check to see if it could be related to my problem.

Where you able to implement a NVidia CloudXR client for Unity? If yes, Can you share details about the implementation.