Vision Pro camera view video feed

Hello, we are working on an MR application where the user with Vision Pro can join calls with other users and share their view, which includes the camera and 3D objects in the scene. Is it currently possible to access these informations, even separately?

You can’t access the real-world camera feed, if that’s what you mean; that’s a limitation that Apple enforces for security reasons. You should be able to access the Persona view (which is what applications such as Zoom would display from the visionOS) via WebCamTextures. As for (virtual) 3D objects, there are various ways you could synchronize these between applications. For example, you could use standard Unity netcode or you could render to a RenderTexture and encode its contents as a video stream.

2 Likes

Thanks for the info :+1:

1 Like