Hi @arybak89 ,
Another option you could consider is using the camera on the HoloLens to take a picture of the real world and then render that to a full-screen quad which could serve as your scene’s backdrop. Then you could distort the backdrop. However, keep in mind that using the HoloLens camera for this operation comes at a performance cost.