Hello!
Here’s a simple game of Pong with Ray-Tracing done using Unity Sentis on URP renderer.
YouTube gameplay video
Screenshots
The entire scene is fully ray-traced AKA path-traced with dynamic lighting. The game runs at 4K 45-50 FPS on a Laptop RTX 3060. With slightly lowered quality, it runs at 1080p 30FPS on a mid-range Android. It achieves the look of ray-tracing without compromising on performance.
Training data created with Blender, trained with PyTorch and inference with Sentis. Pretty neat and streamlined workflow.
Let me know your thoughts!
4 Likes
That’s really nice.
I wonder what is the capacity of the model?
Ie after how many objects does quality starts to degrade?
1 Like
I haven’t done a stress test yet but yes, the quality will degrade a bit if there are large number of objects. I will add more objects and lights and post the results.
1 Like
Added a new theme with two lights - a spot light and a star shaped area light. Also showcasing refraction with roughness, reflections and shadows.
YouTube gameplay video
2 Likes
That’s the most mind-blowing use case I’ve seen with Sentis. Would love to see how that was made in details!
1 Like
UPDATE
Got textures, normal maps, metallic and roughness map working alongside the RT goodness. Wood and marble materials on walls, floor and ceiling.
2 Likes
Updated models and themes with a new Texture Extrapolator included. New gameplay elements also introduced with single and multi player modes added.
The extrapolator might be removed later if the quality does not improve with more training. Looks half-decent now but the lag is still very visible in textures when update rate is low. Performance is improved regardless and low update rate is worth it even without the extrapolator.
4 Likes
Great work! I wonder what is the input and output of the neural network model?
