Terrain textures lighter in right eye in VR because of TerrainLit material

Hello!
I am working on a game for VR (first time for VR) and I came along this issue with TerrainLit material/Terain shader of a terrain.
The textures of terrain are much lighter in the right eye in VR.

Left eye is exactly same as editor. I put two pictures together and noticed that issue is not present on any object, not even custom trees or grass. Only thing affected is terrain. It is most noticeable on dark and bright textures, but is also present on green, where in the left eye there is barely any difference to other green, but in right eye, it is very overblown:

Textures are literally simple png, all of them. I tried some fixes, no matter what I disabled it persisted, I disabled everything in the scene except the camera and terrain, issue persisted. I also changed skybox and lighting settings, still.
Then I changed terrain material to a random one and issue was fixed. Of course, all my textures were gone and terrain is unusable like this but it confirmed that issue is with TerrainLit material or its shader Universal Render Pipeline/Terrain/Lit. I use Performance URP Config (Universal Render Pipeline Asset).

So my question is, has anyone come across problem like this? If so, how can I fix this? In VR it feels weird and makes game of course unplayable.

For anyone with same problem, I did not find the solution to it, probably would be solved by editing shader or something.

But I downloaded Mesh Terrain Editor from Unity Store and Converted terrain to Mesh and problem went away. I used Shader type URP, everyhing unchecked, with Vertex Count up to maximum (for free version 2k) and it converted terrain into mesh. But it did not convert trees or details. So I put old terrain in same place as new MeshTerrain and unchecked “Draw” in old terrain place = details and trees from old terrain while textures and actual terrain is new MeshTerrain.

EDIT: Wanted to delete this, as I found out, the issue is with using more than 4 textures. And Mesh Terrain Editor lets you convert Terrain with up to 4 textures only. So it doesnt really solve anything in regards to this problem.