My collision matrix is completely out of whack

So far, dealing with the collision matrix has been a nightmare.
Nothing is working like they’re suppose to.
I am working in 2D.
I want everything to collide with terrain. enemies only ignore player and other enemies.
but the way it turned out…I am all confused. what’s happening

ok I have made the situation somewhat better but it still does not quite work.
under over ride in boxcollider 2d, I selected nothing in include layers and enemy in exclude layers.
it now interacts well with the environment but enemy layer still does not ignore each other.

EDIT SOLUTION:
Ok, I have found the problem but it leads to new problems. it was navmesh agent that I attached to my enemy object. It has its own colliderbox. Apparently there’s no way to disable that. I could side step the problem by changing the avoidance radius to a small number but then it gets stuck on other obstacles. – partimelhero just now

Translation: You may be able to complete your requirements by closing the enemy and their corresponding layers, such as UI and UI