How to go through objects with character controler

I have a player with character controller and I want to implement a mechanic where player dashes through another player, both will have rigidbodies. What I struggle with is that when I do something like Physics.IgnoreCollisions() then I can get behind the object but it does not go through it but it steps over it. Is there a way to actually go through it? Thank you very much

If you want players to never collide, use the Physics Layer Collision Matrix. (edit>project settings>physics)