Problem with collider (Rigidbody and physics)

I’m doing a project where the player can control many characters. The problem is, when i approax two of them, physics act, sending the one i’m not controlling to the hell, or bumping off. I tried with rigidbody and without, with, and whitout kinematic, character controler… I ONLY want my characters to have gravity and collisions, without these frustrating physics. There’s a way i can get that, or have i to do my own collider script?