Is it really true that if character controller is not used,
then it is just a collider and affected by physics effect?
Not used means set if statement something and stop the move() or simplemove() sequence of controller.
Is it true that what is just a collider? The CharacterController component itself? If so, yes, a CharacterController is just a Collider with additional behaviour.