Player randomly teleports when door hits him

I am using mouse drag door open.
On my player I am using Character Controller.
When I open the door and the door hits my player, he teleports on a location on the map.
If I remove
controller.Move(moveDirection * Time.deltaTime);
The player doesn’t teleport, but its not moving.

Any solutions?

I found out where was the problem after 2-3 hours of searching.

There was object with box collider as big as the map

That was the reason of teleporting.