Collider causes terrible lags

When I add collider attached to first person controller, game begins to lag, FPS drops to 2-3. Is it possible to solve this problem if i need collider attached to first person controller?

No single collider should cause that much of a performance problem. Take a peek at your console window. Are you seeing any errors? Possibly dozens of them?