My character stays in his idle animation when he moves down
This is too vague. It might either be a logic problem in your code, or a setup problem between transitions in your animation / animator controller, which you should be additionally posting info about.