2D Character will teleport a bit up when activating movement

Whenever I walk with my character, my character will teleport a bit up whenever it starts moving. Then whenever I stop moving, the character teleports back down?